| 1 | # Examples |
| 2 | |
| 3 | vLLM's examples are organized into the following categories: |
| 4 | |
| 5 | - **[`basic/`](../../examples/basic)** – Minimal examples for offline inference and online serving. |
| 6 | - **[`generate/`](../../examples/generate)** – Text generation examples, including multimodal models. |
| 7 | - **[`pooling/`](../../examples/pooling)** – Examples for embedding, classification, scoring, reward, etc. |
| 8 | - **[`speech_to_text/`](../../examples/speech_to_text)** – Speech transcription, translation and real-time audio examples. |
| 9 | - **[`features/`](../../examples/features)** – Demonstrations of individual vLLM features: automatic prefix caching, speculative decoding, LoRA, structured outputs, prompt embedding, pause/resume, batch invariance, KV events, data parallelism, and more. |
| 10 | - **[`reasoning/`](../../examples/reasoning)** – Examples for reasoning with vLLM. |
| 11 | - **[`tool_calling/`](../../examples/tool_calling)** – Examples for function/tool calling with vLLM. |
| 12 | - **[`applications/`](../../examples/applications)** – Application examples such as simpler api server, chatbots and RAG (Retrieval-Augmented Generation). |
| 13 | - **[`rl/`](../../examples/rl)** – Reinforcement learning examples. |
| 14 | - **[`deployment/`](../../examples/deployment)** – Examples for deploying vLLM in production. |
| 15 | - **[`ray_serving/`](../../examples/ray_serving)** – Scalable serving using Ray. |
| 16 | - **[`disaggregated/`](../../examples/disaggregated)** – Examples for Disaggregated P/D (Prefill/Decoding) inference, including various kv cache connectors (LMCache, Mooncake, FlexKV, P2P NCCL) and failure recovery. |
| 17 | - **[`scale_out/`](../../examples/scale_out)** – Examples for Token In <> Token Out API Server. |
| 18 | - **[`observability/`](../../examples/observability)** – Metrics, logging, tracing (OpenTelemetry), and dashboards (Grafana, Perses). |