A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 07:15 UTC
[docs] fix: fix markdown syntax (#18927)
H committed
May 29, 2025 at 22:20 UTC
5acf828d9932fb109f18b9790d0bca011a9ed868
1 file changed
+1
-2
docs/design/arch_overview.md
+1
-2
@@ -48,8 +48,7 @@ for output in outputs:
48
print(f"Prompt: {prompt!r}, Generated text: {generated_text!r}")
49
```
50
51
-More API details can be found in the [Offline Inference]
52
-(#offline-inference-api) section of the API docs.
51
+More API details can be found in the [Offline Inference](#offline-inference-api) section of the API docs.
52
53
The code for the `LLM` class can be found in <gh-file:vllm/entrypoints/llm.py>.
54