A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 6, 02:00 UTC
docs: fix broken offline inference paths in documentation (#37998)
Signed-off-by: Vineeta Tiwari <vineeta.tiwari2@ibm.com> Signed-off-by: Vineeta Tiwari <vineetatiwari2000@gmail.com> Co-authored-by: Vineeta Tiwari <vineeta.tiwari2@ibm.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Vineeta Tiwari committed
Mar 24, 2026 at 23:05 UTC
b58c5f28aa687de58e0d314eb1d43a3e26359689
2 files changed
+2
-2
docs/models/pooling_models/classify.md
+1
-1
@@ -89,7 +89,7 @@ probs = output.outputs.probs
89
print(f"Class Probabilities: {probs!r} (size={len(probs)})")
90
```
91
92
-A code example can be found here: [examples/offline_inference/basic/classify.py](../../../examples/basic/offline_inference/classify.py)
92
+A code example can be found here: [examples/basic/offline_inference/classify.py](../../../examples/basic/offline_inference/classify.py)
93
94
### `LLM.encode`
95
docs/models/pooling_models/embed.md
+1
-1
@@ -125,7 +125,7 @@ embeds = output.outputs.embedding
125
print(f"Embeddings: {embeds!r} (size={len(embeds)})")
126
```
127
128
-A code example can be found here: [examples/offline_inference/basic/embed.py](../../../examples/basic/offline_inference/embed.py)
128
+A code example can be found here: [examples/basic/offline_inference/embed.py](../../../examples/basic/offline_inference/embed.py)
129
130
### `LLM.encode`
131