A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 06:00 UTC
Fix typo (#19525)
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
niu_he committed
Jun 12, 2025 at 17:24 UTC
dff680001dbe4e9ab1b1defdc2a5d17561122931
1 file changed
+1
-1
examples/offline_inference/basic/README.md
+1
-1
@@ -70,7 +70,7 @@ Try one yourself by passing one of the following models to the `--model` argumen
70
71
vLLM supports models that are quantized using GGUF.
72
73
-Try one yourself by downloading a GUFF quantised model and using the following arguments:
73
+Try one yourself by downloading a quantized GGUF model and using the following arguments:
74
75
```python
76
from huggingface_hub import hf_hub_download