A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 16:00 UTC
[Doc][Bugfix] Add missing EOF in k8s deploy doc (#16025)
Paul Schweigert committed
Apr 6, 2025 at 08:10 UTC
d5ae4f7f421eacd8de2f7fb012ca7b1ef88e9c71
1 file changed
+1
docs/source/deployment/k8s.md
+1
@@ -46,6 +46,7 @@ metadata:
46
type: Opaque
47
data:
48
token: $(HF_TOKEN)
49
+EOF
50
```
51
52
Next, start the vLLM server as a Kubernetes Deployment and Service: