A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
[DOC] Update production-stack.md (#26177)
Signed-off-by: Elieser Pereira <elieser.pereiraa@gmail.com>
Elieser Pereira committed
Oct 5, 2025 at 18:32 UTC
f509a208462d42e26bdee861db711d4cb2910505
1 file changed
+2
-2
docs/deployment/integrations/production-stack.md
+2
-2
@@ -55,7 +55,7 @@ sudo kubectl port-forward svc/vllm-router-service 30080:80
55
And then you can send out a query to the OpenAI-compatible API to check the available models:
56
57
```bash
58
-curl -o- http://localhost:30080/models
58
+curl -o- http://localhost:30080/v1/models
59
```
60
61
??? console "Output"
@@ -78,7 +78,7 @@ curl -o- http://localhost:30080/models
78
To send an actual chatting request, you can issue a curl request to the OpenAI `/completion` endpoint:
79
80
```bash
81
-curl -X POST http://localhost:30080/completions \
81
+curl -X POST http://localhost:30080/v1/completions \
82
-H "Content-Type: application/json" \
83
-d '{
84
"model": "facebook/opt-125m",