A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 4, 02:30 UTC
[Docs] Fix OpenAI batch model argument examples (#42066)
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
Ethan Feng committed
May 8, 2026 at 22:02 UTC
4140faa4a51d42cb9618949bee28fd47682f611c
1 file changed
+2
-2
examples/features/openai_batch/README.md
+2
-2
@@ -193,7 +193,7 @@ You can now run the batch runner, using the urls generated in the previous secti
193
python -m vllm.entrypoints.openai.run_batch \
194
-i "https://s3.us-west-2.amazonaws.com/MY_BUCKET/MY_INPUT_FILE.jsonl?AWSAccessKeyId=ABCDEFGHIJKLMNOPQRST&Signature=abcdefghijklmnopqrstuvwxyz12345&Expires=1715800091" \
195
-o "https://s3.us-west-2.amazonaws.com/MY_BUCKET/MY_OUTPUT_FILE.jsonl?AWSAccessKeyId=ABCDEFGHIJKLMNOPQRST&Signature=abcdefghijklmnopqrstuvwxyz12345&Expires=1715800091" \
196
- --model --model meta-llama/Meta-Llama-3-8B-Instruct
196
+ --model meta-llama/Meta-Llama-3-8B-Instruct
197
```
198
199
or use command-line:
@@ -202,7 +202,7 @@ or use command-line:
202
vllm run-batch \
203
-i "https://s3.us-west-2.amazonaws.com/MY_BUCKET/MY_INPUT_FILE.jsonl?AWSAccessKeyId=ABCDEFGHIJKLMNOPQRST&Signature=abcdefghijklmnopqrstuvwxyz12345&Expires=1715800091" \
204
-o "https://s3.us-west-2.amazonaws.com/MY_BUCKET/MY_OUTPUT_FILE.jsonl?AWSAccessKeyId=ABCDEFGHIJKLMNOPQRST&Signature=abcdefghijklmnopqrstuvwxyz12345&Expires=1715800091" \
205
- --model --model meta-llama/Meta-Llama-3-8B-Instruct
205
+ --model meta-llama/Meta-Llama-3-8B-Instruct
206
```
207
208
### Step 4: View your results