[Doc] Fix local input path in run-batch examples across docs (#53220)
QWERQWERQWE86 committed
Aug 26, 2026 at 20:17 UTC
15baeaee98263725aed9492dbb5df3ec8525bdff
2 files changed
+6
-6
docs/cli/README.md
+1
-1
@@ -196,7 +196,7 @@ Running with a local file:
196
197
```bash
198
vllm run-batch \
199
- -i features/openai_batch/openai_example_batch.jsonl \
199
+ -i examples/features/openai_batch/openai_example_batch.jsonl \
200
-o results.jsonl \
201
--model meta-llama/Meta-Llama-3-8B-Instruct
202
```
examples/features/openai_batch/README.md
+5
-5
@@ -36,7 +36,7 @@ wget https://raw.githubusercontent.com/vllm-project/vllm/main/examples/features/
36
Once you've created your batch file it should look like this
37
38
```bash
39
-cat features/openai_batch/openai_example_batch.jsonl
39
+cat examples/features/openai_batch/openai_example_batch.jsonl
40
{"custom_id": "request-1", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "meta-llama/Meta-Llama-3-8B-Instruct", "messages": [{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Hello world!"}],"max_completion_tokens": 1000}}
41
{"custom_id": "request-2", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "meta-llama/Meta-Llama-3-8B-Instruct", "messages": [{"role": "system", "content": "You are an unhelpful assistant."},{"role": "user", "content": "Hello world!"}],"max_completion_tokens": 1000}}
42
```
@@ -49,7 +49,7 @@ You can run the batch with the following command, which will write its results t
49
50
```bash
51
python -m vllm.entrypoints.launchers.run_batch \
52
- -i features/openai_batch/openai_example_batch.jsonl \
52
+ -i examples/features/openai_batch/openai_example_batch.jsonl \
53
-o results.jsonl \
54
--model meta-llama/Meta-Llama-3-8B-Instruct
55
```
@@ -58,7 +58,7 @@ or use command-line:
58
59
```bash
60
vllm run-batch \
61
- -i features/openai_batch/openai_example_batch.jsonl \
61
+ -i examples/features/openai_batch/openai_example_batch.jsonl \
62
-o results.jsonl \
63
--model meta-llama/Meta-Llama-3-8B-Instruct
64
```
@@ -119,7 +119,7 @@ wget https://raw.githubusercontent.com/vllm-project/vllm/main/examples/features/
119
Once you've created your batch file it should look like this
120
121
```bash
122
-cat features/openai_batch/openai_example_batch.jsonl
122
+cat examples/features/openai_batch/openai_example_batch.jsonl
123
{"custom_id": "request-1", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "meta-llama/Meta-Llama-3-8B-Instruct", "messages": [{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Hello world!"}],"max_completion_tokens": 1000}}
124
{"custom_id": "request-2", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "meta-llama/Meta-Llama-3-8B-Instruct", "messages": [{"role": "system", "content": "You are an unhelpful assistant."},{"role": "user", "content": "Hello world!"}],"max_completion_tokens": 1000}}
125
```
@@ -127,7 +127,7 @@ cat features/openai_batch/openai_example_batch.jsonl
127
Now upload your batch file to your S3 bucket.
128
129
```bash
130
-aws s3 cp features/openai_batch/openai_example_batch.jsonl s3://MY_BUCKET/MY_INPUT_FILE.jsonl
130
+aws s3 cp examples/features/openai_batch/openai_example_batch.jsonl s3://MY_BUCKET/MY_INPUT_FILE.jsonl
131
```
132
133
### Step 2: Generate your presigned urls