| 1 | # Disaggregated Prefill V1 |
| 2 | |
| 3 | This example contains scripts that demonstrate disaggregated prefill in the offline setting of vLLM. |
| 4 | |
| 5 | ## Files |
| 6 | |
| 7 | - `run.sh` - A helper script that will run `prefill_example.py` and `decode_example.py` sequentially. |
| 8 | - Make sure you are in the `examples/disaggregated/example_connector` directory before running `run.sh`. |
| 9 | - `prefill_example.py` - A script which performs prefill only, saving the KV state to the `local_storage` directory and the prompts to `output.txt`. |
| 10 | - `decode_example.py` - A script which performs decode only, loading the KV state from the `local_storage` directory and the prompts from `output.txt`. |