main
md 9 lines 335 Bytes
Rendered Raw
1 # Disaggregated Serving
2
3 This example contains scripts that demonstrate the disaggregated serving features of vLLM.
4
5 ## Files
6
7 - `disagg_proxy_demo.py` - Demonstrates XpYd (X prefill instances, Y decode instances).
8 - `kv_events.sh` - Demonstrates KV cache event publishing.
9 - `mooncake_connector` - A proxy demo for MooncakeConnector.