A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 13:30 UTC
[Doc] Add two links to disagg_prefill.md (#17168)
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
Michael Yao committed
Apr 25, 2025 at 18:23 UTC
f851b8426659d00a264eaab5ef0f69f70e592e37
1 file changed
+2
-2
docs/source/features/disagg_prefill.md
+2
-2
@@ -21,11 +21,11 @@ Disaggregated prefill DOES NOT improve throughput.
21
22
## Usage example
23
24
-Please refer to `examples/online_serving/disaggregated_prefill.sh` for the example usage of disaggregated prefilling.
24
+Please refer to <gh-file:examples/online_serving/disaggregated_prefill.sh> for the example usage of disaggregated prefilling.
25
26
## Benchmarks
27
28
-Please refer to `benchmarks/disagg_benchmarks/` for disaggregated prefilling benchmarks.
28
+Please refer to <gh-file:benchmarks/disagg_benchmarks> for disaggregated prefilling benchmarks.
29
30
## Development
31