A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 11:00 UTC
[Misc] Add references in ray_serve_deepseek example (#17907)
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Rui Qiao committed
May 9, 2025 at 09:59 UTC
c44c384b1c85b2e83c7b1998fb2a3c1c981fdf6b
1 file changed
+3
-1
examples/online_serving/ray_serve_deepseek.py
+3
-1
@@ -1,7 +1,9 @@
1
# SPDX-License-Identifier: Apache-2.0
2
"""
3
Example to deploy DeepSeek R1 or V3 with Ray Serve LLM.
4
-See Ray Serve LLM documentation at:
4
+See more details at:
5
+https://docs.ray.io/en/latest/serve/tutorials/serve-deepseek.html
6
+And see Ray Serve LLM documentation at:
7
https://docs.ray.io/en/latest/serve/llm/serving-llms.html
8
9
Run `python3 ray_serve_deepseek.py` to deploy the model.