A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 10:45 UTC
Update link to KServe deployment guide (#9173)
Yuan Tang committed
Oct 8, 2024 at 23:58 UTC
acce7630c1dd655ca95a9f1abff23d92ef76262c
1 file changed
+1
-1
docs/source/serving/deploying_with_kserve.rst
+1
-1
@@ -5,4 +5,4 @@ Deploying with KServe
5
6
vLLM can be deployed with `KServe <https://github.com/kserve/kserve>`_ on Kubernetes for highly scalable distributed model serving.
7
8
-Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/vllm/>`_ for more details on using vLLM with KServe.
8
+Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/>`_ for more details on using vLLM with KServe.