@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / acce7630c1
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 10:45 UTC

Update link to KServe deployment guide (#9173)

Yuan Tang committed Oct 8, 2024 at 23:58 UTC acce7630c1dd655ca95a9f1abff23d92ef76262c
1 file changed +1 -1
docs/source/serving/deploying_with_kserve.rst
+1 -1
@@ -5,4 +5,4 @@ Deploying with KServe
5
6 vLLM can be deployed with `KServe <https://github.com/kserve/kserve>`_ on Kubernetes for highly scalable distributed model serving.
7
8 -Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/vllm/>`_ for more details on using vLLM with KServe.
8 +Please see `this guide <https://kserve.github.io/website/latest/modelserving/v1beta1/llm/huggingface/>`_ for more details on using vLLM with KServe.