@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 24a36d6d5f
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

Update link to LlamaStack remote vLLM guide in serving_with_llamastack.rst (#11112)

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>

Yuan Tang committed Dec 11, 2024 at 21:39 UTC 24a36d6d5f789fd2d5105174c24528fc7e659b00
1 file changed +1 -1
docs/source/serving/serving_with_llamastack.rst
+1 -1
@@ -24,7 +24,7 @@ Then start Llama Stack server pointing to your vLLM server with the following co
24 config:
25 url: http://127.0.0.1:8000
26
27 -Please refer to `this guide <https://github.com/meta-llama/llama-stack/blob/main/docs/source/getting_started/distributions/self_hosted_distro/remote_vllm.md>`_ for more details on this remote vLLM provider.
27 +Please refer to `this guide <https://llama-stack.readthedocs.io/en/latest/distributions/self_hosted_distro/remote-vllm.html>`_ for more details on this remote vLLM provider.
28
29 Inference via Embedded vLLM
30 ---------------------------