A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 06:45 UTC
Update run_on_sky.rst (#2025)
sharable -> shareable
Ikko Eltociear Ashimine committed
Dec 12, 2023 at 03:32 UTC
c0ce15dfb2b4316d5a519adbbd7c5c04d7718b9f
1 file changed
+1
-1
docs/source/serving/run_on_sky.rst
+1
-1
@@ -55,7 +55,7 @@ Start the serving the LLaMA-13B model on an A100 GPU:
55
56
$ sky launch serving.yaml
57
58
-Check the output of the command. There will be a sharable gradio link (like the last line of the following). Open it in your browser to use the LLaMA model to do the text completion.
58
+Check the output of the command. There will be a shareable gradio link (like the last line of the following). Open it in your browser to use the LLaMA model to do the text completion.
59
60
.. code-block:: console
61