A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 04:15 UTC
[Doc] minor fix to neuron-installation.rst (#3505)
Jim Burtoft committed
Mar 19, 2024 at 16:21 UTC
2a60c9bd174c4eaba790ecb36d13fa4c145d99f4
1 file changed
+1
docs/source/getting_started/neuron-installation.rst
+1
@@ -128,6 +128,7 @@ Once neuronx-cc and transformers-neuronx packages are installed, we will be able
128
129
.. code-block:: console
130
131
+ $ git clone https://github.com/vllm-project/vllm.git
132
$ cd vllm
133
$ pip install -U -r requirements-neuron.txt
134
$ pip install .