@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 730e9592e9
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 03:15 UTC

[Doc] Recommend uv and python 3.12 for quickstart guide (#11849)

Signed-off-by: mgoin <michael@neuralmagic.com>

Michael Goin committed Jan 8, 2025 at 22:37 UTC 730e9592e97c643474aa44e9d3dbe6f55c4b9ad9
1 file changed +11 -2
docs/source/getting_started/quickstart.md
+11 -2
@@ -15,10 +15,19 @@ This guide will help you quickly get started with vLLM to perform:
15 ## Installation
16
17 If you are using NVIDIA GPUs, you can install vLLM using [pip](https://pypi.org/project/vllm/) directly.
18 -It's recommended to use [conda](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) to create and manage Python environments.
18 +
19 +It's recommended to use [uv](https://docs.astral.sh/uv/), a very fast Python environment manager, to create and manage Python environments. Please follow the [documentation](https://docs.astral.sh/uv/#getting-started) to install `uv`. After installing `uv`, you can create a new Python environment and install vLLM using the following commands:
20 +
21 +```console
22 +$ uv venv myenv --python 3.12 --seed
23 +$ source myenv/bin/activate
24 +$ uv pip install vllm
25 +```
26 +
27 +You can also use [conda](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) to create and manage Python environments.
28
29 ```console
21 -$ conda create -n myenv python=3.10 -y
30 +$ conda create -n myenv python=3.12 -y
31 $ conda activate myenv
32 $ pip install vllm
33 ```