A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 03:15 UTC
[Doc] Recommend uv and python 3.12 for quickstart guide (#11849)
Signed-off-by: mgoin <michael@neuralmagic.com>
Michael Goin committed
Jan 8, 2025 at 22:37 UTC
730e9592e97c643474aa44e9d3dbe6f55c4b9ad9
1 file changed
+11
-2
docs/source/getting_started/quickstart.md
+11
-2
@@ -15,10 +15,19 @@ This guide will help you quickly get started with vLLM to perform:
15
## Installation
16
17
If you are using NVIDIA GPUs, you can install vLLM using [pip](https://pypi.org/project/vllm/) directly.
18
-It's recommended to use [conda](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) to create and manage Python environments.
18
+
19
+It's recommended to use [uv](https://docs.astral.sh/uv/), a very fast Python environment manager, to create and manage Python environments. Please follow the [documentation](https://docs.astral.sh/uv/#getting-started) to install `uv`. After installing `uv`, you can create a new Python environment and install vLLM using the following commands:
20
+
21
+```console
22
+$ uv venv myenv --python 3.12 --seed
23
+$ source myenv/bin/activate
24
+$ uv pip install vllm
25
+```
26
+
27
+You can also use [conda](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) to create and manage Python environments.
28
29
```console
21
-$ conda create -n myenv python=3.10 -y
30
+$ conda create -n myenv python=3.12 -y
31
$ conda activate myenv
32
$ pip install vllm
33
```