A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 21:00 UTC
Update quickstart.md (#13958)
王博伟 committed
Feb 28, 2025 at 00:05 UTC
512d77d5821e1417b08617b6cf914c4207249a58
1 file changed
+6
docs/source/getting_started/quickstart.md
+6
@@ -24,6 +24,12 @@ source myenv/bin/activate
24
uv pip install vllm
25
```
26
27
+Another delightful way is to use `uv run` with `--with [dependency]` option, which allows you to run commands such as `vllm serve` without creating an environment:
28
+
29
+```console
30
+uv run --with vllm vllm --help
31
+```
32
+
33
You can also use [conda](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) to create and manage Python environments.
34
35
```console