A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 01:45 UTC
[Bugfix] Fix CLI arguments in OpenAI server docs (#4729)
Allen.Dou committed
May 10, 2024 at 23:00 UTC
706588a77d2099b118f53a53ef2dd7f8c2de9ffc
1 file changed
+1
docs/requirements-docs.txt
+1
@@ -10,3 +10,4 @@ pydantic
10
torch
11
py-cpuinfo
12
transformers
13
+openai # Required by docs/source/serving/openai_compatible_server.md's vllm.entrypoints.openai.cli_args