A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 18:15 UTC
[Bugfix] add >= 1.0 constraint for openai dependency (#7612)
Xander Johnson committed
Aug 16, 2024 at 20:56 UTC
7c0b7ea2141246d2904fc8d8cf501411e81bb429
1 file changed
+1
-1
requirements-common.txt
+1
-1
@@ -9,7 +9,7 @@ tokenizers >= 0.19.1 # Required for Llama 3.
9
protobuf # Required by LlamaTokenizer.
10
fastapi
11
aiohttp
12
-openai
12
+openai >= 1.0 # Ensure modern openai package (ensure types module present)
13
uvicorn[standard]
14
pydantic >= 2.0 # Required for OpenAI server.
15
pillow # Required for image processing