@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 7c0b7ea214
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

[Bugfix] add >= 1.0 constraint for openai dependency (#7612)

Xander Johnson committed Aug 16, 2024 at 20:56 UTC 7c0b7ea2141246d2904fc8d8cf501411e81bb429
1 file changed +1 -1
requirements-common.txt
+1 -1
@@ -9,7 +9,7 @@ tokenizers >= 0.19.1 # Required for Llama 3.
9 protobuf # Required by LlamaTokenizer.
10 fastapi
11 aiohttp
12 -openai
12 +openai >= 1.0 # Ensure modern openai package (ensure types module present)
13 uvicorn[standard]
14 pydantic >= 2.0 # Required for OpenAI server.
15 pillow # Required for image processing