@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / d1b689c445
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 03:30 UTC

[Bugfix] Fix flaky `test_streaming_response` test (#20363)

Signed-off-by: NickLucche <nlucches@redhat.com>

Nicolò Lucchesi committed Jul 3, 2025 at 16:46 UTC d1b689c44588a15f7a3d5812414b428963b2bb4b
1 file changed +1 -1
requirements/common.txt
+1 -1
@@ -13,7 +13,7 @@ tokenizers >= 0.21.1 # Required for fast incremental detokenization.
13 protobuf # Required by LlamaTokenizer.
14 fastapi[standard] >= 0.115.0 # Required by FastAPI's form models in the OpenAI API server's audio transcriptions endpoint.
15 aiohttp
16 -openai >= 1.52.0 # Ensure modern openai package (ensure types module present and max_completion_tokens field support)
16 +openai >= 1.52.0, <= 1.90.0 # Ensure modern openai package (ensure types module present and max_completion_tokens field support)
17 pydantic >= 2.10
18 prometheus_client >= 0.18.0
19 pillow # Required for image processing