@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / dc903e70ac
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

[ROCm] Upgrade transformers to v4.38.0 (#2967)

Woosuk Kwon committed Feb 21, 2024 at 09:46 UTC dc903e70acf9dba74d6afaa50e7b5650d6b9338a
1 file changed +1 -1
requirements-rocm.txt
+1 -1
@@ -6,7 +6,7 @@ ray >= 2.9
6 sentencepiece # Required for LLaMA tokenizer.
7 numpy
8 tokenizers>=0.15.0
9 -transformers >= 4.37.0 # Required for Mixtral.
9 +transformers >= 4.38.0 # Required for Gemma.
10 fastapi
11 uvicorn[standard]
12 pydantic >= 2.0 # Required for OpenAI server.