A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 04:15 UTC
[ROCm] Upgrade transformers to v4.38.0 (#2967)
Woosuk Kwon committed
Feb 21, 2024 at 09:46 UTC
dc903e70acf9dba74d6afaa50e7b5650d6b9338a
1 file changed
+1
-1
requirements-rocm.txt
+1
-1
@@ -6,7 +6,7 @@ ray >= 2.9
6
sentencepiece # Required for LLaMA tokenizer.
7
numpy
8
tokenizers>=0.15.0
9
-transformers >= 4.37.0 # Required for Mixtral.
9
+transformers >= 4.38.0 # Required for Gemma.
10
fastapi
11
uvicorn[standard]
12
pydantic >= 2.0 # Required for OpenAI server.