A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 08:00 UTC
Bum up transformers version (#976)
Woosuk Kwon committed
Sep 8, 2023 at 05:15 UTC
7a9c20c71521f9bfce5bb88fda5a1308b7351c82
1 file changed
+1
-1
requirements.txt
+1
-1
@@ -4,7 +4,7 @@ ray >= 2.5.1
4
sentencepiece # Required for LLaMA tokenizer.
5
numpy
6
torch >= 2.0.0
7
-transformers >= 4.31.0 # Required for LLaMA-2.
7
+transformers >= 4.33.1 # Required for Code Llama.
8
xformers >= 0.0.21
9
fastapi
10
uvicorn