A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 03:00 UTC
[Misc] Bump transformers to latest version (#4176)
Nick Hill committed
Apr 18, 2024 at 14:36 UTC
87fa80c91f5b24a2ee1805b80c3eca8fd6600cd5
1 file changed
+2
-1
requirements-common.txt
+2
-1
@@ -5,7 +5,8 @@ sentencepiece # Required for LLaMA tokenizer.
5
numpy
6
requests
7
py-cpuinfo
8
-transformers >= 4.39.1 # Required for StarCoder2 & Llava.
8
+transformers >= 4.40.0 # Required for StarCoder2 & Llava, Llama 3.
9
+tokenizers >= 0.19.1 # Required for Llama 3.
10
fastapi
11
uvicorn[standard]
12
pydantic >= 2.0 # Required for OpenAI server.