A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 23:15 UTC
[CI/Build] Add tqdm to dependencies (#5680)
Cyrus Leung committed
Jun 19, 2024 at 22:37 UTC
e9c2732b976612b6362635be2984f03bfabc20ec
1 file changed
+1
requirements-common.txt
+1
@@ -4,6 +4,7 @@ psutil
4
sentencepiece # Required for LLaMA tokenizer.
5
numpy < 2.0.0
6
requests
7
+tqdm
8
py-cpuinfo
9
transformers >= 4.40.0 # Required for StarCoder2 & Llava, Llama 3.
10
tokenizers >= 0.19.1 # Required for Llama 3.