@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 7a9c20c715
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

Bum up transformers version (#976)

Woosuk Kwon committed Sep 8, 2023 at 05:15 UTC 7a9c20c71521f9bfce5bb88fda5a1308b7351c82
1 file changed +1 -1
requirements.txt
+1 -1
@@ -4,7 +4,7 @@ ray >= 2.5.1
4 sentencepiece # Required for LLaMA tokenizer.
5 numpy
6 torch >= 2.0.0
7 -transformers >= 4.31.0 # Required for LLaMA-2.
7 +transformers >= 4.33.1 # Required for Code Llama.
8 xformers >= 0.0.21
9 fastapi
10 uvicorn