@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 87fa80c91f
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

[Misc] Bump transformers to latest version (#4176)

Nick Hill committed Apr 18, 2024 at 14:36 UTC 87fa80c91f5b24a2ee1805b80c3eca8fd6600cd5
1 file changed +2 -1
requirements-common.txt
+2 -1
@@ -5,7 +5,8 @@ sentencepiece # Required for LLaMA tokenizer.
5 numpy
6 requests
7 py-cpuinfo
8 -transformers >= 4.39.1 # Required for StarCoder2 & Llava.
8 +transformers >= 4.40.0 # Required for StarCoder2 & Llava, Llama 3.
9 +tokenizers >= 0.19.1 # Required for Llama 3.
10 fastapi
11 uvicorn[standard]
12 pydantic >= 2.0 # Required for OpenAI server.