@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 6368e777a8
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

Add Aquila2 to README (#1331)

Signed-off-by: ldwang <ftgreat@gmail.com> Co-authored-by: ldwang <ftgreat@gmail.com>

ldwang committed Oct 13, 2023 at 03:11 UTC 6368e777a8ead7fb62054d3779c6237361ec0d86
1 file changed +1 -1
README.md
+1 -1
@@ -46,7 +46,7 @@ vLLM is flexible and easy to use with:
46
47 vLLM seamlessly supports many Hugging Face models, including the following architectures:
48
49 -- Aquila (`BAAI/Aquila-7B`, `BAAI/AquilaChat-7B`, etc.)
49 +- Aquila & Aquila2 (`BAAI/AquilaChat2-7B`, `BAAI/AquilaChat2-34B`, `BAAI/Aquila-7B`, `BAAI/AquilaChat-7B`, etc.)
50 - Baichuan (`baichuan-inc/Baichuan-7B`, `baichuan-inc/Baichuan-13B-Chat`, etc.)
51 - BLOOM (`bigscience/bloom`, `bigscience/bloomz`, etc.)
52 - Falcon (`tiiuae/falcon-7b`, `tiiuae/falcon-40b`, `tiiuae/falcon-rw-7b`, etc.)