@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / df5dd3c68e
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

Add Baichuan-7B to README (#494)

Zhuohan Li committed Jul 25, 2023 at 15:25 UTC df5dd3c68ec7007e4b3a27907f4d954f1c7d511d
2 files changed +4
README.md
+1
@@ -42,6 +42,7 @@ vLLM is flexible and easy to use with:
42
43 vLLM seamlessly supports many Huggingface models, including the following architectures:
44
45 +- Baichuan-7B (`baichuan-inc/Baichuan-7B`)
46 - BLOOM (`bigscience/bloom`, `bigscience/bloomz`, etc.)
47 - GPT-2 (`gpt2`, `gpt2-xl`, etc.)
48 - GPT BigCode (`bigcode/starcoder`, `bigcode/gpt_bigcode-santacoder`, etc.)
docs/source/models/supported_models.rst
+3
@@ -14,6 +14,9 @@ Alongside each architecture, we include some popular models that use it.
14 * - Architecture
15 - Models
16 - Example HuggingFace Models
17 + * - :code:`BaiChuanForCausalLM`
18 + - Baichuan-7B
19 + - :code:`baichuan-inc/Baichuan-7B`.
20 * - :code:`BloomForCausalLM`
21 - BLOOM, BLOOMZ, BLOOMChat
22 - :code:`bigscience/bloom`, :code:`bigscience/bloomz`, etc.