A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 08:00 UTC
Add Baichuan-7B to README (#494)
Zhuohan Li committed
Jul 25, 2023 at 15:25 UTC
df5dd3c68ec7007e4b3a27907f4d954f1c7d511d
2 files changed
+4
README.md
+1
@@ -42,6 +42,7 @@ vLLM is flexible and easy to use with:
42
43
vLLM seamlessly supports many Huggingface models, including the following architectures:
44
45
+- Baichuan-7B (`baichuan-inc/Baichuan-7B`)
46
- BLOOM (`bigscience/bloom`, `bigscience/bloomz`, etc.)
47
- GPT-2 (`gpt2`, `gpt2-xl`, etc.)
48
- GPT BigCode (`bigcode/starcoder`, `bigcode/gpt_bigcode-santacoder`, etc.)
docs/source/models/supported_models.rst
+3
@@ -14,6 +14,9 @@ Alongside each architecture, we include some popular models that use it.
14
* - Architecture
15
- Models
16
- Example HuggingFace Models
17
+ * - :code:`BaiChuanForCausalLM`
18
+ - Baichuan-7B
19
+ - :code:`baichuan-inc/Baichuan-7B`.
20
* - :code:`BloomForCausalLM`
21
- BLOOM, BLOOMZ, BLOOMChat
22
- :code:`bigscience/bloom`, :code:`bigscience/bloomz`, etc.