A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 04:15 UTC
[Docs] Add Command-R to supported models (#3669)
Woosuk Kwon committed
Mar 27, 2024 at 15:20 UTC
6d9aa00fc404f8877287d559fbdac4f7a05330de
2 files changed
+5
README.md
+1
@@ -67,6 +67,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
67
- Baichuan & Baichuan2 (`baichuan-inc/Baichuan2-13B-Chat`, `baichuan-inc/Baichuan-7B`, etc.)
68
- BLOOM (`bigscience/bloom`, `bigscience/bloomz`, etc.)
69
- ChatGLM (`THUDM/chatglm2-6b`, `THUDM/chatglm3-6b`, etc.)
70
+- Command-R (`CohereForAI/c4ai-command-r-v01`, etc.)
71
- DBRX (`databricks/dbrx-base`, `databricks/dbrx-instruct` etc.)
72
- DeciLM (`Deci/DeciLM-7B`, `Deci/DeciLM-7B-instruct`, etc.)
73
- Falcon (`tiiuae/falcon-7b`, `tiiuae/falcon-40b`, `tiiuae/falcon-rw-7b`, etc.)
docs/source/models/supported_models.rst
+4
@@ -27,6 +27,10 @@ Alongside each architecture, we include some popular models that use it.
27
- ChatGLM
28
- :code:`THUDM/chatglm2-6b`, :code:`THUDM/chatglm3-6b`, etc.
29
- ✅︎
30
+ * - :code:`CohereForCausalLM`
31
+ - Command-R
32
+ - :code:`CohereForAI/c4ai-command-r-v01`, etc.
33
+ -
34
* - :code:`DbrxForCausalLM`
35
- DBRX
36
- :code:`databricks/dbrx-base`, :code:`databricks/dbrx-instruct`, etc.