@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 6d9aa00fc4
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

[Docs] Add Command-R to supported models (#3669)

Woosuk Kwon committed Mar 27, 2024 at 15:20 UTC 6d9aa00fc404f8877287d559fbdac4f7a05330de
2 files changed +5
README.md
+1
@@ -67,6 +67,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
67 - Baichuan & Baichuan2 (`baichuan-inc/Baichuan2-13B-Chat`, `baichuan-inc/Baichuan-7B`, etc.)
68 - BLOOM (`bigscience/bloom`, `bigscience/bloomz`, etc.)
69 - ChatGLM (`THUDM/chatglm2-6b`, `THUDM/chatglm3-6b`, etc.)
70 +- Command-R (`CohereForAI/c4ai-command-r-v01`, etc.)
71 - DBRX (`databricks/dbrx-base`, `databricks/dbrx-instruct` etc.)
72 - DeciLM (`Deci/DeciLM-7B`, `Deci/DeciLM-7B-instruct`, etc.)
73 - Falcon (`tiiuae/falcon-7b`, `tiiuae/falcon-40b`, `tiiuae/falcon-rw-7b`, etc.)
docs/source/models/supported_models.rst
+4
@@ -27,6 +27,10 @@ Alongside each architecture, we include some popular models that use it.
27 - ChatGLM
28 - :code:`THUDM/chatglm2-6b`, :code:`THUDM/chatglm3-6b`, etc.
29 - ✅︎
30 + * - :code:`CohereForCausalLM`
31 + - Command-R
32 + - :code:`CohereForAI/c4ai-command-r-v01`, etc.
33 + -
34 * - :code:`DbrxForCausalLM`
35 - DBRX
36 - :code:`databricks/dbrx-base`, :code:`databricks/dbrx-instruct`, etc.