@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 76879342a3
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

[Doc]add lora support (#3649)

Jee Li committed Mar 27, 2024 at 10:06 UTC 76879342a33352b4e7cd08de36a0474ad2e25453
1 file changed +2 -2
docs/source/models/supported_models.rst
+2 -2
@@ -22,11 +22,11 @@ Alongside each architecture, we include some popular models that use it.
22 * - :code:`BaiChuanForCausalLM`
23 - Baichuan
24 - :code:`baichuan-inc/Baichuan2-13B-Chat`, :code:`baichuan-inc/Baichuan-7B`, etc.
25 - -
25 + - ✅︎
26 * - :code:`ChatGLMModel`
27 - ChatGLM
28 - :code:`THUDM/chatglm2-6b`, :code:`THUDM/chatglm3-6b`, etc.
29 - -
29 + - ✅︎
30 * - :code:`DeciLMForCausalLM`
31 - DeciLM
32 - :code:`Deci/DeciLM-7B`, :code:`Deci/DeciLM-7B-instruct`, etc.