A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 04:15 UTC
[Doc]add lora support (#3649)
Jee Li committed
Mar 27, 2024 at 10:06 UTC
76879342a33352b4e7cd08de36a0474ad2e25453
1 file changed
+2
-2
docs/source/models/supported_models.rst
+2
-2
@@ -22,11 +22,11 @@ Alongside each architecture, we include some popular models that use it.
22
* - :code:`BaiChuanForCausalLM`
23
- Baichuan
24
- :code:`baichuan-inc/Baichuan2-13B-Chat`, :code:`baichuan-inc/Baichuan-7B`, etc.
25
- -
25
+ - ✅︎
26
* - :code:`ChatGLMModel`
27
- ChatGLM
28
- :code:`THUDM/chatglm2-6b`, :code:`THUDM/chatglm3-6b`, etc.
29
- -
29
+ - ✅︎
30
* - :code:`DeciLMForCausalLM`
31
- DeciLM
32
- :code:`Deci/DeciLM-7B`, :code:`Deci/DeciLM-7B-instruct`, etc.