A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 08:00 UTC
[Docs] Minor fixes in supported models (#920)
* Minor fix in supported models * Add another small fix for Aquila model --------- Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Woosuk Kwon committed
Sep 1, 2023 at 08:28 UTC
55b28b1eee3a94a8b1c812d461f68ff8f150d38e
1 file changed
+3
-3
docs/source/models/supported_models.rst
+3
-3
@@ -15,7 +15,7 @@ Alongside each architecture, we include some popular models that use it.
15
- Models
16
- Example HuggingFace Models
17
* - :code:`AquilaForCausalLM`
18
- - Aqualia
18
+ - Aquila
19
- :code:`BAAI/Aquila-7B`, :code:`BAAI/AquilaChat-7B`, etc.
20
* - :code:`BaiChuanForCausalLM`
21
- Baichuan
@@ -43,14 +43,14 @@ Alongside each architecture, we include some popular models that use it.
43
- :code:`internlm/internlm-7b`, :code:`internlm/internlm-chat-7b`, etc.
44
* - :code:`LlamaForCausalLM`
45
- LLaMA, LLaMA-2, Vicuna, Alpaca, Koala, Guanaco
46
- - :code:`meta-llama/Llama-2-13b-hf`, :code:`openlm-research/open_llama_13b`, :code:`lmsys/vicuna-13b-v1.3`, :code:`young-geng/koala`, :code:`JosephusCheung/Guanaco`, etc.
46
+ - :code:`meta-llama/Llama-2-13b-hf`, :code:`meta-llama/Llama-2-70b-hf`, :code:`openlm-research/open_llama_13b`, :code:`lmsys/vicuna-13b-v1.3`, :code:`young-geng/koala`, etc.
47
* - :code:`MPTForCausalLM`
48
- MPT, MPT-Instruct, MPT-Chat, MPT-StoryWriter
49
- :code:`mosaicml/mpt-7b`, :code:`mosaicml/mpt-7b-storywriter`, :code:`mosaicml/mpt-30b`, etc.
50
* - :code:`OPTForCausalLM`
51
- OPT, OPT-IML
52
- :code:`facebook/opt-66b`, :code:`facebook/opt-iml-max-30b`, etc.
53
- * - :code:`OPTForCausalLM`
53
+ * - :code:`QWenLMHeadModel`
54
- Qwen
55
- :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.
56