@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 55b28b1eee
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

[Docs] Minor fixes in supported models (#920)

* Minor fix in supported models * Add another small fix for Aquila model --------- Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

Woosuk Kwon committed Sep 1, 2023 at 08:28 UTC 55b28b1eee3a94a8b1c812d461f68ff8f150d38e
1 file changed +3 -3
docs/source/models/supported_models.rst
+3 -3
@@ -15,7 +15,7 @@ Alongside each architecture, we include some popular models that use it.
15 - Models
16 - Example HuggingFace Models
17 * - :code:`AquilaForCausalLM`
18 - - Aqualia
18 + - Aquila
19 - :code:`BAAI/Aquila-7B`, :code:`BAAI/AquilaChat-7B`, etc.
20 * - :code:`BaiChuanForCausalLM`
21 - Baichuan
@@ -43,14 +43,14 @@ Alongside each architecture, we include some popular models that use it.
43 - :code:`internlm/internlm-7b`, :code:`internlm/internlm-chat-7b`, etc.
44 * - :code:`LlamaForCausalLM`
45 - LLaMA, LLaMA-2, Vicuna, Alpaca, Koala, Guanaco
46 - - :code:`meta-llama/Llama-2-13b-hf`, :code:`openlm-research/open_llama_13b`, :code:`lmsys/vicuna-13b-v1.3`, :code:`young-geng/koala`, :code:`JosephusCheung/Guanaco`, etc.
46 + - :code:`meta-llama/Llama-2-13b-hf`, :code:`meta-llama/Llama-2-70b-hf`, :code:`openlm-research/open_llama_13b`, :code:`lmsys/vicuna-13b-v1.3`, :code:`young-geng/koala`, etc.
47 * - :code:`MPTForCausalLM`
48 - MPT, MPT-Instruct, MPT-Chat, MPT-StoryWriter
49 - :code:`mosaicml/mpt-7b`, :code:`mosaicml/mpt-7b-storywriter`, :code:`mosaicml/mpt-30b`, etc.
50 * - :code:`OPTForCausalLM`
51 - OPT, OPT-IML
52 - :code:`facebook/opt-66b`, :code:`facebook/opt-iml-max-30b`, etc.
53 - * - :code:`OPTForCausalLM`
53 + * - :code:`QWenLMHeadModel`
54 - Qwen
55 - :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.
56