A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 04:30 UTC
[Doc] Add `QVQ` and `QwQ` to the list of supported models (#11509)
Signed-off-by: Roger Wang <ywang@roblox.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Roger Wang committed
Dec 26, 2024 at 01:44 UTC
7492a362077ace26b4f0374a39ba5b0846962b87
1 file changed
+2
-2
docs/source/models/supported_models.md
+2
-2
@@ -319,7 +319,7 @@ See [this page](#generative-models) for more information on how to use generativ
319
- ✅︎
320
* - :code:`Qwen2ForCausalLM`
321
- Qwen2
322
- - :code:`Qwen/Qwen2-7B-Instruct`, :code:`Qwen/Qwen2-7B`, etc.
322
+ - :code:`Qwen/QwQ-32B-Preview`, :code:`Qwen/Qwen2-7B-Instruct`, :code:`Qwen/Qwen2-7B`, etc.
323
- ✅︎
324
- ✅︎
325
* - :code:`Qwen2MoeForCausalLM`
@@ -710,7 +710,7 @@ See [this page](#generative-models) for more information on how to use generativ
710
* - :code:`Qwen2VLForConditionalGeneration`
711
- Qwen2-VL
712
- T + I\ :sup:`E+` + V\ :sup:`E+`
713
- - :code:`Qwen/Qwen2-VL-2B-Instruct`, :code:`Qwen/Qwen2-VL-7B-Instruct`, :code:`Qwen/Qwen2-VL-72B-Instruct`, etc.
713
+ - :code:`Qwen/QVQ-72B-Preview`, :code:`Qwen/Qwen2-VL-7B-Instruct`, :code:`Qwen/Qwen2-VL-72B-Instruct`, etc.
714
- ✅︎
715
- ✅︎
716
-