@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 7492a36207
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

[Doc] Add `QVQ` and `QwQ` to the list of supported models (#11509)

Signed-off-by: Roger Wang <ywang@roblox.com> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

Roger Wang committed Dec 26, 2024 at 01:44 UTC 7492a362077ace26b4f0374a39ba5b0846962b87
1 file changed +2 -2
docs/source/models/supported_models.md
+2 -2
@@ -319,7 +319,7 @@ See [this page](#generative-models) for more information on how to use generativ
319 - ✅︎
320 * - :code:`Qwen2ForCausalLM`
321 - Qwen2
322 - - :code:`Qwen/Qwen2-7B-Instruct`, :code:`Qwen/Qwen2-7B`, etc.
322 + - :code:`Qwen/QwQ-32B-Preview`, :code:`Qwen/Qwen2-7B-Instruct`, :code:`Qwen/Qwen2-7B`, etc.
323 - ✅︎
324 - ✅︎
325 * - :code:`Qwen2MoeForCausalLM`
@@ -710,7 +710,7 @@ See [this page](#generative-models) for more information on how to use generativ
710 * - :code:`Qwen2VLForConditionalGeneration`
711 - Qwen2-VL
712 - T + I\ :sup:`E+` + V\ :sup:`E+`
713 - - :code:`Qwen/Qwen2-VL-2B-Instruct`, :code:`Qwen/Qwen2-VL-7B-Instruct`, :code:`Qwen/Qwen2-VL-72B-Instruct`, etc.
713 + - :code:`Qwen/QVQ-72B-Preview`, :code:`Qwen/Qwen2-VL-7B-Instruct`, :code:`Qwen/Qwen2-VL-72B-Instruct`, etc.
714 - ✅︎
715 - ✅︎
716 -