@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 1744cc99ba
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

[Doc] Add Phi-3-medium to list of supported models (#5788)

Michael Goin committed Jun 24, 2024 at 13:48 UTC 1744cc99ba9bdefea8f3f798cf51ed650b81a98e
1 file changed +1 -1
docs/source/models/supported_models.rst
+1 -1
@@ -129,7 +129,7 @@ Alongside each architecture, we include some popular models that use it.
129 - ✅︎
130 * - :code:`Phi3ForCausalLM`
131 - Phi-3
132 - - :code:`microsoft/Phi-3-mini-4k-instruct`, :code:`microsoft/Phi-3-mini-128k-instruct`, etc.
132 + - :code:`microsoft/Phi-3-mini-4k-instruct`, :code:`microsoft/Phi-3-mini-128k-instruct`, :code:`microsoft/Phi-3-medium-128k-instruct`, etc.
133 -
134 * - :code:`Phi3SmallForCausalLM`
135 - Phi-3-Small