@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / bd7a8eef25
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

[Doc] README Phi-3 name fix. (#4372)

Co-authored-by: Caio Mendes <caiocesart@microsoft.com>

Caio Mendes committed Apr 25, 2024 at 14:32 UTC bd7a8eef25cd85be7eb9f2a94fd752d27ee7dce3
1 file changed +1 -1
README.md
+1 -1
@@ -78,7 +78,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
78 - OPT (`facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
79 - Orion (`OrionStarAI/Orion-14B-Base`, `OrionStarAI/Orion-14B-Chat`, etc.)
80 - Phi (`microsoft/phi-1_5`, `microsoft/phi-2`, etc.)
81 -- Phi3 (`microsoft/Phi-3-mini-4k-instruct`, `microsoft/Phi-3-mini-128k-instruct`, etc.)
81 +- Phi-3 (`microsoft/Phi-3-mini-4k-instruct`, `microsoft/Phi-3-mini-128k-instruct`, etc.)
82 - Qwen (`Qwen/Qwen-7B`, `Qwen/Qwen-7B-Chat`, etc.)
83 - Qwen2 (`Qwen/Qwen1.5-7B`, `Qwen/Qwen1.5-7B-Chat`, etc.)
84 - Qwen2MoE (`Qwen/Qwen1.5-MoE-A2.7B`, `Qwen/Qwen1.5-MoE-A2.7B-Chat`, etc.)