A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 01:45 UTC
[Doc] README Phi-3 name fix. (#4372)
Co-authored-by: Caio Mendes <caiocesart@microsoft.com>
Caio Mendes committed
Apr 25, 2024 at 14:32 UTC
bd7a8eef25cd85be7eb9f2a94fd752d27ee7dce3
1 file changed
+1
-1
README.md
+1
-1
@@ -78,7 +78,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
78
- OPT (`facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
79
- Orion (`OrionStarAI/Orion-14B-Base`, `OrionStarAI/Orion-14B-Chat`, etc.)
80
- Phi (`microsoft/phi-1_5`, `microsoft/phi-2`, etc.)
81
-- Phi3 (`microsoft/Phi-3-mini-4k-instruct`, `microsoft/Phi-3-mini-128k-instruct`, etc.)
81
+- Phi-3 (`microsoft/Phi-3-mini-4k-instruct`, `microsoft/Phi-3-mini-128k-instruct`, etc.)
82
- Qwen (`Qwen/Qwen-7B`, `Qwen/Qwen-7B-Chat`, etc.)
83
- Qwen2 (`Qwen/Qwen1.5-7B`, `Qwen/Qwen1.5-7B-Chat`, etc.)
84
- Qwen2MoE (`Qwen/Qwen1.5-MoE-A2.7B`, `Qwen/Qwen1.5-MoE-A2.7B-Chat`, etc.)