@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 76b889bf1d
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

[Doc] Update README.md (#3806)

Robert Shaw committed Apr 2, 2024 at 23:11 UTC 76b889bf1d101c4e5c9a17b9e1a7f8e2df43e306
1 file changed +1 -1
README.md
+1 -1
@@ -88,7 +88,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
88 - Orion (`OrionStarAI/Orion-14B-Base`, `OrionStarAI/Orion-14B-Chat`, etc.)
89 - Phi (`microsoft/phi-1_5`, `microsoft/phi-2`, etc.)
90 - Qwen (`Qwen/Qwen-7B`, `Qwen/Qwen-7B-Chat`, etc.)
91 -- Qwen2 (`Qwen/Qwen2-7B-beta`, `Qwen/Qwen-7B-Chat-beta`, etc.)
91 +- Qwen2 (`Qwen/Qwen1.5-7B`, `Qwen/Qwen1.5-7B-Chat`, etc.)
92 - Qwen2MoE (`Qwen/Qwen1.5-MoE-A2.7B`, `Qwen/Qwen1.5-MoE-A2.7B-Chat`, etc.)
93 - StableLM(`stabilityai/stablelm-3b-4e1t`, `stabilityai/stablelm-base-alpha-7b-v2`, etc.)
94 - Starcoder2(`bigcode/starcoder2-3b`, `bigcode/starcoder2-7b`, `bigcode/starcoder2-15b`, etc.)