A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 08:00 UTC
Remove e.g. in README (#167)
Zhuohan Li committed
Jun 20, 2023 at 14:00 UTC
033f5c78f5bd0b6a16ad7e5e973ce765fbe19374
1 file changed
+4
-4
README.md
+4
-4
@@ -41,10 +41,10 @@ vLLM is flexible and easy to use with:
41
42
vLLM seamlessly supports many Huggingface models, including the following architectures:
43
44
-- GPT-2 (e.g., `gpt2`, `gpt2-xl`, etc.)
45
-- GPTNeoX (e.g., `EleutherAI/gpt-neox-20b`, `databricks/dolly-v2-12b`, `stabilityai/stablelm-tuned-alpha-7b`, etc.)
46
-- LLaMA (e.g., `lmsys/vicuna-13b-v1.3`, `young-geng/koala`, `openlm-research/open_llama_13b`, etc.)
47
-- OPT (e.g., `facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
44
+- GPT-2 (`gpt2`, `gpt2-xl`, etc.)
45
+- GPTNeoX (`EleutherAI/gpt-neox-20b`, `databricks/dolly-v2-12b`, `stabilityai/stablelm-tuned-alpha-7b`, etc.)
46
+- LLaMA (`lmsys/vicuna-13b-v1.3`, `young-geng/koala`, `openlm-research/open_llama_13b`, etc.)
47
+- OPT (`facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
48
49
Install vLLM with pip or [from source](https://vllm.readthedocs.io/en/latest/getting_started/installation.html#build-from-source):
50