@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 033f5c78f5
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

Remove e.g. in README (#167)

Zhuohan Li committed Jun 20, 2023 at 14:00 UTC 033f5c78f5bd0b6a16ad7e5e973ce765fbe19374
1 file changed +4 -4
README.md
+4 -4
@@ -41,10 +41,10 @@ vLLM is flexible and easy to use with:
41
42 vLLM seamlessly supports many Huggingface models, including the following architectures:
43
44 -- GPT-2 (e.g., `gpt2`, `gpt2-xl`, etc.)
45 -- GPTNeoX (e.g., `EleutherAI/gpt-neox-20b`, `databricks/dolly-v2-12b`, `stabilityai/stablelm-tuned-alpha-7b`, etc.)
46 -- LLaMA (e.g., `lmsys/vicuna-13b-v1.3`, `young-geng/koala`, `openlm-research/open_llama_13b`, etc.)
47 -- OPT (e.g., `facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
44 +- GPT-2 (`gpt2`, `gpt2-xl`, etc.)
45 +- GPTNeoX (`EleutherAI/gpt-neox-20b`, `databricks/dolly-v2-12b`, `stabilityai/stablelm-tuned-alpha-7b`, etc.)
46 +- LLaMA (`lmsys/vicuna-13b-v1.3`, `young-geng/koala`, `openlm-research/open_llama_13b`, etc.)
47 +- OPT (`facebook/opt-66b`, `facebook/opt-iml-max-30b`, etc.)
48
49 Install vLLM with pip or [from source](https://vllm.readthedocs.io/en/latest/getting_started/installation.html#build-from-source):
50