@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / face83c7ec
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 05:30 UTC

[Docs] Add "About" Heading to README.md (#2260)

blueceiling committed Dec 25, 2023 at 17:37 UTC face83c7eccff05c5cd3ec3b6f114f71b7694e4e
1 file changed +1 -1
README.md
+1 -1
@@ -27,7 +27,7 @@ Easy, fast, and cheap LLM serving for everyone
27 - [2023/06] We officially released vLLM! FastChat-vLLM integration has powered [LMSYS Vicuna and Chatbot Arena](https://chat.lmsys.org) since mid-April. Check out our [blog post](https://vllm.ai).
28
29 ---
30 -
30 +## About
31 vLLM is a fast and easy-to-use library for LLM inference and serving.
32
33 vLLM is fast with: