A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 05:30 UTC
[Docs] Add "About" Heading to README.md (#2260)
blueceiling committed
Dec 25, 2023 at 17:37 UTC
face83c7eccff05c5cd3ec3b6f114f71b7694e4e
1 file changed
+1
-1
README.md
+1
-1
@@ -27,7 +27,7 @@ Easy, fast, and cheap LLM serving for everyone
27
- [2023/06] We officially released vLLM! FastChat-vLLM integration has powered [LMSYS Vicuna and Chatbot Arena](https://chat.lmsys.org) since mid-April. Check out our [blog post](https://vllm.ai).
28
29
---
30
-
30
+## About
31
vLLM is a fast and easy-to-use library for LLM inference and serving.
32
33
vLLM is fast with: