A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 09:15 UTC
main
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago