A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 09:15 UTC
Add blank setup file
Woosuk Kwon committed
Feb 9, 2023 at 11:37 UTC
3be29a1104e15c3bb30ed1d42eda476d2bf9f04e
1 file changed