A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 09:15 UTC
Move worker/models -> models
Woosuk Kwon committed
Feb 22, 2023 at 18:03 UTC
709a69176ea86f60786acb87ede52e62d9efb036
3 files changed