A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 23:15 UTC
Unmark more files as executable (#5962)
Tyler Michael Smith committed
Jun 28, 2024 at 17:34 UTC
5d2a1a9cf0f47ac4f1676c17a835a05d4b4e4175
3 files changed