@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 10:45 UTC

main

[torch.compile] fix tensor alias (#8982)

youkaichao committed about 2 years ago

[ci] Add CODEOWNERS for test directories (#8795)

Kevin H. Luu committed about 2 years ago

[Core] Make scheduling policy settable via EngineArgs (#8956)

Sebastian Schoennenbeck committed about 2 years ago

[Misc] Fix typo in BlockSpaceManagerV1 (#8944)

juncheoll committed about 2 years ago

[Model] Support Qwen2.5-Math-RM-72B (#8896)

Zilin Zhu committed about 2 years ago

← Newer Page 978 of 1120 Older →