@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 10:45 UTC

main

[Misc] Fix CI lint (#9085)

Cody Yu committed about 2 years ago

[Misc] Improved prefix cache example (#9077)

Andy Dai committed about 2 years ago

Remove AMD Ray Summit Banner (#9075)

Simon Mo committed about 2 years ago

[Misc] Move registry to its own file (#9064)

Cyrus Leung committed about 2 years ago

[Models] Add remaining model PP support (#7168)

Murali Andoorveedu committed about 2 years ago

[Bugfix] Weight loading fix for OPT model (#9042)

Domen Vreš committed about 2 years ago

← Newer Page 976 of 1120 Older →