@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

main

[Core] Implement sharded state loader (#4690)

Aurick Qiao committed over 2 years ago

Add 4th meetup announcement to readme (#4817)

Simon Mo committed over 2 years ago

[Core] Add MultiprocessingGPUExecutor (#4539)

Nick Hill committed over 2 years ago

[Bugfix][Doc] Fix CI failure in docs (#4804)

Cyrus Leung committed over 2 years ago

[Doc] Add meetups to the doc (#4798)

Zhuohan Li committed over 2 years ago

[Doc] Add API reference for offline inference (#4710)

Cyrus Leung committed over 2 years ago

[Bugfix] Fix dynamic FP8 quantization for Mixtral (#4793)

Philipp Moritz committed over 2 years ago

← Newer Page 1053 of 1120 Older →