@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 23:30 UTC

main

Make vllm compatible with verl (#12824)

ZSL98 committed almost 2 years ago

[Bugfix] FA2 illegal memory access (#12848)

Lucas Wilkinson committed almost 2 years ago

[misc] Revert # 12833 (#12857)

Kevin H. Luu committed almost 2 years ago

Add Bamba Model (#10909)

Yu Chin Fabian Lim committed almost 2 years ago

[V1] LoRA Support (#10957)

Varun Sundar Rabindranath committed almost 2 years ago

[Misc] Remove unnecessary decode call (#12833)

Cyrus Leung committed almost 2 years ago

[Attention] Use FA3 for MLA on Hopper (#12807)

Lucas Wilkinson committed almost 2 years ago

[Docs] Add Google Cloud Slides (#12814)

Simon Mo committed almost 2 years ago

[Misc] Update w2 scale loading for GPTQMarlinMoE (#12757)

Dipika Sikka committed almost 2 years ago

Improve `TransformersModel` UX (#12785)

Harry Mellor committed almost 2 years ago

[Model] LoRA Support for Ultravox model (#11253)

Sumit Vij committed almost 2 years ago

← Newer Page 897 of 1120 Older →