@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

EVS Support (Video tokens pruning) (#22980)

Eugene Khvedchenya committed about 1 year ago

Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135)

Aleksandr Malyshev committed about 1 year ago

[Refactor] Remove DeepGEMM OP Register (#25710)

Wentao Ye committed about 1 year ago

Fix routing_bias dtype (#25711)

Shu Wang committed about 1 year ago

[Misc] Simplify `test_argsort_mm_positions` (#25690)

Cyrus Leung committed about 1 year ago

[V0 deprecation] Clean up LoRA (#25686)

Jee Jee Li committed about 1 year ago

[BugFix] Fix DBO hang (#25625)

Lucas Wilkinson committed about 1 year ago

← Newer Page 625 of 1120 Older →