A high-throughput and memory-efficient inference and serving engine for LLMs

main

[Attention] Extend XQA decode support on SM90 (#50439)

Andrii Skliar committed about 1 month ago

[Bugfix][MM] Fix swapped H/W in dummy video profiling inputs (#56385)

Hung Hoang (黄兴) committed about 1 month ago

[Perf][ROCm] Add AITER custom AG/RS (DP only) (#48247)

Simon Danielsson committed about 1 month ago

[CI/Build] Pin HyperCLOVAX V2 test model revision (#56335)

Tyler Michael Smith committed about 1 month ago

← Newer Page 63 of 1120 Older →