[KV Offload] Make compact secondary identity TP-independent (#49858)

Chang Guo committed 3 months ago

[Bugfix] Fix DeepseekV4FP8 Quark MXFP4 crash on list-valued weight (#49634)

Colin Z committed 3 months ago

[AMD] Revert `Mxfp4MoeBackend.TRITON_UNFUSED` fallback (#46491)

fxmarty committed 3 months ago

[KV-offload][FS] : Batch store/load_block in C (#49152)

Varun Sundar Rabindranath committed 3 months ago

[Feature] Add VidCom2 video token pruning (#47750)

nvbfalk committed 3 months ago

[ROCm][Quark][6/N] Use MXFP4 linear kernel abstraction for `aiter` backend (#49348)

fxmarty-amd committed 3 months ago

[XPU] Add online fp8 quantization test (#44513)

Yan Ma committed 3 months ago

[CI][ROCm] Soft-fail Python-only installation mirror (#50041)

Andreas Karatzas committed 3 months ago

[ROCm][DSv3.2] Eliminate per-decode FillFunctor launches in sparse-MLA hot loop (#44527)

frida-andersson committed 3 months ago

[ROCm][KVConnector][MoRI-IO] Fix WRITE-mode remote-TP rank collapse (#46332 follow-up) (#47764)

avininjamay8 committed 3 months ago

[Docs] Remove experimental warning for EP (#50057)

Woosuk Kwon committed 3 months ago

[Core][PCP] Select MRV2 when PCP is enabled (#50034)

Lucas Wilkinson committed 3 months ago

[Tests][Spec Decode] Add gemma4 MTP acceptance rates test (#47920)

Giancarlo Delfin committed 3 months ago

Fix Humming non-gated MoE (#49096)

Netanel Haber committed 3 months ago

Fix MQA with tensor parallelism on transformers modeling backend (#49987)

Miłosz Grunwald committed 3 months ago

[ROCm] [BugFix] Fix Quark GLM-5.2 Checkpoint inference: indexer wk per-channel FP8 dequant + missing sparse-MLA metadata fields (#48886)

Colin Z committed 3 months ago

[CI][ROCm] Fix `test_ocp_mx_wikitext_correctness` reference value (#49690)

fxmarty-amd committed 3 months ago

[CI] Initialize DeepEP FP8 test weights (#49912)

Andreas Karatzas committed 3 months ago

[ROCm][Quantization][5/N] Refactor quark_moe w8a8-int8 w/ oracle (#46765)

amd-sourjya committed 3 months ago

[Refactor] Remove dead code in multiple files (#49745)

Wentao Ye committed 3 months ago