[ROCm][CI] Add MLA decode accuracy and determinism tests (#50480)

Aarushi Jain committed 3 months ago

[MoE] Align TRTLLM MXFP4 autotune buckets (#50942)

Thien Tran committed 3 months ago

[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)

Silen Naihin committed 3 months ago

[BugFix] Dense multinode DP rescope with regression test (#49212)

aoshen02 committed 3 months ago

[Bugfix][Spec Decode] Fix NaN handling in rejection sampler tl.argmax (#50183)

gabriel-peracio committed 3 months ago

[KV Connector][Mooncake] Add tenant ID support to MooncakeStoreConnector (#48069)

LZW committed 3 months ago

[Bugfix] Size and iterate w13 by shard count for non-gated MoE (#51125)

aoshen02 committed 3 months ago

[Refactor][PCP] Make PCPManager construction extensible (#50066)

Qiu committed 3 months ago

[EPD] Remove duplicate image preprocessing in EPD and enable preprocess on GPU (#50390)

Tianyu Guo committed 3 months ago

[ROCm] Relax MLA rope+cache test tolerances for bf16 (#51083)

Rohan Potdar committed 3 months ago

[K3 Perf] Combine multiple all gather together for SP, 1.5~3x kernel level performance improvement (#51070)

Wentao Ye committed 3 months ago

[MoE Refactor] Remove MoE legacy code (#51078)

bnellnm committed 3 months ago

[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375)

Micah Williamson committed 3 months ago

[Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)

Netanel Haber committed 3 months ago

[CI Bug] Fix `pydantic_core._pydantic_core.ValidationError: Input should be a valid integer` (#51179)

Wentao Ye committed 3 months ago

[ROCm][CI] Keep rocprofiler-sdk out of DeepEP HT MoE test workers (#51173)

stefankoncarevic committed 3 months ago

[ROCm] Work around DeepEP teardown SIGSEGV in MoE test harness (#51174)

Rohan Potdar committed 3 months ago

[CI] Prune PyTorch Fullgraph Test (#51074)

Michael Goin committed 3 months ago

[MoE] Share apply_moe_activation support metadata (#44359)

Michael Goin committed 3 months ago

[Docker][KVConnector] Install mooncake from official wheels instead of a custom build (#51067)

Zhewen Li committed 3 months ago