[Bugfix] Install nvidia-cutlass-dsl[cu13] extra on CUDA 13 platforms (#42438)

Jiangyun Zhu committed 6 months ago

[Bugfix][SimpleCPUOffloadBackend] Dedup in-flight CPU offload stores across scheduler steps (#41289)

Yifan Qiao committed 6 months ago

Patch SlidingWindowSpec.real_page_size_bytes for nvfp4 kv (#42464)

sychen52 committed 6 months ago

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3.5 (#42151)

Shanshan Shen committed 6 months ago

[5/n] Migrate CUTLASS MLA, hadamard, awq, allspark and DSV3 fused a gemm to torch stable ABI (continued) (#42339)

Chris Leonard committed 6 months ago

[chore] Refactor pooling metadata token ID accessors (#42368)

Taneem Ibrahim committed 6 months ago

[Bugfix][PD] Fix multi-node TP (TP>8) (#39907)

Nicolò Lucchesi committed 6 months ago

[Attention] Sync FA with upstream (#41052)

Matthew Bonanni committed 6 months ago

[MoE Refactor] Add sequence parallel tests to test_moe_layer.py (#41299)

bnellnm committed 6 months ago

[PD] Bump NIXL connector dependency to 1.x (#42364)

Alec committed 6 months ago

[Perf] Optimize MLA `compute_prefill_context` memory allocation (#42460)

Wentao Ye committed 6 months ago

[KV Transfer] Add MooncakeStoreConnector for KV cache offloading via Mooncake distributed store (#40900)

Chao Lei committed 6 months ago

[Build] DeepGEMM: trim comments, add integration notes + TODOs (#42429)

Michael Goin committed 6 months ago

[CI] Inline build artifact annotations in release pipeline (#42357)

Kevin H. Luu committed 6 months ago

[CI] Fix `test_async_scheduling.py` flakiness (#42455)

Nick Hill committed 6 months ago

[Model Runner V2] Apply synthetic mode to probabilistic rejection sampler (#41035)

Giancarlo Delfin committed 6 months ago

platforms: add uses_cpu_device() hook to Platform for DeviceConfig (#42313)

Viktor Pus committed 6 months ago

[CI] Migrate 6 verified jobs from gpu_1_queue to h200_18gb MIG (#42446)

Kevin H. Luu committed 6 months ago

[Model][Bugfix] Fix Step3-VL image_embeds input path (#42333)

KaivalyaMDabhadkar committed 6 months ago

[MoE Refactor] EPLB refactoring for FusedMoE (#41055)

bnellnm committed 6 months ago