[Feat][1/N] CuTeDSL warmup infrastructure, FA4 MLA (#46182)

Roberto L. Castro committed 4 months ago

[Bugfix][Tool Parser] PoolsideV1: fix logprobs AttributeError on Responses API (#47138)

Joe Rowell committed 4 months ago

[Feat] Improve Triton JIT diagnostics (#46621)

Roberto L. Castro committed 4 months ago

[ROCm][V1][MLA] Clone prefill backend state per metadata builder (#46993)

Andreas Karatzas committed 4 months ago

[PERF] Extend NCCL symmetric memory to AllGather and ReduceScatter (#46703)

Woosuk Kwon committed 4 months ago

[Feature] DP supervisor using rust frontend (#47076)

Wentao Ye committed 4 months ago

[Model Runner V2][Spec Decode] Fix stale values in idx_mapping from CG num reqs padding (#47066)

Giancarlo Delfin committed 4 months ago

[Bugfix] Restore part of bugfix #42650 after accidental deletion in #43241 (#47039)

Nikita Shapovalov committed 4 months ago

Add Medusa speculative decoding e2e test (#41396)

Rishi Puri committed 4 months ago

[Parser][Bugfix] Ensure tool call or other special tokens don't leak in non-streaming tool parsing (#46875)

Ben Browning committed 4 months ago

[CI] Move distributed small LM eval to B200 (#47048)

Lucas Wilkinson committed 4 months ago

[XPU] Support ZE_AFFINITY_MASK passthrough in xpu_disagg_acc_test (#47105)

liuzhenwei committed 4 months ago

[ROCm][CI] Move PyTorch Compilation Unit Tests to MI300(gfx942) (#47065)

Charlie Fu committed 4 months ago

[Feature] Detect all2all peer fault with fault tolerance backend and prevent corrupted output (#43637)

fangyuchu committed 4 months ago

[Platform] Replace `torch.cuda.Event` with `torch.Event` (#47140)

Kunshang Ji committed 4 months ago

[BugFix] Gate MRV2 mixed sparse-MLA warmup on `max_num_seqs` > 1 (#47050)

Nick Hill committed 4 months ago

[Refactor] Remove dead minimax allreduce rms kernel (#46842)

Wentao Ye committed 4 months ago

[Spec Decode] Fix hidden-state extraction block size for hybrid verifiers (#46301)

Igor Margulis committed 4 months ago

[CI][Bugfix] Fix `Hybrid SSM NixlConnector PD prefix cache test (2 GPUs)` (#47157)

Nicolò Lucchesi committed 4 months ago

[Bugfix] MiniCPM-V 4.6: fix grid rows/cols swap in placeholder generation (#45918)

tc-mb committed 4 months ago