[CI] Explicitly tear down speculative decode runners (#49910)

Andreas Karatzas committed 3 months ago

[Bugfix][KV Offload][P2P] Fix EngineCore crash reconnecting to a reaped peer (#49823)

Jason committed 3 months ago

[ROCm] Make vllm_c RMSNorm output contiguous (#49913)

Andreas Karatzas committed 3 months ago

[Bugfix] Fix mHC block-M prenorm GEMM cross-row reduction carry-over (#49429)

Nick Hill committed 3 months ago

[XPU][CI] Add more test cases in Intel GPU CI (#49422)

xiangdong committed 3 months ago

[CI] Add kimi and k3 auto-labeling rules (#49895)

jcotant-inferact committed 3 months ago

[Docs] Document NVFP4 GEMM kernel selection and Marlin weight-only fallback (#49376)

Harjoth Khara committed 3 months ago

[ROCm][CI] Keep native datasets cache off shared NFS (#49516)

Andreas Karatzas committed 3 months ago

[Frontend] expose stream_interval as req sampling param (#49754)

Walter Beller-Morales committed 3 months ago

[XPU] Enable QK Norm + RoPE fusion pass on XPU (#49394)

Chaojun Zhang committed 3 months ago

[CI][ROCm] Keep global GPU memory cleanup opt-in (#49911)

Andreas Karatzas committed 3 months ago

[CI][ROCm] Reduce V1 attention test runtime (#49916)

Andreas Karatzas committed 3 months ago

[Core] Fix gpu<->cpu syncs in MRV2 mamba_hybrid.py (#49736)

Nick Hill committed 3 months ago

[Core][KV-transfer] MoRIIO: heterogeneous TP<->DP prefill/decode read routing (#46116)

limeward committed 3 months ago

[BugFix][MRV2] Don't create dummy requests longer than `max_model_len` (#49751)

Nick Hill committed 3 months ago

[Bugfix] Prevent NaN poisoning in xpu_mla_sparse for fully-masked index chunks (#48366)

Nick Iusiumbeli committed 3 months ago

[ModelRunner V2] Support encoder-only attention (#49331)

Nick Hill committed 3 months ago

[CI/Build] Refresh tags before building macOS wheel (#49901)

Kevin H. Luu committed 3 months ago

[Bugfix][CuMem] Make KV-cache wake cleanup tag-safe (#49857)

aoshen02 committed 3 months ago

[Core][Distributed] Add process-checkpoint lifecycle hooks for communicators (starting with Flashinfer) (#46877)

Schwinn Saereesitthipitak committed 3 months ago