[XPU] allow forcing flash attn for mm_prefix (#48828)

liuzhenwei committed 3 months ago

[CI] Gate non-default release wheel builds (#48772)

Kevin H. Luu committed 3 months ago

[docs] preserve page path in stable-docs announcement link (#48839)

Sage committed 3 months ago

[Bugfix][Multimodal] Fix Qwen3-Omni use_audio_in_video with mixed image/video inputs (#46213)

wendadawen committed 3 months ago

[KV Offload] Add optional tier locality to FS/OBJ KV events (#48281)

Chang Guo committed 3 months ago

[Model] Support TranslateGemma-12b-it (#41599)

Zhang Jian committed 3 months ago

[rl] Stateful Trainer Send: New Abstractions [1/N] (#48042)

Aaron Hao committed 3 months ago

[Rust][Benchmark] Port in vllm-bench (#48107)

Roy Wang committed 3 months ago

[Bugfix][Attention] Preserve post-load tensors across weight reloads (#48251)

aoshen02 committed 3 months ago

Add blocks_per_chunk configuration for KV offloading to support heterogeneous KV cache groups (#48878)

Debasish Mohanty committed 3 months ago

[Bugfix][Pooling] Fix wrong scores for chunked prefill under torch.compile (#48901)

Sebastian Woo committed 3 months ago

[Render] Add round trip parity test and docs for derender (#48617)

Martin Hickey committed 3 months ago

[CI] Extend max-model-len for `test_parsable_context` to allow reasoning to finish (#48873)

Micah Williamson committed 3 months ago

[Warmup] Show CuTeDSL compilation progress (#48881)

Woosuk Kwon committed 3 months ago

[Model] Add Inkling LoRA support [4/N] (#48884)

Woosuk Kwon committed 3 months ago

[M3] Improve indexer for long-context decode (sm100) (#48582)

Thien Tran committed 3 months ago

[Misc] Remove orphaned env vars and stale env-var references (#44749)

Daoyuan Li committed 3 months ago

[Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642)

Matthew Bonanni committed 3 months ago

[Perf] Optimize `clamp` to `clamp_` (#48143)

Wentao Ye committed 3 months ago

[Model][Hardware][AMD]: Part 1/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_AITER_FA, and ROCM_AITER_UNIFIED_ATTN (#42749)

Jack Hu committed 3 months ago