[compile] Fix inductor partition config (#26645)

Angela Yi committed about 1 year ago

CP: make correct_attn_out robust to 4‑D views and fix Triton arg binding (#26509)

Huamin Li committed about 1 year ago

[Benchmark] Support Infinity API (#26641)

Cyrus Leung committed about 1 year ago

[Bugfix] Fix qwen-moe packed_modules_mapping (#26634)

Jee Jee Li committed about 1 year ago

[Bugfix][Qwen3VL] fix deepstack in qwen3vl (#26626)

JJJYmmm committed about 1 year ago

[compile] Add patched_fused_scaled_matmul_reduce_scatter (#26604)

Angela Yi committed about 1 year ago

[Refactor]Reduce duplicate code in serving_chat (#26627)

Chauncey committed about 1 year ago

[CPU] fix the issue when the node is '-' cause json decode error. (#26562)

muzian666 committed about 1 year ago

Add EAGLE-3 Speculative Decoding Support for Qwen3 MoE (#26485)

Rahul Tuli committed about 1 year ago

fix(nix): Allow local oneDNN path to fix vLLM CPU build failure (#26401)

ihb2032 committed about 1 year ago

[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)

dsinghvi committed about 1 year ago

[Bugfix][Multi Modal] Fix incorrect Molmo image processing (#26563)

sangho.lee committed about 1 year ago

[MM] Move Qwen3Omni MRoPE impl to model file (#26608)

Roger Wang committed about 1 year ago

[XPU] Upgrade NIXL to remove CUDA dependency (#26570)

liuzhenwei committed about 1 year ago

[CI/Build] Fix ppc64le CPU build and tests (#22443)

Nishidha Panpaliya committed about 1 year ago

[Frontend] Improve the performance of `is_reasoning_end` (#25735)

Chauncey committed about 1 year ago

[BugFix] Make penalties and bad_words work with async scheduling (#26467)

Nick Hill committed about 1 year ago

AOT Compilation for torch.compile (Bundled) (#24274)

Zhengxu Chen committed about 1 year ago

Cache the environment variable check for batch invariance (#26510)

Bram Wasti committed about 1 year ago

[BugFix] Fix async scheduling + request preemption (#26385)

Nick Hill committed about 1 year ago