[Bugfix][HiSparse] Preserve per-layer offsets in KV cache bindings (#57027)

Lucas Wilkinson committed about 1 month ago

[Refactor] Remove dead kernel code (#56845)

Wentao Ye committed about 1 month ago

[Config] Infer HiSparse attention config from HiSparseConnector (#57041)

Nicolò Lucchesi committed about 1 month ago

[Bugfix] Avoid nested score cancellation handlers for /v1/score alias (#57024)

Taneem Ibrahim committed about 1 month ago

[ROCm][Perf] Optimize DSV4.1 K=512 decode top-k on gfx950 (#56743)

Fangzhou Ai committed about 1 month ago

[CI] Keep Qwen3 Omni DSpark config fixture complete (#57044)

Kevin H. Luu committed about 1 month ago

[ROCm][Spec Decode] Add Aiter MLA decode support non-causal draft block (#55966)

ppalanga committed about 1 month ago

[Bugfix][Attention] Stabilize sparse-MLA DCP for GLM PCP evals (#55879)

Kevin H. Luu committed about 1 month ago

[Bugfix] Prevent out-of-bounds access in FlashInfer SM90 sparse MLA mixed batches (#56969)

Chauncey committed about 1 month ago

[Bugfix][Spec Decode] Only create draft_id_to_target_id when draft vocab differs (#53458)

drslark committed about 1 month ago

[Bugfix][Gemma 4] Don't read fft_length when profiling unified audio (#56721)

Abhinav Verma committed about 1 month ago

[Frontend] Share max_num_queued_reqs across API server processes (#54746)

Chauncey committed about 1 month ago

[Bugfix][Spec Decode][MoE] Avoid uninitialized EPLB state in DeepSeek V4.1 DSpark drafter (#56387)

zack committed about 1 month ago

[Perf][Nemotron] Skip redundant latent-MoE all-reduce at TP>1 (~13% decode win) (#52301)

Junhao Shen committed about 1 month ago

[XPU][CI]Skip test_chat_completion_with_tools in Intel GPU CI (#56934)

xiangdong committed about 1 month ago

[Refactor] StructuredOutputManager x Speculative Decoding Refactor (#48200)

yzong-rh committed about 1 month ago

[Bugfix] Measure complete pooling responses (#56760)

Taneem Ibrahim committed about 1 month ago

[Rust Frontend] Add iteration token histogram (#56990)

Bugen Zhao committed about 1 month ago

[Perf][Kernel] Integrate Mega-mHC from DeepGEMM for DeepSeek V4.1 (reopen of #56255) (#56962)

Juntian Liu committed about 1 month ago

[Bugfix] Load reasoning parser plugins before headless engine config (#53124)

ALEX LILUZ committed about 1 month ago