[Bugfix][ROCm] Fix FP8 per-tensor scale rank mismatch causing Inductor assertion failure (#44912)

nehmathe2 committed 5 months ago

[Bugfix][ROCm] Fix MiniMax-M3 FP8 KV cache dtype (#45720)

Cameron Quilici committed 5 months ago

[XPU] Fix test_spec_decode_logprobs: use FLASH_ATTN for XPU in GPU_DETERMINISM_KWARGS (#44468)

Chaojun Zhang committed 5 months ago

[CI] Run pre-commit on self-hosted vllm-runners (#45865)

Kevin H. Luu committed 5 months ago

[Bugfix][Gemma4] Fix parsing when thinking is disabled (#45832)

Federico committed 5 months ago

[Bugfix] Fix MoE model load OOM in FlashInfer_TRTLLM backend with sleep mode (#45589)

Dakai An committed 5 months ago

[XPU][CI] fix server test file path (#45870)

Kunshang Ji committed 5 months ago

[Kernel] Support DS Mamba tail copy for MTP align mode (#45473)

sungsoo ha committed 5 months ago

Apply LRU policy only to proper cache entries (#42656)

Stan Wozniak committed 5 months ago

[Kernel] Support GLM-5 dimensions for TRT-LLM ragged MLA prefill (#43525)

Mohammad Miadh Angkad committed 5 months ago

[Bugfix] Gemma4: skip forced JSON for required/named tool choice (#45795)

Federico committed 5 months ago

[ROCm][CI] fix multimodel run cmds (#45858)

Divakar Verma committed 5 months ago

[Core] Add prefill step cadence for better non-PD DP balancing (#44558)

Nick Hill committed 5 months ago

[Misc] Update Mergify tool-calling label (#45853)

Flora Feng committed 5 months ago

[ROCm][Quant] mxfp8 moe/linear gfx950 tuning for MiniMax-M3 (#45725)

Hongxia Yang committed 5 months ago

[PERF] Fuse multi-group block table staged writes (#44944)

Song Zhixin committed 5 months ago

[Bugfix] Fix Qwen3 prompt tool-call reasoning false positive (#45763)

alexbi29 committed 5 months ago

[Frontend] Add Streaming Parser Engine and new MinimaxM2 Parser (#45701)

Chauncey committed 5 months ago

[KV Connector][Mooncake] Add cache_prefix to namespace store keys (#45767)

Dao007forever committed 5 months ago

[KVConnector][MoRIIO] Allow overriding the advertised host IP (#45488)

kourosh hakhamaneshi committed 5 months ago