[Bugfix] Fix weight loading issues caused by #41184 (#45054)

bnellnm committed 5 months ago

[Bugfix][CI/Build] Fix Rust frontend build after chat conversion refactor (#45085)

Mohammad Miadh Angkad committed 5 months ago

[Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in (#43756)

Change72 committed 5 months ago

[Core][Model] Gemma4: Unified FA4 for all layers + FlashAttention mm_prefix support (#42175)

Luciano Martins committed 5 months ago

[Refactor][Mistral] Extract parsing logic into MistralParser (#44596)

Flora Feng committed 5 months ago

[Rust Frontend] Extract shared options in route helper params (#44884)

Bugen Zhao committed 5 months ago

[Bug] Fix deepseek v4 OOM issue (#44914)

Wentao Ye committed 5 months ago

[ROCm][CI] fix test_rope_kvcache_fusion.py (#44678)

Charlie Fu committed 5 months ago

Revert "[Kernel] Speed up silu_and_mul_per_block_quant with warp-shuf… (#45066)

Micah Williamson committed 5 months ago

feat(multi-turn-bench): add api_key and custom headers for multi turn benchmark (#44516)

Jimmy committed 5 months ago

[Bugfix] fix qwen3.5 ep weight loading (#45002)

Jiangyun Zhu committed 5 months ago

[ROCm][V2] Fix failed assertion in Llama models when using EAGLE with `ROCM_AITER_FA` (#44936)

Micah Williamson committed 5 months ago

[Mooncake] Use all HCAs on multi-NIC hosts instead of GPU-indexed RNIC selection (#43799)

Dao007forever committed 5 months ago

[ROCm][Perf] Use fused softplus-sqrt-topk router under AITER fused-MoE (#44945)

Fangzhou Ai committed 5 months ago

[Kernel] Speed up silu_and_mul_per_block_quant with warp-shuffle reduction + vectorized I/O (#44173)

SII-yangdian committed 5 months ago

[Security] Fix image EXIF orientation and tRNS transparency handling (#44974)

Juan Pérez de Algaba committed 5 months ago

Fix MiDashengLM TP>1 crash in audio encoder attention (#44408)

Michał Ganczarenko committed 5 months ago

[Docs] Add KV offloading usage guide (single- and multi-tier) (#44415)

Ronen Schaffer committed 5 months ago

[Security] Fix DoS via audio decompression bomb in speech-to-text endpoint (#44970)

Juan Pérez de Algaba committed 5 months ago

[Bugfix] Add X-Session-ID from conversation_id in multi-turn benchmark (#44663)

Tyko Niemi committed 5 months ago