[ROCm][Bugfix]: Fallback GFX942 sparse MLA ops to Triton (#45782)

vllmellm committed 5 months ago

fix(security): enforce audio decode duration limit in chat completions path (#45908)

Juan Pérez de Algaba committed 5 months ago

[Bugfix][test] Use Salesforce/wikitext for ppl tests (#45913)

wentian-byte committed 5 months ago

[Bugfix][Gemma4] Pre-initialise streaming reasoning state when prompt ends inside an open `<|channel>` (fixes #45834) (#45852)

Nikhilesh Chhetri committed 5 months ago

[Bugfix] Fixes MiniCPM-O resampler device placement to avoid tensor device mismatch (#42332)

Joel Smith committed 5 months ago

[KV Connector][Offloading] Avoid blocking the engine to flush offloads on idle (#45595)

Itay Etelis committed 5 months ago

[Rust Frontend] Support hybrid/external DP LB in Python supervised bootstrap (#45805)

Bugen Zhao committed 5 months ago

[Misc] Validate Cohere Embed Mixed Content Payloads (#45873)

Taneem Ibrahim committed 5 months ago

[Kernel] Add weightless RMSNorm CUDA kernels for has_weight=False (#41430) (#44109)

arghyadeep sarkar committed 5 months ago

[Rust Frontend] Add serde defaults for omit_defaults fields in `EngineCoreSamplingParams` (#45848)

Will Eaton committed 5 months ago

[Rust Frontend] Add /abort_requests endpoint (#44382)

Sahil Singh committed 5 months ago

[Rust Frontend] Support prompt-only completions (#44938)

Reid committed 5 months ago

[BugFix][CI] Fix scheduler plugin test (#45897)

Nick Hill committed 5 months ago

[Bugfix][Quantization] Reject unsupported compressed tensors KV cache schemes (#45312)

Ting SUN committed 5 months ago

[M3] Enable FP8 sparse GQA (#45744)

Thien Tran committed 5 months ago

[CI][NIXL] Pin NIXL to 1.2.0 (#45843)

Itay Alroy committed 5 months ago

[M3] Tune Triton indexer score decode for spec-decode (#45743)

Thien Tran committed 5 months ago

[FlexAttention] make custom mask mods fully cudagraphable (#45232)

liangel-02 committed 5 months ago

[Bugfix][V1] Clean up compiled-model bytecode hooks on VllmRunner exit (#45195)

Ting SUN committed 5 months ago

[ModelRunnerV2] Various model/config compatibility fixes (#45868)

Nick Hill committed 5 months ago