[Transformers backend] Enable QKV-Fuser for Gemma4 (#55690)

Thomas Ortner committed about 1 month ago

[ROCm][Perf] Fix Qwen3-vLLM audio encoder TP when heads are not divisible by TP size (#45900)

abrahamzewoudie committed about 1 month ago

[Bugfix] Fix unreachable None guard in Molmo2 get_candidate_target_fps (#55893)

Adababy committed about 1 month ago

[Bugfix][Rust Frontend] Skip undefined token ids in decode and anchor them zero-width (#55240)

Salt Sato committed about 1 month ago

[CI/Build] Upload CPU nightly image to Docker Hub (#55163)

wliao2 committed about 1 month ago

[Docs] Update README.md MkDocs to give option to run dev-server on different port. (#54584)

Jefrey Cayab committed about 1 month ago

[Rust Frontend] Make --max-model-len optional for the render server (#55328)

Wen Zhou committed about 1 month ago

[Bugfix] Exclude DP token padding from draft attention metadata (#55458)

Kevin H. Luu committed about 1 month ago

[Bugfix][Frontend] Reject unsupported Responses API input items with 400 instead of 500 (#55974)

Nikhil Kulkarni committed about 1 month ago

[Bugfix] Fix Mooncake heterogeneous TP with replicated GQA heads (#52516)

Yicong Wang committed about 1 month ago

[CI][Test][Spec Decode] Fix CI failure of Qwen3 Omni DSpark loader mock (#56011)

Jing Wang committed about 1 month ago

[CI/Build][Hardware][NVIDIA] Add public CUDA 13.4 Rubin build path (#54640)

meena-at-work committed about 1 month ago

[Bugfix][EC Connector] Fix ECExampleConnector load device under TP>1 (#40416)

Hang Gong committed about 1 month ago

[Rust Frontend] Correctly parse whitespace framing in model output (#55417)

Bugen Zhao committed about 1 month ago

[CI][XPU] skip test_sampling_mask_tensors_match_finite_support on XPU (#55852)

Qiming Zhang committed about 1 month ago

[Refactor][EC Connector] Add backend extension points to ECCPUWorker (#54033)

Akine-Ko committed about 1 month ago

[Bugfix][EC Connector] Fail the request, not the engine, when a remote encoding cannot arrive (#55290)

Tianyu Guo committed about 1 month ago

[Rust Frontend] Simplify reasoning parser initialization and test organization (#55411)

Bugen Zhao committed about 1 month ago

[Bugfix][Elastic EP] Route only to surviving engines during scale-down (#55772)

djramic committed about 1 month ago

[CI][IR] Speed up vLLM IR test group (#55965)

djramic committed about 1 month ago