[P/D] Report prefill worker cache hits in prompt_tokens_details (#54222)

Robert Shaw committed about 1 month ago

[Model] Qwen4Exp: fp8_e4m3 main KV cache on the QSA path (#55557)

semerandre committed about 1 month ago

[BugFix][PCP] Handle missing DP metadata in one-sided EP (#54016)

Roberto L. Castro committed about 1 month ago

[Model][LoRA] Enable LoRA support for ModernBertModel (#57148)

linitra24 committed about 1 month ago

[LoRA] Support modules_to_save for sequence classification (#53555)

linitra24 committed about 1 month ago

[CI] Bump Transformers version to 5.17.0 (#56108)

Harry Mellor committed about 1 month ago

[Bugfix][Kimi-K3] Do not classify a stateless first chunk as a decode (#51483)

sashko-zakharchuk committed about 1 month ago

[Perf][GDN] Scatter mixed speculative outputs into the caller buffer (#57140)

Arpan Tripathi committed about 1 month ago

[Bugfix][Mooncake] Report request-level KV load failures under HMA (#56855)

Nicolò Lucchesi committed about 1 month ago

[Bugfix] Let an optional Literal flag accept the None it advertises (#52370)

Vineeth Sai Varikuntla committed about 1 month ago

[Model] Optimize Sarvam MLA routing and preserve FP32 router logits (#56034)

Harshit Kedia committed about 1 month ago

[Agent] Add agent instructions for parser directories (#56883)

Flora Feng committed about 1 month ago

[Platform] Move env check function to platform interface (#48599)

wangxiyuan committed about 1 month ago

[Model][DSv4.1] FlashMLA mega attention and the NVFP4 compressed KV cache (#56935)

Yongye Zhu committed about 1 month ago

[Misc] Remove no-op self-assignments across vLLM (#55988)

Adababy committed about 1 month ago

[Docs] Split slash-combined docstring parameters (#57141)

Harry Mellor committed about 1 month ago

[Bugfix][CPU] Fall back to CpuPlatform when zentorch fails to import (#54923)

Ganesh R committed about 1 month ago

[Perf][DSV4.1] Pad shared experts for native MegaMoE fusion (#56568)

Canlin Guo committed about 1 month ago

[UX] Add thinking support to `vllm chat` (#57045)

Misha Goin committed about 1 month ago

[XPU][Bugfix] Fix Qwen2-Audio ValueError on audio clips longer than 30s (#56912)

Jakub Byczkowski committed about 1 month ago