[Kimi-K3] Add FlashInfer speculative KDA backend (#54255)

Duncan Moss committed 21 days ago

[Attention][SM120] Occupancy-adaptive Triton split-K segment count (#58482)

Venky committed 21 days ago

[Docker] Compile Python bytecode at image build time (#55422)

Nils Matteson committed 21 days ago

[Perf][PP] Skip sampled-token broadcasts whose requests leave the engine (#58542)

LostFox11 committed 21 days ago

[Bugfix] Don't let a structured-output request sample from an unmasked row (#54442)

Ausar committed 21 days ago

[Bugfix][Rust Frontend] Stop vllm-bench chat latency at the last token (#59251)

ZhenchengLin committed 21 days ago

[CI][Spec Decode] Add async scheduling accuracy tests (#55840)

Andreas Karatzas committed 21 days ago

[Metrics] Add --custom-histogram-buckets to override histogram bucket families (#48867)

Guy Stone committed 21 days ago

[Doc] Score centering via top-k processed logprobs (#59361)

vx120 committed 21 days ago

[Core] Include the LoRA path in prefix-cache block hashes (#59335)

Nick Hill committed 21 days ago

[CI] Fix MiniMax-M3 PP aux-state test mock after #58648 (#59508)

Venky committed 21 days ago

[CI] Deflake the multi-API-server metrics test and Mooncake PD ports (#59507)

Kevin H. Luu committed 21 days ago

[CI] Deflake shutdown wait-timeout test by synchronizing on request admission (#58125)

jackLei committed 21 days ago

[ROCm][CI] Sync two AMD test groups between test-amd.yaml and test_areas (#59499)

Aarushi Jain committed 21 days ago

[Docs] Add PR checklist skill for coding agents (#57084)

Benjamin Chislett committed 21 days ago

[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)

Andrii Skliar committed 21 days ago

[Bugfix][Core] Fix mamba prefill checkpoint block reservation and prompt-end eviction in align mode (#59175)

kliuae committed 21 days ago

[Bugfix][PP][Spec Decode] MiniMax-M3 EAGLE3 aux-state relay at PP > 1 and per-stage FlashInfer autotune (#57197)

Venky committed 21 days ago

[Bugfix][HiSparse] Stop the host pool feeding device KV cache residency metrics (#58725)

Yueh-Ting (eop) Chen committed 21 days ago

[Docs] Clarify snapshot runtime image support (#59127)

Nils Matteson committed 21 days ago