[Bugfix][KV Cache][GLM-5.3-Flash] Disable slot mapping kernel for the kpool tail buffer (#57317)

Simon Danielsson committed about 1 month ago

[Bugfix][ROCm][KV Offload] Use private pinned tensors for CPU KV offload (#57160)

Ren Yuzhou committed about 1 month ago

[Perf][GLM5.3-Flash] Use cooperative top-k for small GLM decode batches (#57327)

Chauncey committed about 1 month ago

[Bugfix][DSv4.1] Preserve NaN-scored candidate block indices (#57454)

Woosuk Kwon committed about 1 month ago

[Bugfix] DiffusionGemma: hand out stashed logprobs only on the committing step (#57414)

Matt Mastracci committed about 1 month ago

[ROCm][Bugfix] Gate AITER MXFP8 MoE on the aiter enable flag (#57426)

Rohan Potdar committed about 1 month ago

[XPU] Fix incorrect context-key normalization for Qwen DFlash-based models (#56431)

Yan Ma committed about 1 month ago

[Frontend][Core] Add release_kv_cache_memory() API (#44890)

Dakai An committed about 1 month ago

[AMD][Bugfix] Make the nested-RoPE patch reach automatic validation (#57289)

Oxana Korzh committed about 1 month ago

[Bugfix] Restore KV cache metadata GET method for external event consumer (#56925)

Wei Zhao committed about 1 month ago

[Bugfix][ROCm] Add record_logical_topk_ready to ROCMAiterMLASparseImpl (GLM-5.3-Flash boot crash) (#57252)

Mustafa YILDIRIM committed about 1 month ago

[Bugfix][DSv4.1] Fix FlashInfer DSpark non-causal attention (#57432)

Woosuk Kwon committed about 1 month ago

[AMD][CI][The Rock] Fix language models standard for The Rock on mi355 (#53837)

rasmith committed about 1 month ago

[Bugfix][Frontend] Reject stop strings on --tokens-only servers instead of silently ignoring them (#57058)

Shimi Bandiel committed about 1 month ago

[MoE] Encapsulate TRT-LLM BF16 weight layout handling (#57405)

Misha Goin committed about 1 month ago

[Perf] Add fused DFlash2 grouped convolution (#55960)

Misha Goin committed about 1 month ago

[CI] Shard multimodal Processor 1->4 (#56316)

Thang Nguyen committed about 1 month ago

[Bugfix] Release stale FlashMLA workspace views after growth (#56902)

Maroon Ayoub committed about 1 month ago

[ROCm][CI][The Rock 10] Fix (MI355) Quantized Models failure on The Rock 10 with Triton 3.8.x (#54849)

rasmith committed about 1 month ago

[Model] Add Cohere2MoE Eagle3 auxiliary hidden states (#49819)

Doug Brown committed about 1 month ago