[ROCm][DSV4] Enable Tilelang MHC replacing torch/triton mhc (#43679)

TJian committed 5 months ago

minor docs: fix incorrect example path (#43830)

JINO ROHIT committed 5 months ago

[Bugfix][Frontend] streaming tool-call serializer drops first args chunk when name and args share a DeltaMessage (#42683)

Ignacio Sica committed 5 months ago

[BugFix] Fix blocked reasoning parsing with MRV2 (#43808)

Nick Hill committed 5 months ago

[Bugfix] Pass `routed_scaling_factor` to FlashInfer TRTLLM BF16 MoE (#43769)

Thien Tran committed 5 months ago

fix: parse Qwen3 XML JSON arguments first (#43243)

Yufeng He committed 5 months ago

[ROCm][CI] Stabilize Cargo cache and pre-test image checks (#43815)

Andreas Karatzas committed 5 months ago

[Misc][Rocm] Remove redundant `AiterUnifiedAttentionBackend` block size log (#43664)

Nicolò Lucchesi committed 5 months ago

[MoE] Remove inplace fused experts mechanism (#43727)

Yongye Zhu committed 5 months ago

Fix RunAI streamer tensor buffer reuse during weight loading (#43464)

Benjamin Bartels committed 5 months ago

[Rust Frontend] Introduce mock engine for benchmark baseline (#43469)

Bugen Zhao committed 5 months ago

[ModelRunnerV2][Hybrid model] Support kernel block size in hybrid model (#38831)

Mengqing Cao committed 5 months ago

[Bugfix][Kernel] TRTLLM NVFP4 MoE chunking (#43599)

amitz-nv committed 5 months ago

Add @AndreasKaratzas to CODEOWNERS (#43740)

Andreas Karatzas committed 5 months ago

Fix Qwen3-VL and Qwen3-omni-thinker accuracy degradation from deepstack inputs under torch.compile (#43617)

Dakai An committed 5 months ago

[Bugfix][DFlash]allocate the proper number of lookahead slots (#43733)

Benjamin Chislett committed 5 months ago

Validate against some config fields being set to 0 (#43794)

Harry Mellor committed 5 months ago

Remove Transformers forward/backward compatibility tests (#43785)

Harry Mellor committed 5 months ago

[Quantization] Fix Humming RoutedExperts import (#43540)

Minh Vu committed 5 months ago

[8/n] Migrate merge_attn_states, mamba, sampler to torch stable ABI (continued) (#43361)

Chris Leonard committed 5 months ago