[Test] Make Anthropic messages test compatible with SDK 1.x via extra_body (#57780)

jiangyunfan1 committed 20 days ago

[CPU][Zen] Add DA8W4 (W4A8) int4 support for dense and MoE layers (#54024)

Ganesh R committed 20 days ago

[GLM 5.3 Perf] Skip qlnorm calculation for MHA, 4.4~7.7% E2E TTFT Improvement (#58845)

Wentao Ye committed 20 days ago

[Bugfix][ROCm] Fix race on AITER MLA FP8 prefill scheduling metadata under async scheduling (#58887)

Mehdi Ghanimifard committed 20 days ago

[Perf][GDN] Slice pure spec-decode rows instead of a host-mask gather (#58763)

Luca Motz committed 20 days ago

[Bugfix] Preserve sampling masks in DELTA and TITO streaming outputs (#55935)

aoshen02 committed 20 days ago

[Qwen3.8-Flash-Next] Fuse main QK-norm/RoPE/gate and KV-cache write into the QSA pre-indexer launch (#57097)

Shuolei Wang committed 20 days ago

[Feature][Spec Decode] Support sampling mask replay for MRV2 MTP (#59359)

vx120 committed 20 days ago

[Bugfix][Tokenizer] Fix off-by-one max_token_id from vocab_size (#59491)

Shijie Lyu committed 20 days ago

[Rust Frontend] Split argument grammars into schema resolution and per-model rendering (#59395)

Bugen Zhao committed 20 days ago

[Rust Frontend] Snapshot structural-tag grammars as readable outlines (#59393)

Bugen Zhao committed 20 days ago

[Rust Frontend] Token-aware marker parsing for Kimi K3 (#58358)

Bugen Zhao committed 20 days ago

[Rust Frontend] Anchor tokens after pending UTF-8 bytes at their own first byte (#58357)

Bugen Zhao committed 20 days ago

[Perf][DSv4.1] Faster Engram host lookups: sorted rows, inline big lookups (#59327)

Juntian Liu committed 21 days ago

[Perf][Qwen4Exp] Add SM100 low-latency decode GEMM plans (#59214)

namgyu-youn committed 21 days ago

[Frontend] Enrich chat_parsing streaming events (#58603)

Yoni Gozlan committed 21 days ago

[weight loader] add dtype equality validation between parameter and weight (#51792)

Ning Xie committed 21 days ago

[Observability] add model initializing duration log (#52141)

Ning Xie committed 21 days ago

[Bugfix] Register IR providers before hashing configuration (#58756)

Nils Matteson committed 21 days ago

[Bugfix] Support CuTe DSL 4.8.0 block-scale API (#59480)

Hanjie Qiu committed 21 days ago