[Refactor][Parser] Migrate chat completion auto-tool/reasoning/plain streaming to parse_delta (#39446)

Flora Feng committed 7 months ago

[Bugfix]: Fix MinimaxM2ToolParser missing tools parameter (#39683)

Chauncey committed 7 months ago

[LMCache][MP] optimize save when mla enabled (#38810)

chunxiaozheng committed 7 months ago

[Model Runner V2] Add full cuda graph support for eagle prefill (#37588)

Giancarlo Delfin committed 7 months ago

ParakeetExtractor performance and UX enhancements (#39423)

Netanel Haber committed 7 months ago

[Refactor][Parser] Simplify parse_delta (#39728)

Flora Feng committed 7 months ago

Bug/test eagle dp v0 (#38938)

Monishver committed 7 months ago

[Bugfix][Pooling] Fix silent weight corruption with buffer-reusing iterators (#39650)

Pedram Razavi committed 7 months ago

[Core][Metrics] expose waiting request breakdown via labeled metric (capacity/deferred) (#38435)

mukesh-hai committed 7 months ago

[Bugfix] Reject non-nvfp4 dtypes when using the flashinfer_nvlink_one_sided all2all backend (#39717)

Tyler Michael Smith committed 7 months ago

[Doc] Fix Python-only build 404 fallback guidance (#38052)

Yuyi Ao committed 7 months ago

[Bugfix][Kernel][ROCm] Fix triton_w4a16 scales mismatch when BLOCK_K > group_size (#39705)

JartX committed 7 months ago

[Misc] Multi-turn benchmark output performance json (#39572)

Nicolò Lucchesi committed 7 months ago

[Bugfix] Use is_integrated to detect UMA GPUs for memory reporting (#35356)

haosdent committed 7 months ago

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604)

Yongye Zhu committed 7 months ago

[Bugfix] Fix tensor shape mismatch in sparse attention with speculative decoding (#39542)

Santino Ramos committed 7 months ago

[CI][Metrics] Fix local_cache_hit assertion after prompt tokens metrics updates (#39709)

zhanqiuhu committed 7 months ago

[Bug] Fix rocm sparse attn indexer issue (#39225)

Wentao Ye committed 7 months ago

[Bugfix][CT] Fix KV cache scale handling (#39418)

Yi Liu committed 7 months ago

[Bugfix] stream failure when model name not in audio endpoints (#36679)

Ekagra Ranjan committed 7 months ago