[Bugfix][MoE] Snapshot max_cudagraph_capture_size into FusedMoEConfig (#44613)

aoshen02 committed 5 months ago

[Misc] Replaced asserts with proper exceptions to improve UX for pooling (#44593)

Taneem Ibrahim committed 5 months ago

[Bugfix][Kernel] Fix mHC fused-RMSNorm big-fuse miscompile for hidden_size != 4096 (#44692)

Yongye Zhu committed 5 months ago

[Rust Frontend] Add Phi-4 mini JSON tool parser (#44213)

Devin Lai committed 5 months ago

Preserve layout-changing clones (#44574)

Mike G committed 5 months ago

[Bugfix] Fix `sequence_parallel_chunk_impl` custom op aliasing its input (#44130)

Vadim Gimpelson committed 5 months ago

[Cohere] fix RoutingMethodType (#44021)

Terrence Zhao committed 5 months ago

[Doc] Add Llama-3.2-3B-Instruct to batch-invariance tested models (#44435)

Daoyuan Li committed 5 months ago

[ROCm][GPT-OSS] Fuse RoPE + static Q FP8 quant on fused RoPE+KV path (#42832)

akii96 committed 5 months ago

[Core][Engine] allow DP ray placement groups to be set on specific nodes (#44669)

Walter Beller-Morales committed 5 months ago

Male Mergify comment less spammy (#44666)

Harry Mellor committed 5 months ago

[Bugfix] GPT-OSS instruction rendering (#44330)

yzong-rh committed 5 months ago

Upgrade tpu-inference to v0.21.0 (#44621)

Sting Lin committed 5 months ago

Fix sarvam forward compatibility with transformers v5 (#38804)

Flame committed 5 months ago

[Bugfix] [ROCm] [Critical] fallback to regular abi for ROCm (#44648)

TJian committed 5 months ago

Add objectstore as a secondary tier to multi-tier kv cache offloading (#41968)

Effi Ofer committed 5 months ago

Support MiniCPMV batched preprocessing (#44609)

Yan Ma committed 5 months ago

[CI] Bump mypy version `1.19.1` -> `1.20.2` (#44647)

Harry Mellor committed 5 months ago

Speed up docs build (#44635)

Harry Mellor committed 5 months ago

[CI] Bump mistral-common (#44649)

Harry Mellor committed 5 months ago