mla: don't update kv cache on dummy forwards (#36282)

Itay Alroy committed 8 months ago

[ROCm][CI] Fixing yaml file for external amd-ci signal (#36284)

Andreas Karatzas committed 8 months ago

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538)

Copilot committed 8 months ago

[ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear) (#35850)

Chuan (Richard) Li committed 8 months ago

Enabling some B200-specific tests on MI355 (#35253)

Alexei-V-Ivanov-AMD committed 8 months ago

[CustomOp] CustomOp FusedRMSNormGated (#35877)

eellison committed 8 months ago

Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262)

Nick Hill committed 8 months ago

[Bugfix] Quickfix followups to busy loop removal in #28053 (#36068)

Travis Johnson committed 8 months ago

[compile] Stop unconditionally patching constrain_to_fx_strides (#36152)

Richard Zou committed 8 months ago

[Bugfix] Fix `cudagraph_mode:FULL` dispatch (This does not impact `FULL_AND_PIECEWISE` (default)) (#36165)

Raphaël Rialland committed 8 months ago

[Refactor] Modular video loader backend refactoring (#35202)

Isotr0py committed 8 months ago

[Misc] Lazy import registered processors (#36024)

Isotr0py committed 8 months ago

[bugfix] add api process rank in default multimodal request (#36150)

Chenguang Zheng committed 8 months ago

[CI] Fix startup error test (#36230)

Harry Mellor committed 8 months ago

[CI][MM] Gate vision encoder attention mask to MiniCPM only, fixing Aria regression (#36206)

Andreas Karatzas committed 8 months ago

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153)

Alex Brooks committed 8 months ago

[Core][KVConnector] Support HMA+NixlConnector (#35758)

Nicolò Lucchesi committed 8 months ago

[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158)

zhanqiuhu committed 8 months ago

[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching, eliminate batch variance (#35553)

Andreas Karatzas committed 8 months ago

Change "following fields were present in the request but ignored" log from warn to debug (#36173)

Tyler Michael Smith committed 8 months ago