[XPU] fix MoE triton backend in online fp8 quantization (#40109)

Yan Ma committed 7 months ago

Properly enable wvSplitK fp8 path for RDNA (#37712)

Hashem Hashemi committed 7 months ago

[ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242)

Rita Brugarolas committed 7 months ago

[Bug] Fix dcp error message (#40053)

Wentao Ye committed 7 months ago

[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)

larryli2-amd committed 7 months ago

[CI][EPLB] Add Async EPLB end-to-end integration test to CI (#40168)

Sage Moore committed 7 months ago

mxfp8 online quant move to new frontend (#40152)

Vasiliy Kuznetsov committed 7 months ago

[bugfix] Use only onlines CPUs in lscpu (#40161)

Galigator committed 7 months ago

[Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125)

aleksandaryanakiev committed 7 months ago

[XPU] enable triton attention test on XPU by removing cuda device binding (#39627)

Yan Ma committed 7 months ago

nixl refactor [2/N]: unify TpKVTopology + HeteroTPTransferConfig into TransferTopology (#39529)

zhanqiuhu committed 7 months ago

[EPLB] Add nixl-based eplb communicator (#36276)

Ilya Markov committed 7 months ago

[kv_offload+HMA][4/N]: Support sliding window lookup (#36645)

Or Ozeri committed 7 months ago

[CPU][BugFix] Fix inter-node pipeline parallel (#40150)

Fadi Arafeh committed 7 months ago

[Bugfix] Fix scaled_mm output narrowing for 3D input tensors (#38093)

nemanjaudovic committed 7 months ago

[ROCm][CI] Introducing new MI300 nodes (#39531)

Andreas Karatzas committed 7 months ago

[Docs] Fix thinking_token_budget docs (#40316)

milesial committed 7 months ago

[Bugfix] Forward mm_processor_kwargs in offline generate APIs (#40251)

wuyingjun committed 7 months ago

[Fix] Add Spacing when Requesting Output Token > max_model_len (#40324)

San-Nguyen committed 7 months ago

[CPU][RISC-V] Support multiple RVV VLEN targets via compile-time dispatch (#39478)

velonica0 committed 7 months ago