[Model] Optimize Qwen3.5 on H20 (#48350)

zzt committed 4 months ago

[ROCm][MiniMax-M3] Add AITER sparse paged attention (#47287)

Tan Pin Siang committed 4 months ago

[Kernel] Implement CUDA kernel for ReLUSquaredActivation (relu^2) (#39058)

Tanish Malekar committed 4 months ago

[Bugfix][KV Offloading] Fix stale transfer_jobs after reset_cache + harden job completion (#48102)

AlexHuang committed 4 months ago

[CI][Rust Frontend] Pin cargo tool versions (#48222)

Bugen Zhao committed 4 months ago

[EC Connector] Add EC Transfer Params (#42433)

omerpaz95 committed 4 months ago

[CI][2/N] reduce CI time (#48394)

Jiangyun Zhu committed 4 months ago

Make tiering offload region DP-replica aware (#47987)

liranschour committed 4 months ago

[Bugfix] Guard mixed-dtype allreduce RMSNorm quant fusions (#48330)

Hugo Centeno committed 4 months ago

[Frontend] Add /abort_requests to the RLHF dev API router (#47173)

aoshen02 committed 4 months ago

[Perf][Qwen] Replace MOE all-reduce with reduce-scatter (#47006)

Canlin Guo committed 4 months ago

Runtime Draft Weight Update for Speculative Decoding (#46725)

vx120 committed 4 months ago

[2/N][Core] support partial prefix cache hit for hybrid model (#46384)

Jiangyun Zhu committed 4 months ago

[CI][CPU] Add Qwen2-VL multimodal tests for CPU backend and fix incompatibilities (#48072)

zhao, zhenhui committed 4 months ago

[Bugfix][LoRA] Support ark_linear base layer in _get_lora_device (#47690)

Alejandro Paredes La Torre committed 4 months ago

[CI] split tests to reduce CI time (#48219)

Jiangyun Zhu committed 4 months ago

fix(processor): route MiMo-V2-Omni media fetch through MediaConnector (#43117)

Ievgen Bondarenko committed 4 months ago

fix(entrypoints): stop resolve_items leaking in-flight media fetch tasks on partial failure (#48333)

ErenAta16 committed 4 months ago

[2/N][KV-Cache Layout Refactor] Pack K/V into the content dim across attention backends (#44455)

Lucas Wilkinson committed 4 months ago

[XPU][UT]Fix InternS1ProForConditionalGeneration AssertionError (#48232)

Yejing Lai committed 4 months ago