[CI] Shard multimodal extended generation 2 (#52323)

Kevin H. Luu committed 2 months ago

[CI] Shard extended pooling model tests (#52322)

Kevin H. Luu committed 2 months ago

[CI] Shard Quantization job into 4 parallel shards (≤30 min target) (#52328)

Kevin H. Luu committed 2 months ago

[CI][Test] Seed the DeepEP v2 MoE workers, not just the parent (#50589)

Guanxin Li committed 2 months ago

[ROCm]Remove special-case SiTU support model-specific gating (#50597)

sroberts-amd committed 2 months ago

[Rust Frontend][gRPC] Add RL lifecycle control (#51316)

Connor Carpenter committed 2 months ago

[Perf] Avoid more GPU<->CPU syncs in multimodal encoders (#52369)

Nick Hill committed 2 months ago

[ROCm][AMD] Enable preshuffled sparse indexing for 16-token blocks (#51216)

James E T Smith committed 2 months ago

[Test][LoRA] Speed up the LoRA test job (#52331)

stefankoncarevic committed 2 months ago

[Bugfix] Widen flashinfer.comm import guard so a failed import doesn't abort engine startup (#52241)

shanjiaz committed 2 months ago

[Model][Spec Decode] Tap the pre-norm AttnRes mixture as the Kimi K3 DFlash aux state (#50487)

Rahul Chalamala committed 2 months ago

[Misc] Remove `override_attention_dtype` (#48684)

wangxiyuan committed 2 months ago

[UT][XPU] fix b12x UT (#52265)

Qiming Zhang committed 2 months ago

[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)

Lucas Wilkinson committed 2 months ago

[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)

Zhuobin Huang committed 2 months ago

[Bugfix][Helm] Fix chart resource references (#51664)

iwannagotobed committed 2 months ago

[Doc] Update model support information (#52289)

Jee Jee Li committed 2 months ago

[Bugfix] Fix Cosmos3-Edge processor after transformers 5.15 release (#51989)

bastefaniak committed 2 months ago

[MRV2][Multimodal] Enable encoder cuda graph for model runner v2 (#49852)

Isotr0py committed 2 months ago

[Frontend] Consolidate entrypoint exception handler (#52261)

wang.yuqi committed 2 months ago