[Attention]: Use KVCacheSpec for AttentionMetadataBuilder type hints (#50148)

Martin Hickey committed 3 months ago

K3 DSpark AR fusion (#50242)

Jee Jee Li committed 3 months ago

[Misc] Clarify mono audio requirement (#50141)

Nicolò Lucchesi committed 3 months ago

[MoE Refactor] Rename FusedMoE to FusedMoEFactory (#44941)

bnellnm committed 3 months ago

[ROCm][CI] Update Transformers AR+RMS fusion expectation (#50517)

Andreas Karatzas committed 3 months ago

[chore] clean-up weight prepack for INT8 MoE (#50116)

Fadi Arafeh committed 3 months ago

[CPU][s390x] Optimize inference perf and add oneDNN INT8 GEMM for s390x (#50219)

Rehan Khan committed 3 months ago

[XPU] Unify XPU RMSNorm kernels with vllm_c and drop redundant XPU-specific implementation (#46981)

Chaojun Zhang committed 3 months ago

[UT] add skipif for rocm aiter sampler UT (#50530)

Qiming Zhang committed 3 months ago

[CI] Add M3 MSA tests to CI (#49143)

Thien Tran committed 3 months ago

[Bugfix] Re-land MiniMax M3 default video processor (#50305)

Taneem Ibrahim committed 3 months ago

[CPU][BugFix] Remove redundant kv cache write (#50437)

Fadi Arafeh committed 3 months ago

Fix duplicate HunyuanVL image boundary tokens (#49691)

Mi Jiazhi committed 3 months ago

[XPU][CI]Adjust source_file_dependencies for NixlConnector PD accuracy (4 GPUs) (#50373)

xiangdong committed 3 months ago

[Multimodal] Expose mm hash algothrim selection to cli args (#49686)

Isotr0py committed 3 months ago

[Model Runner V2] Enable encoder token classification (#50293)

Taneem Ibrahim committed 3 months ago

[Bugfix][Model] Reject encoder-backbone jina-embeddings-v5 checkpoints with a clear error (fixes #50337) (#50352)

Sebastian Woo committed 3 months ago

[DSv4] Remove sparse-MLA q-head padding for FlashInfer >=0.6.14 (#48047)

Jeff (Junze) Ma committed 3 months ago

[ROCm][CI] Use explicit wvSplitKrc skinny-GEMM test tolerance for bf16 (gfx950) (#49309)

stefankoncarevic committed 3 months ago

[KV Offload] Enable single-copy MLA layout for CPUOffloadingSpec (#50301)

Chang Guo committed 3 months ago