[Hardware][AMD][CI] Tweak mirrored tests; improve CI base dependency change detection (#46930)

Matt committed 4 months ago

[Bugfix][MM][CG] Enable dual-path ViT CUDA graph for Step3-VL (#46034)

Shanshan Shen committed 4 months ago

[ROCm][Perf] Add Fused Shared Expert (FSE) support for GLM-4.5/6/7 (#44313)

Olga Miroshnichenko committed 4 months ago

[Model] Support Unlimited OCR (#46564)

Tianyu Guo committed 4 months ago

[ROCm][CI] Add ci_base metadata for external cache orchestration (#46886)

Andreas Karatzas committed 4 months ago

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

Chauncey committed 4 months ago

[KV-Offloading] Fix tensors_per_block stride (#46888)

Varun Sundar Rabindranath committed 4 months ago

[Hardware][AMD][CI] Patch Whisper multi LoRA test to use TRITON_ATTN for now (#46928)

Matt committed 4 months ago

[Model Runner V2][Spec Decode] Use fp32 uniform threshold for acceptance (#46878)

Giancarlo Delfin committed 4 months ago

Fixed chunked embedding aggregation with request-id metadata (#46782)

Taneem Ibrahim committed 4 months ago

[Misc] Fix incorrect layer type annotation in Fp8LinearMethod (#46818)

jj shao committed 4 months ago

[CI Bug] Fix h100 `AssertionError: Cold-start child failed` (#46927)

Wentao Ye committed 4 months ago

[Bugfix][Test] Fix test_flashinfer_cutlass_mxfp4_fused_moe on sm90 (stale weight/scale interleave) (#46915)

xiaolinchen committed 4 months ago

[ROCm][Perf] Fused shared expert for Minimax M3 (#46474)

Fangzhou Ai committed 4 months ago

[ROCm][Perf] Use flydsl moe with Minimax-M3 mxfp8 weights on gfx950 and implemented moe-backend selection (#46184)

Hongxia Yang committed 4 months ago

[ROCm][CI] Move remaining mi250_2 tests out of the MI250 queue (#46905)

Andreas Karatzas committed 4 months ago

[ROCm][CI] Add TRITON_ATTN score absolute tolerance floor (#46891)

peizhang56 committed 4 months ago

[GLM5.2 Perf] `fused_indexer_q_rope_quant` triton kernel, 1.9% ~ 3.3% E2E Throughput improvement. (#46862)

Wentao Ye committed 4 months ago

[CLI] Add flag to print TTFT and TPS in `vllm chat` (#46775)

Benjamin Chislett committed 4 months ago

fix: Correct reasoning-end detection for prompt history (#44551)

JasonCohere committed 4 months ago