[CPU] Fix s390x builds and update torch version in dockerfile (#50144)

Rehan Khan committed 3 months ago

Add CachePolicyFactory for pluggable/external eviction policies (#49114)

Philip Pesic committed 3 months ago

[CI][ROCm] Stabilize Qwen2-VL LoRA test (#50161)

Andreas Karatzas committed 3 months ago

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

Zach Zhu committed 3 months ago

[KV Connector] Support NIXL P/D for hybrid MLA+SSM models (#49762)

Nick Hill committed 3 months ago

Integrate CuTeDSL MoE for ReLU2 NVFP4 (#49580)

danielafrimi committed 3 months ago

[CompressedTensors] FP4 Qutlass Integration (#43229)

Kyle Sayers committed 3 months ago

[ROCm][CI] Stabilize ngram and suffix correctness test (#50190)

Andreas Karatzas committed 3 months ago

[Model] Add Inkling compressed-tensors dynamic FP8 support (#48876)

Krishna Teja Chitty-Venkata committed 3 months ago

[CI] Allow comment-triggered builds past pipeline filters (#50197)

Kevin H. Luu committed 3 months ago

[CI] Add comment-based Buildkite triggers (#50132)

Kevin H. Luu committed 3 months ago

[BugFix] Stop dummy runs from writing mamba state through stale block-table rows (#49757)

Nick Hill committed 3 months ago

[Bugfix] Fix /wake_up crash on hybrid models (Mamba/DeltaNet) (#41602)

Kevin Glynn committed 3 months ago

[CI][NIXL] Fix flaky DP+EP test port conflict (#50171)

Divakar Verma committed 3 months ago

[ROCm][CI] Stabilize ROCm audio streaming test (#50163)

Andreas Karatzas committed 3 months ago

[MXFP8][ROCm] Fix MXFP8 MoE backend selection (#49747)

fxmarty-amd committed 3 months ago

[Test] Make EPD correctness tests configurable for XPU (#50110)

liuzhenwei committed 3 months ago

[Perf] Zero-copy torch.Tensor pickling in shm_broadcast MessageQueue (#48442)

Ruinan Ma committed 3 months ago

perf: dispatch non-grouped bias-less topk routing methods to fused path (#49618)

Julien Debache committed 3 months ago

[Model] Add Kimi K3 support: Rust frontend [1/2] (#50104)

Bugen Zhao committed 3 months ago