[Fix] Remove divisibility requirement between num_kv_heads and tp_size in bailing_moe (#26876)

ant-yy committed about 1 year ago

[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853)

Xudong Ma committed about 1 year ago

[doc] add Context Parallel Deployment doc (#26877)

youkaichao committed about 1 year ago

[Doc] ruff format remaining Python examples (#26795)

Cyrus Leung committed about 1 year ago

[CI] Fix mypy for `vllm/executor` (#26845)

Wentao Ye committed about 1 year ago

[CI/Build] Add Qwen2.5-VL-7B-Instruct ChartQA Accuracy Tests in CI (#21810)

Zhewen Li committed about 1 year ago

[Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456)

Yongye Zhu committed about 1 year ago

[bugfix] Lazy import cv2 (#26869)

Angela Yi committed about 1 year ago

[Misc] Use helper function to generate dummy messages in OpenAI MM tests (#26875)

Cyrus Leung committed about 1 year ago

[DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656)

Mengqing Cao committed about 1 year ago

[Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873)

sangho.lee committed about 1 year ago

[Graph Partition] pass tests for decorator (#26831)

Boyuan Feng committed about 1 year ago

[Bugfix] Fix qwen3-omni audio truncation issue (#26815)

Isotr0py committed about 1 year ago

[BugFix] Patch inductor partitioning logic (#26735)

Angela Yi committed about 1 year ago

[Feature] default --extra-body param to disable thinking in vllm bench serve (#26784)

rongfu.leng committed about 1 year ago

[CI/Build][Bugfix] fix qutlass cmake error when set QUTLASS_SRC_DIR (#26773)

zhrrr committed about 1 year ago

[Docs] Move build.inc into arm.inc (#26862)

Michael Yao committed about 1 year ago

[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589)

Tao Hui committed about 1 year ago

[Bugfix] Fixes prefix-repetition benchmark script (#26828)

kourosh hakhamaneshi committed about 1 year ago

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

Morrison Turnansky committed about 1 year ago