Fix EventPublisherFactory logic for disabled KV cache events (#27419)

usberkeley committed about 1 year ago

[Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427)

fhl2000 committed about 1 year ago

[Misc] Add TPU usage report when using tpu_inference. (#27423)

hfan committed about 1 year ago

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)

Xiangyu Li committed about 1 year ago

Fix pooling adapters for Transformers backend (#27338)

Harry Mellor committed about 1 year ago

Granite 4.0 quark quantization support (#26944)

xiao-llm committed about 1 year ago

[Hardware][POWERPC] Disable oneDNN path in vllm/model_executor/layers/utils.py for Powerpc (#27422)

Akash kaothalkar committed about 1 year ago

[Model] Siglip Embedding Support (#27324)

Yu Jiaqi committed about 1 year ago

[Bugfix][DP] Fix creating too many DP Placement Groups (#26880)

Kebe committed about 1 year ago

[Attention] Fix FlashMLA metadata builder arguments for q_len > 1 (#27368)

Matthew Bonanni committed about 1 year ago

[Chore] Separate out `vllm.utils.platform_utils.py` (#27374)

Jonathan Chen committed about 1 year ago

[Misc] Add triton_kernels dependency (#27370)

Varun Sundar Rabindranath committed about 1 year ago

[Bugfix] Fix AWQ marlin layer skipping (#27416)

Isotr0py committed about 1 year ago

[Bugfix][ROCm][DeepSeek] Fix for forward_hip in rope for DeepSeek (#27373)

Gregory Shtrasberg committed about 1 year ago

[Bugfix] Fix dp_chunking enablement logic in FusedMoE layer (#27220)

Alexander Matveev committed about 1 year ago

Mirroring the test definitions (2025-10-22) (#27362)

Alexei-V-Ivanov-AMD committed about 1 year ago

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

wang.yuqi committed about 1 year ago

[CI/Build] Remove unnecessary flags from test registry (#27353)

Cyrus Leung committed about 1 year ago

[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)

Ilya Markov committed about 1 year ago

[Feature] Pydantic validation for speculative.py (#27156)

Navya Srivastava committed about 1 year ago