Modify torch dependency in xpu.txt (#43087)

Bram Vanroy committed 5 months ago

[Dependency] Remove stale cuDNN frontend upper bound (#42599)

Mohammad Miadh Angkad committed 5 months ago

[CI] Stabilize the multi-audio OpenAI server path (#44051)

Andreas Karatzas committed 5 months ago

[Doc] Fix multimodal torch.compile troubleshooting to not use removed VLLM_TORCH_COMPILE_LEVEL (#44378)

Daoyuan Li committed 5 months ago

[Bugfix][Mooncake] Fix per-group block_size/block_hash and group_idx in MooncakeStoreConnector KV events (#44103)

Yifan Qiao committed 5 months ago

[videoloader] implement glm46v video loader (#44417)

Jared Wen committed 5 months ago

[Cohere] Enable Cohere Mini Code model and update Command A-plus test registry (#44707)

Terrence Zhao committed 5 months ago

[feature] add index share feature for DSA MTP (#44420)

Jared Wen committed 5 months ago

[Bugfix] Fix benchmark_moe.py after inplace mechanism removal (#44041)

Qiuyang Yue committed 5 months ago

[XPU] add xpu branch in compressed_tensors_moe_w4a4_mxfp4 (#44540)

zofia committed 5 months ago

[XPU][Feature] transparent sleep mode support for XPU platform (#37149)

Yan Ma committed 5 months ago

[XPU] Support cpu kv offloading and tiering offloading on XPU platform (#36423)

Chaojun Zhang committed 5 months ago

[DSV4] Decouple DS V4 Sparse MLA Metadata from DS V3.2 (#44699)

Woosuk Kwon committed 5 months ago

[ROCm][MLA] Replace torch.cat in sparse-MLA forward_mqa with fused concat_mla_q (#42838)

Markus Hartikainen committed 5 months ago

[BugFix] Resolve multiple async kv load deadlock (#44560)

Nick Hill committed 5 months ago

[ROCm][Perf] Fused MoE W4A16 HIP kernel for AMD RDNA3 (gfx1100) (#44075)

JartX committed 5 months ago

[PERF] [Qwen3.5] Split mixed prefill+decode batches: route decodes to the recurrent kernel (#44700)

Vadim Gimpelson committed 5 months ago

[Bugfix] Fix Qwen3.5-FP8 nightly fail. Guard fused_add_rms_norm input/weight dtype mismatch in RMSNorm + quant fusion (#44694)

Vadim Gimpelson committed 5 months ago

[Bugfix][ROCm] `ApplyRotaryEmb`: fall back to native when flash_attn rotary grid would exceed the HIP per-dim limit (#43684)

Fuwei Yang committed 5 months ago

[Bugfix][Voxtral] Add fetch_audio to MistralCommonFeatureExtractor (transformers>=5.10 compat) (#44559)

Yadan-Wei committed 5 months ago