[CI] Return HTTP 400 for unsupported chat content part type (#41121)

haosdent committed 6 months ago

[CI][AMD][BugFix] Patch has_flashinfer decorator for test_select_rocm_aiter_backend (#41072)

rasmith committed 6 months ago

[DSV4] Align aux stream API with DeepseekV4DecoderLayer (#41171)

qizixi committed 6 months ago

[Bugfix][ROCm] Fix gemm_a4w4 call to use updated AITER API signature (#40754)

chelnnexy committed 6 months ago

[Core] Account for `num_gpu_blocks_override` in `max_model_len` checks (#41069)

Nick Hill committed 6 months ago

[Doc] Add missing API endpoints to security documentation (#40532)

Russell Bryant committed 6 months ago

[FEATURE] Add EagleMistralForCausalLM (#41024)

Julien Denize committed 6 months ago

[Bugfix] release KV blocks for skipped P-ranks to prevent invalid KV errors and timeouts when P_tp > D_tp and MLA (#40449)

yangrz committed 6 months ago

[New Model] Laguna XS.2 implementation (#41129)

Joe Rowell committed 6 months ago

[CI][AMD][BugFix] Update request URL in test_moriio_connector to match vllm-router compatibility changes (#41076)

rasmith committed 6 months ago

[Build] Defer flashinfer cubin download to avoid ~2.5 GB (decompressed) layer duplication (#41134)

Benoit Tigeot committed 6 months ago

[DSV4] Enable Multi-stream for Pre-Attn GEMM (#41061)

Yongye Zhu committed 6 months ago

Add tuned triton fused_moe configs on H100 for gpt-oss (#39904)

zhangxin81 committed 6 months ago

[Bugfix] Exclude numa_bind fields from ParallelConfig DP hash (#41098)

Roy Wang committed 6 months ago

[Bugfix][Granite4Vision] Fix deepstack buffer causing decode slowdown in compiled mode (#40917)

artem-spector committed 6 months ago

Bugfix: fix SpecBench sample argument error (#40927)

zhrrr committed 6 months ago

[Examples] Resettle features examples. (#40995)

wang.yuqi committed 6 months ago

[Core] Fix redundant None append in StepPool.forward for chunked prefill (#41049)

anthonsu committed 6 months ago

[Bugfix ] fix bailing_moe_linear (#40859)

JiangWeixiang committed 6 months ago

[Model] update for mimo v25 (#41029)

Jiangyun Zhu committed 6 months ago