[Bugfix] Reapply 50869 (#52223)

Benjamin Chislett committed 2 months ago

[Bugfix] Correct prompt lengths for timed_traces benchmark (#45423)

Stan Wozniak committed 2 months ago

[Attention] Fix FlashInfer SM12x prefill with sinks (#52148)

Andrii Skliar committed 2 months ago

[CI Failure] Fix CUDA wheel build for the Kimi K3 fused MLA kernel (#52210)

Misha Goin committed 2 months ago

[Platform] Add check_runner_kv_caches_multi_layer (#51633)

wangxiyuan committed 2 months ago

[Bugfix][ROCm][CI] Give the AITER MLA decode metadata stub its MLA dims (#52139)

stefankoncarevic committed 2 months ago

[ROCm] Defer `tilelang` import through its import `from vllm.tilelang_utils import tilelang` and relaxed `has_tilelang` (#51159)

fxmarty-amd committed 2 months ago

[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#50595)

yzong-rh committed 2 months ago

[Quantization] Remove dead `QuantizationConfig.is_mxfp4_quant` (#51793)

fxmarty-amd committed 2 months ago

[ROCm][CI] Solidify entrypoint LLM lifecycle (#51280)

Andreas Karatzas committed 2 months ago

Auto-ping Cohere on related issues (#52091)

Cyrus Leung committed 2 months ago

[Bugfix] Declare SupportsEagle3 on KimiLinearForCausalLM (#52171)

Nick Iusiumbeli committed 2 months ago

Apply logit softcapping in Transformers modelling backend (#52173)

Harry Mellor committed 2 months ago

[Kimi-K3] Add GEMM-RS for sequence parallelism (#52079)

Thien Tran committed 2 months ago

[Bugfix][MiniCPM-V] Fix AssertionError in get_dummy_mm_data when passing VideoDummyOptions to _get_dummy_images (#52122)

Qiming Zhang committed 2 months ago

[Bugfix] Fix `--data-parallel-start-rank 0` being treated as unset in `create_engine_config` (#47692)

Ali Jaseem committed 2 months ago

Standardise weight tying on `ParallelLMHead.tie_weights` (#52147)

Harry Mellor committed 2 months ago

[Frontend] Add routed-experts prompt offset (#51906)

aoshen02 committed 2 months ago

[ROCm] Enable V2 model runner for Kimi-K3 on ROCm (#51653)

vllmellm committed 2 months ago

[Bugfix] Fix packed GDN decode launch for large batch-head grids (#52030)

Michael Goin committed 2 months ago