[Bugfix] Zero new KV blocks for quantized + sliding-window hybrid caches (#47574)

EdalatiAli committed 3 months ago

[Misc][Docs] Remove duplicate CodeGeex4 row in XPU model table (#47210)

Lena Onyshchenko committed 3 months ago

fix(openai): reject non-numeric logprobs with 400 instead of 500 (#49144)

hcl committed 3 months ago

[Bugfix][Rust Frontend] Map missing prompt logprobs for single-token prompts in chat and raw generate (#49111)

Salt Sato committed 3 months ago

[Misc][Docs] Fix broken csrc kernel links in fusions doc (#47211)

Lena Onyshchenko committed 3 months ago

[Rust Frontend] Fix macro-based content format detection (#49042)

Reid committed 3 months ago

[Rust][Benchmark] Integrate `vllm-bench` to `vllm-rs` & `vllm` CLI (#48930)

Bugen Zhao committed 3 months ago

[XPU] FP8 o_proj with fp8_bmm and load-time scale transpose (#48334)

Xiaochang Wu committed 3 months ago

[Rust Frontend] Use zero-copy slicing for multimodal tensors (#48781)

Sage committed 3 months ago

[XPU] [MoE] add quant input when prepare for fusedmoe (#47122)

zofia committed 3 months ago

[CPU] fixes heterogeneous NIXL KV transfer into CPU_ATTN decode workers (#47871)

Sihan Chen committed 3 months ago

[XPU][Bugfix] Fix GroupCoordinator device_index (#47295)

Michał Ganczarenko committed 3 months ago

[Bugfix][RL] Set vLLM config during weight reload (#45989)

aoshen02 committed 3 months ago

[Doc] Document blocks_per_chunk in the KV offloading guide (#49100)

Itay Etelis committed 3 months ago

[Bugfix][KV Offload] Propagate EAGLE mode to SimpleCPU coordinator (#49071)

Yifan Qiao committed 3 months ago

[Hardware][CPU] Enable granite-4 model on cpu (#47641)

Akash kaothalkar committed 3 months ago

[Bugfix] Fix logprobs token-string collision from SentencePiece space… (#48674)

aoshen02 committed 3 months ago

[ROCm][CI] Fix sparse MLA metadata sync fixture (#49128)

Andreas Karatzas committed 3 months ago

[Bugfix] Fix broken NVVM caused by CuteDSL 4.6.0 (#49108)

Thien Tran committed 3 months ago

[CI] Move compatible 1xL4 jobs to H200 35GB MIG (#43024)

Kevin H. Luu committed 3 months ago