[Frontend] Return prompt metadata from /inference/v1/generate (#53187)

aoshen02 committed about 1 month ago

[BugFix][KV Connector] Fix Deadlock with KVConnector + MTP under KV Pressure (#57104)

Robert Shaw committed about 1 month ago

[Bugfix] Add Responses cache_write_tokens for API compat and CC parity (#57222)

yzong-rh committed about 1 month ago

[Build] Bump DeepGEMM pin to a6bbb80 (#57218)

Yongye Zhu committed about 1 month ago

[CI][Bugfix] Initialize _transfer_layer_group_ids in region_pull_worker fixture (#57211)

vllm-agent committed about 1 month ago

[Refactor] Remove unused interface methods (#57194)

Flora Feng committed about 1 month ago

[BugFix] Fix is_supported of cutlass FP8 linear (selected and fails on A100) (#55884)

danisereb committed about 1 month ago

[Perf][DSV4.1] Remove MegaMoE padding and shared padding workaround (#57204)

Woosuk Kwon committed about 1 month ago

[ROCm][Bugfix] Revert #56433 + #51692 to fix accuracy breakdown for DeepSeek-V4 (#57132)

Shanshan Shen committed about 1 month ago

[MM] Keep raw pixels through dp-sharded ViT path (#56872)

cjackal committed about 1 month ago

[Bugfix] Remove unsupported comma-separated detailed trace values (#55702)

jxj committed about 1 month ago

[Rust Frontend] Expose local DP size in gRPC Control metadata (#57116)

Alec committed about 1 month ago

[Bugfix] Fix np.float64 leaking into the KV transfer metrics log (#57068)

Nicolò Lucchesi committed about 1 month ago

[Bugfix][Model] Restore causal image SWA for DeepSeek V4.1 (#57152)

Juntian Liu committed about 1 month ago

[CI] Ignore ruff D209, rejoin the docstrings it split, and silence incompatible-rule warnings (#57212)

Harry Mellor committed about 1 month ago

[Benchmark] Retire stale benchmarks and consolidate RMSNorm (#57083)

Misha Goin committed about 1 month ago

[MM] Further cleanup _apply_hf_processor_main (#53610)

Cyrus Leung committed about 1 month ago

[ROCm] Expose kFp8DynamicTokenSym on AITER PTPC linears (#54248)

Rebecca Lee committed about 1 month ago

Add `pydocstyle` to the `ruff` rules (#52136)

Harry Mellor committed about 1 month ago

[Bugfix][HiSparse][PD] Align region-mapped pulls across logical block sizes (#57077)

Nicolò Lucchesi committed about 1 month ago