[Perf][KDA] Fuse gate softplus, chunk-local cumsum, and RCP_LN2 scaling (#43667)

zexplorerhj committed 5 months ago

[Perf] Optimize moe permute by pre-allocate buffer, 9~14% kernel performance improvement (#43014)

Wentao Ye committed 5 months ago

[BUGFIX] Multimodal benchmark with MistralTokenizer (#42965)

Julien Denize committed 5 months ago

Fix `OlmoHybridForCausalLM` not initialising (#43846)

Harry Mellor committed 5 months ago

[EC Connector] Add shutdown API to EC Connector. (#42423)

omerpaz95 committed 5 months ago

Log dummy DP step in iteration details (#41406)

Vadim Gimpelson committed 5 months ago

[Feature] Add structured output and effort support to Anthropic Messages API (#42396)

Chauncey committed 5 months ago

[CI] Auto-apply `rust` label to relevant PRs (#43866)

Bugen Zhao committed 5 months ago

[Bugfix] Fix HyperCLOVAX CI failure after upstream removed remote code (#43860)

Kevin H. Luu committed 5 months ago

[Bugfix][ROCm] Fix Accuracy Drop in Sparse Indexer on gfx950 (#43781)

kliuae committed 5 months ago

[Model][Bugfix] Rename weight_mapper to hf_to_vllm_mapper in LlamaNemotronVL pooling models (#43581)

Jakub Zakrzewski committed 5 months ago

[UX] Increase DP Coordinator startup timeout from 30s to 120s (#42343)

Wei Zhao committed 5 months ago

[Feature] Add support for timed trace replay in `vllm bench serve` to replay Moonshot and Alibaba workload traces (#39795)

Animesh Trivedi committed 5 months ago

[ROCm][CI] Move workload from MI300 to MI325 (#43824)

Andreas Karatzas committed 5 months ago

[Bugfix] Stream DeepSeek DSML tool-call argument deltas incrementally (#42879)

jack committed 5 months ago

Restore `Literal` for `WeightTransferConfig.backend` (#43183)

Harry Mellor committed 5 months ago

[DSV4] Remove AMD/XPU path in deepseek_v4/nvidia (#43829)

Woosuk Kwon committed 5 months ago

[Kernel] Marlin MoE: include SM 12.x in default arch list (#40923)

tonyliu312 committed 5 months ago

[BugFix] Fix hard-coded timeout for multi-API-server startup (#43768)

Vadim Gimpelson committed 5 months ago

change name of fs_python secondary tier to fs. (#43600)

Rotem Shavitt committed 5 months ago