[Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571)

haosdent committed 8 months ago

[XPU] bump vllm-xpu-kernels to v0.1.3 (#35984)

Kunshang Ji committed 8 months ago

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681)

Kunshang Ji committed 8 months ago

[ROCm][Bugfix] Fall back from CK MXFP4 MoE when GEMM dimensions are unsupported (#35893)

Chuan (Richard) Li committed 8 months ago

[Bugfix] Add missing dynamic_arg_dims for Qwen3-ASR torch.compile (#35869)

Nathan Price committed 8 months ago

[Core] Remove busy loop from idle buffer readers (#28053)

Joe Runde committed 8 months ago

Support Audio Extraction from MP4 Video for Nemotron Nano VL (#35539)

Andrii Skliar committed 8 months ago

[cohere][fix][spec-decode]: fix crash when allowed_token_ids is set without penalties (#35654)

Komal Kumar Teru committed 8 months ago

[Bugfix] Improve engine ready timeout error message (#35616)

lailoo committed 8 months ago

[BugFix] Support tool_choice=none in the Anthropic API (#35835)

ShiJie Zhong committed 8 months ago

[Rocm][CI] Fix ROCm LM Eval Large Models (8 Card) (#35913)

Charlie Fu committed 8 months ago

[Bugfix] Guard mm_token_type_ids kwarg in get_mrope_input_positions (#35711)

Andreas Karatzas committed 8 months ago

[Refactor] Clean up processor kwargs extraction (#35872)

Cyrus Leung committed 8 months ago

[Chore] Remove debug code in model implementation (#35883)

Isotr0py committed 8 months ago

[model] support FireRedASR2 (#35727)

AllenDou committed 8 months ago

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753)

Shanshan Shen committed 8 months ago

[Bugfix] Fix EVS implementation for Qwen3 VL (#33607)

William Zhang committed 8 months ago

Enable bnb for multiple indices weight (#35838)

xjx committed 8 months ago

[ROCm][CI] Support async weight transfer example with platform-aware determinism (#35710)

Andreas Karatzas committed 8 months ago

[Bugfix] Fix coord_socket assertion in DPEngineCoreProc for offline DP mode (#35916)

Jaewon committed 8 months ago