[Bugfix][ROCm]: Allow `gpt_oss_mxfp4` quantization method on rocm (#39754)

Rohan Potdar committed 7 months ago

[Core][Metrics] Remove unused `SchedulerStats.encoder_cache_usage` (#39693)

Mark McLoughlin committed 7 months ago

[ROCm][CI] Fix condition for `test_per_token_group_quant_fp8_packed` (#39730)

Micah Williamson committed 7 months ago

Bugfix: `use_existing_torch.py`: Glob recursive subdirs in requirements (fixes #39024) (#39793)

Netanel Haber committed 7 months ago

Measure encoder compile time seperate from llm backbone (#39240)

Lucas Kabela committed 7 months ago

[PluggableLayer][3/N] Apply PluggableLayer to moe-related layers. (#33556)

Hexiang Wang committed 7 months ago

[MoE Refactor] Remove MoE DP chunking (#39107)

bnellnm committed 7 months ago

[Bugfix] Fix mismatch between global and local attention heads in tensor-parallel mode for param2moe model (#39707)

bhargav-patel-29 committed 7 months ago

fix: handle ImportError in load_audio (#39473)

Yiyang "Ian" Liu committed 7 months ago

[Bugfix] Fix `vllm bench serve` to count multimodal tokens in "total input tokens" (#38654)

Matthias Gehre committed 7 months ago

[Bugfix][Model] Fix Devstral Small 2 HF format weight loading (#39293)

Thomas committed 7 months ago

[fix][MOE] Fix MOE experts `intermediate_size` dimension not being narrowed before weight loading (#39688)

fxmarty-amd committed 7 months ago

[XPU][CI] Remove Arc in label-xpu (#39776)

xiangdong committed 7 months ago

feat: add TxtSlicesDataset to allow sampling slices from txt file for benchmarking (#30156)

Julien Debache committed 7 months ago

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3-VL video inference (#38061)

Shanshan Shen committed 7 months ago

[Frontend] Offload blocking preprocessing & postprocessing ops to thread pool for pooling entrypoints. (#39763)

wang.yuqi committed 7 months ago

[Model] Use mm_features for Ernie-4.5 VL M-RoPE (#39753)

lalit10 committed 7 months ago

[Core][Metrics][BugFix] Replace num_cached_tokens/num_external_computed_tokens with PrefillStats (#37460)

Mark McLoughlin committed 7 months ago

Fix Responses API streaming for multiple auto tool calls (#39626)

noobHappylife committed 7 months ago

[Bugfix] Fix Gemma4 tool parser converting bare `null` to string `"null"` (#39679)

김의진 committed 7 months ago