Consolidate Intel Quantization Toolkit Integration in vLLM (#31716)

Yi Liu committed 10 months ago

[ROCm][CI] Disable Async Scheduling For Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test (#32275)

Micah Williamson committed 10 months ago

[Model Runner V2] Refactor Sampler (#32245)

Woosuk Kwon committed 10 months ago

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885)

Roberto L. Castro committed 10 months ago

[Improvement] Persist CUDA compat libraries paths to prevent reset on `apt-get` (#30784)

emricksini-h committed 10 months ago

Add mergify label job for "bug" in PR titles (#31980)

Michael Goin committed 10 months ago

[Build] Add scripts for cherry-picking and trigger build (#32282)

Simon Mo committed 10 months ago

[Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502)

HappyAmazonian committed 10 months ago

fix(rocm): Use refresh_env_variables() for rocm_aiter_ops in test_moe (#31711)

Rabi Mishra committed 10 months ago

[Perf] Optimize grouped topk kernel, 1.2%~2% E2E Throughput improvement (#32058)

Wentao Ye committed 10 months ago

Fix CUDA 13 wheel installation doc (#32276)

Dmitry Tokarev committed 10 months ago

[responseAPI] support partial message generation (#32100)

Andrew Xia committed 10 months ago

[EPLB][Cleanup] Remove `is_async_enabled` from `EplbModelState` (#32050)

Sage Moore committed 10 months ago

[Trivial] Remove duplicate enable_mfu_metrics (#32246)

Mark McLoughlin committed 10 months ago

[4/N][Attention] Move MLA common to model_executor (#32060)

Matthew Bonanni committed 10 months ago

nixl_connector: export UCX_MEM_MMAP_HOOK_MODE=none to avoid a UCX memory leak (#32181)

Mathis Felardos committed 10 months ago

[BugFix] [KVConnector] Fix KV events for LMCache connector (#32169)

Martin Hickey committed 10 months ago

[Refactor] [7/N] to simplify the vLLM lora serving architecture (#32251)

Chauncey committed 10 months ago

[Refactor] Remove `MultiModalProfiler` (#32254)

Cyrus Leung committed 10 months ago

[6/N][Attention] Move utils to more appropriate locations (#32215)

Matthew Bonanni committed 10 months ago