[Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787)

Andreas Karatzas committed 8 months ago

[ROCm][CI][PD] Add Hybrid SSM integration tests to CI (#37924)

Andreas Karatzas committed 8 months ago

[release] Move the rest of release jobs to release queue (#38044)

Kevin H. Luu committed 8 months ago

[Perf] Disable inductor runtime asserts by default for serving perfor… (#37485)

Terry Gao committed 8 months ago

nano_nemotron_vl: suppress readonly torch.from_numpy() warning in image and video resize paths (#37903)

Netanel Haber committed 8 months ago

Make microbatch optimization (DBO) work with general models (#37926)

Junhao committed 8 months ago

[UX] Add flashinfer-cubin as CUDA default dep (#37233)

Michael Goin committed 8 months ago

[MRV2] Fix for DS v3.2 (#38030)

Woosuk Kwon committed 8 months ago

[Model Runner V2][Minor] Simplify PP logic (#38031)

Nick Hill committed 8 months ago

Add Ubuntu 24.04 support for Docker builds (#35386)

amey asgaonkar committed 8 months ago

[FlexAttention] allow custom mask mod (#37692)

liangel-02 committed 8 months ago

[Bugfix] Pass hf_token through config loading paths for gated model support (#37920)

Javier De Jesus committed 8 months ago

[BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015)

Richard Zou committed 8 months ago

[BugFix] Fix order of compile logging (#38012)

Richard Zou committed 8 months ago

[Model] Add Granite 4.0 1B speech to supported models (#38019)

Nick Cao committed 8 months ago

[Bugfix] Fix structured output crash on CPU due to pin_memory=True (#37706)

Willy Hardy committed 8 months ago

docs: fix broken offline inference paths in documentation (#37998)

Vineeta Tiwari committed 8 months ago

Fix Mamba state corruption from referencing stale block table entries (#37728) (#37728) (#37728)

Ming Yang committed 8 months ago

[Bugfix] Force continuous usage stats when CLI override is enabled (#37923)

Dhruv Singal committed 8 months ago

[XPU] Support Intel XPU hardware information collection in usage stats (#37964)

sihao_li committed 8 months ago