OffloadingConnector: Prevent redundant loads (#29087)

Or Ozeri committed 10 months ago

Revert "[PluggableLayer][1/N] Define PluggableLayer" (#32725)

Robert Shaw committed 10 months ago

fp8 online quant: split out Fp8OnlineLinearMethod (#32189)

Vasiliy Kuznetsov committed 10 months ago

[ROCm][CI] Remove DS async eplb accuracy test from AMD CI (#32717)

Micah Williamson committed 10 months ago

[Bugfix] Suppress log on non-ROCm platform (#32703)

TJian committed 10 months ago

[Misc] Remove pad_for_cudagraphs from config (#30143)

Lucas Wilkinson committed 10 months ago

[Bugfix] Fix byte fallback handling when using outlines (#31391)

Shinichi Hemmi committed 10 months ago

[AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205)

dolpm committed 10 months ago

[5/N] Initialize MM components in context managers (Q-Z) (#32695)

Cyrus Leung committed 10 months ago

Test: added acceptance length tests (#32030)

Rahul Tuli committed 10 months ago

[Doc] Update docs for MM model development with context usage (#32691)

Cyrus Leung committed 10 months ago

[Model Runner V2] Support FLASHINFER_MLA backend (#32709)

Woosuk Kwon committed 10 months ago

[Bugfix] fix the ima issue of qwen-vit (#32687)

JJJYmmm committed 10 months ago

[Doc] [ROCm] Update ROCm getting started doc (#32580)

TJian committed 10 months ago

[Perf] Only clone when needed for `moe_permute` (#32273)

Wentao Ye committed 10 months ago

[PluggableLayer][1/N] Define PluggableLayer (#32331)

whx committed 10 months ago

[Bugfix] Fix Off-by-one error in _num_tokens_to_min_blocks calculation (#32603)

linhaifeng committed 10 months ago

[XPU]Support AgRsAll2AllManager on XPU device (#32654)

YiSheng5 committed 10 months ago

[4/N] Initialize MM components in context managers (M-P) (#32663)

Cyrus Leung committed 10 months ago

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661)

杨朱 · Kiki committed 10 months ago