Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714)

Simon Mo committed about 1 year ago

Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598)

Huy Do committed about 1 year ago

[Core] Early return in SlidingWindowManager.remove_skipped_blocks (#27673)

Jialin Ouyang committed about 1 year ago

[Bug] Fix deepep low latency use nvlink by default (#27677)

Wentao Ye committed about 1 year ago

[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)

Lucas Kabela committed about 1 year ago

[AsyncScheduling] Make async overlap work with logprobs (#27615)

Nick Hill committed about 1 year ago

[Core] Scheduler: Publish connector events after output (#25875)

Or Ozeri committed about 1 year ago

[Test] Batch Invariant: Unit test using parameterized backend (#27478)

Wentao Ye committed about 1 year ago

[Misc] Make reorder batch also separate extends (#27367)

Lucas Wilkinson committed about 1 year ago

Add load pattern configuration guide to benchmarks (#26886)

Matvei Pashkovskii committed about 1 year ago

[compile] Add fallback path to AOT compile when serialization fails. (#27350)

Zhengxu Chen committed about 1 year ago

[Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658)

Cyrus Leung committed about 1 year ago

[Bugfix][CI] Fix v1 attention backend tests and add CI coverage (#26597)

Mohammad Miadh Angkad committed about 1 year ago

[Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117)

Kero Liang committed about 1 year ago

[FLA] Introduce Kimi Delta Attention(KDA) to VLLM (#27654)

Zhiyuan Li committed about 1 year ago

[nit]: Fix import for the lmcache integration (#27600)

Samuel Shen committed about 1 year ago

[BugFix] Also consider RAY_EXPERIMENTAL_NOSET_* when storing compilation cache (#27294)

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 committed about 1 year ago

[Bugfix][Frontend] validate arg priority in frontend LLM class before add request (#27596)

Junpu Fan committed about 1 year ago

[Core] Enable async scheduling for external_launcher mode (#27394)

22quinn committed about 1 year ago

fix: allow HuggingFace standard chat template params via **kwargs (#27622)

wangln19 committed about 1 year ago