[Doc] Add more tips to avoid OOM (#16765)

Cyrus Leung committed over 1 year ago

[misc] ignore marlin_moe_wna16 local gen codes (#16760)

DefTruth committed over 1 year ago

[Ray] Improve documentation on batch inference (#16609)

Richard Liaw committed over 1 year ago

[V1] Remove log noise when idle (#16735)

Russell Bryant committed over 1 year ago

[Bugfix] Revert max_prompt_len validation for decoder-only models. (#16741)

David Heineman committed over 1 year ago

[Bugfix] Update Florence-2 tokenizer to make grounding tasks work (#16734)

Isotr0py committed over 1 year ago

[rocm][V0] fix selection logic for custom PA in V0 (#16426)

Divakar Verma committed over 1 year ago

[V1][Frontend] Improve Shutdown And Logs (#11737)

Robert Shaw committed over 1 year ago

Adding vllm buildkite job for IBM Power (#16679)

Aaruni Aggarwal committed over 1 year ago

[V1][Spec Dec Bug Fix] Respect Spec Dec Method Specification (#16636)

Bryan Lu committed over 1 year ago

[V1][Performance] Implement custom serializaton for MultiModalKwargs [Rebased] (#16432)

Staszek Paśko committed over 1 year ago

Help user create custom model for Transformers backend remote code models (#16719)

Harry Mellor committed over 1 year ago

[Misc] Remove redundant comment (#16703)

Jade Zheng committed over 1 year ago

Improve error for structured output backend selection (#16717)

Harry Mellor committed over 1 year ago

[Hardware] Add processor inputs to platform validation (#16680)

Joe Runde committed over 1 year ago

[Model] support modernbert (#16648)

xsank committed over 1 year ago

[Bugfix][Kernel] fix potential cuda graph broken for merge_attn_states kernel (#16693)

DefTruth committed over 1 year ago

[Doc] Improve OOM troubleshooting (#16704)

Cyrus Leung committed over 1 year ago

[Misc] refactor examples series (#16708)

Reid committed over 1 year ago

[CI] Cleanup `additional_dependencies: [toml]` for pre-commit yapf hook (#16405)

Kay Yan committed over 1 year ago