[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130)

Yang Fan committed over 1 year ago

[release] Publish neuron docker image (#16733)

omrishiv committed over 1 year ago

[Doc] Updated Llama section in tool calling docs to have llama 3.2 config info (#16857)

Justin Ho committed over 1 year ago

[Misc] refactor examples series - Chat Completion Client With Tools (#16829)

Reid committed over 1 year ago

[New Model]: Snowflake Arctic Embed (Family) (#16649)

wang.yuqi committed over 1 year ago

Fix `nullable_kvs` fallback (#16837)

Harry Mellor committed over 1 year ago

[Misc] Clean up Kimi-VL (#16833)

Cyrus Leung committed over 1 year ago

[Model] use AutoWeightsLoader for BigCode, GPT-J (#16823)

Jonghyun Choe committed over 1 year ago

[Docs] Fix a link and grammar issue in production-stack.md (#16809)

Michael Yao committed over 1 year ago

[Doc] add podman setup instructions for official image (#16796)

Nathan Weinberg committed over 1 year ago

[Bugfix] fix pp for llama4 (#16746)

Lucia Fang committed over 1 year ago

[ROCm] [Attention] Cleanup ROCm output passing (#16431)

Luka Govedič committed over 1 year ago

[Misc] add collect_env to cli and docker image (#16759)

rongfu.leng committed over 1 year ago

Improve-mm-and-pooler-and-decoding-configs (#16789)

Harry Mellor committed over 1 year ago

[BugFix] Accuracy fix for llama4 int4 - improperly casted scales (#16801)

Lucas Wilkinson committed over 1 year ago

Add hardware print to TPU V1 test (#16792)

Michael Goin committed over 1 year ago

[V1][Structured Output] Minor modification to `_validate_structured_output()` (#16748)

Shanshan Shen committed over 1 year ago

[Misc] Update outdated note: LMCache now supports chunked prefill (#16697)

Chauncey committed over 1 year ago

[Doc] Improve help examples for `--compilation-config` (#16729)

Cyrus Leung committed over 1 year ago

Add property-based testing for vLLM endpoints using an API defined by an OpenAPI 3.1 schema (#16721)

Tarun Kumar committed over 1 year ago