[compile] Disable dynamo guards check for AOT compilation. (#27288)

Zhengxu Chen committed about 1 year ago

[Hybrid] Add mamba_block_size to Engine Args (#27289)

Asaf Joseph Gardin committed about 1 year ago

[compile] Add enable_prompt_embeds to compile hash. (#27285)

Zhengxu Chen committed about 1 year ago

[Bug] Fix shape issue for eplb expert weights (#27589)

Wentao Ye committed about 1 year ago

[Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588)

Cyrus Leung committed about 1 year ago

[Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431)

Matthew Bonanni committed about 1 year ago

[V0 Deprecation] Remove vestigial V0 logits_processors.py file (#27601)

Nick Hill committed about 1 year ago

Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565)

wangln19 committed about 1 year ago

[CI/Build] Fix amd model executor test (#27612)

Zhewen Li committed about 1 year ago

[Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618)

Jialin Ouyang committed about 1 year ago

[Bugfix][CPU] Fallback oneDNN linear to torch linear to fix half gemm support on legecy platforms (#27526)

Li, Jiang committed about 1 year ago

[Hardware][AMD][Model] Triton MoE tuning configs for GLM-4.6 for MI300X (#27323)

Eric Yue committed about 1 year ago

[ROCm] [Doc] Update ROCm installation docs (#27327)

vllmellm committed about 1 year ago

[Bugfix] fixed inconsistent finish_reason handling between V0 and V1 engines (#27555)

Chauncey committed about 1 year ago

[Stability fix] turn off HMA allocator when connector is set (#27592)

Kuntai Du committed about 1 year ago

[Bugfix][CI] Fix config resolving logic with remote models (#27610)

Roger Wang committed about 1 year ago

[gpt-oss][2/N] Support input_messages in responsesRequest (#26962)

Andrew Xia committed about 1 year ago

Code quality improvements: version update, type annotation enhancement, and enum usage simplification (#27581)

usberkeley committed about 1 year ago

[ROCm] Update AITER branch for ROCm base docker (#27586)

Micah Williamson committed about 1 year ago

[Misc] Clean up more utils (#27567)

Cyrus Leung committed about 1 year ago