[Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772)

Nicolò Lucchesi committed 11 months ago

[ROCm][MTP] Support MTP for AITER MLA backend (#28624)

Pleaplusone committed 11 months ago

update piecewise cudagraph warning when splitting_ops=[] (#30728)

Boyuan Feng committed 11 months ago

[ROCm] [AITER] [DOC] Add usage description about check functions in `_aiter_ops` (#30586)

TJian committed 11 months ago

Don'e assume `position_embedding_type` will be present for BERT and RoBERTa models (#30770)

Harry Mellor committed 11 months ago

[Bugfix] Fix prefix_repetition routing in bench throughput (#29663)

Junru Shen committed 11 months ago

[Bugfix] Fix RequestOutput miss lora_request (#30636)

Jee Jee Li committed 11 months ago

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

Andrew Xia committed 11 months ago

[Bugfix] Fix broken ViT attention selection for Blackwell device (#30731)

Isotr0py committed 11 months ago

[feature] extend DBO to XBO (#30120)

jiangkuaixue123 committed 11 months ago

improve lazy import test (#30733)

Boyuan Feng committed 11 months ago

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873)

Shanshan Shen committed 11 months ago

[docker] Restructure Dockerfile for more efficient and cache-friendly builds (#30626)

Amr Mahdi committed 11 months ago

[Bugfix] fix streaming final output for non harmony (#30237)

penfree committed 11 months ago

[BUILD] use sm_100f when compiling flashmla to fix support on sm103 (#30705)

Shengqi Chen committed 11 months ago

[UX][Attention] Add `attention_config` argument to `LLM()` (#30710)

Matthew Bonanni committed 11 months ago

[Benchmarks] `auto_tune.sh`: Use hostname variable for server requests (#30529)

Kevin Musgrave committed 11 months ago

Update batch invariant to use attention config (#30704)

Matthew Bonanni committed 11 months ago

[Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708)

Michael Goin committed 11 months ago

[docs][fix] Update Arm CPU vLLM wheel installation docs (#30594)

Fadi Arafeh committed 11 months ago