Install tpu_info==0.4.0 to fix core dump for TPU (#23135)

Xiang Xu committed about 1 year ago

Use Blackwell FlashInfer MXFP4 MoE by default if available (#23008)

Michael Goin committed about 1 year ago

fix: OpenAI SDK compat (ResponseTextConfig) (#23126)

Breno Baldas Skuk committed about 1 year ago

[CI Bugfix] Pin `openai<1.100` to unblock CI (#23118)

Michael Goin committed about 1 year ago

[Bugfix] Support compile for Transformers multimodal (#23095)

Raushan Turganbay committed about 1 year ago

chore: remove unnecessary patch_padding_side for the chatglm model (#23090)

杨朱 · Kiki committed about 1 year ago

[Refactor] Get prompt updates earlier (#23097)

Cyrus Leung committed about 1 year ago

[Bugfix] fix IntermediateTensors equal method (#23027)

Ning Xie committed about 1 year ago

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

Cyrus Leung committed about 1 year ago

[XPU][CI]add xpu env vars in CI scripts (#22946)

Kunshang Ji committed about 1 year ago

[XPU] Fix compile size for xpu (#23069)

Kunshang Ji committed about 1 year ago

[Misc] Fix backward compatibility from #23030 (#23070)

Roger Wang committed about 1 year ago

[Misc] refactor function name (#23029)

Ning Xie committed about 1 year ago

[Bugfix][CI] Machete kernels: deterministic ordering for more cache hits (#23055)

Andy Lo committed about 1 year ago

[Bugfix] fix Qwen2.5-Omni processor output mapping (#23058)

double7 committed about 1 year ago

[Misc] enhance static type hint (#23059)

Ning Xie committed about 1 year ago

[Misc] Minor code cleanup for _get_prompt_logprobs_dict (#23064)

Woosuk Kwon committed about 1 year ago

fix: gptq marlin weight loading failure (#23066)

Simon Mo committed about 1 year ago

[XPU] fix xpu to set cudagraph batch sizes (#23044)

Calvin Chen committed about 1 year ago

[Misc] Convert use_structured_output property into constant (#23060)

Woosuk Kwon committed about 1 year ago