[V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148)

Shanshan Shen committed over 1 year ago

[VLM] Florence-2 supports online serving (#16164)

Isotr0py committed over 1 year ago

doc: fix some typos in doc (#16154)

yihong committed over 1 year ago

[CI] Set max transformers version for Ultravox model test (#16149)

Roger Wang committed over 1 year ago

[Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129)

Isotr0py committed over 1 year ago

[Misc] Update Mistral-3.1 example (#16147)

Cyrus Leung committed over 1 year ago

[V1][Minor] Minor simplification for get_computed_blocks (#16139)

Woosuk Kwon committed over 1 year ago

[Metrics] Add bucket for `request_latency`, `time_to_first_token` and `time_per_output_token` (#15202)

Kay Yan committed over 1 year ago

Fix requires-python (#16132)

Martin Hoyer committed over 1 year ago

[V1][Minor] Optimize get_cached_block (#16135)

Woosuk Kwon committed over 1 year ago

[TPU] Update PyTorch/XLA (#16130)

Chengji Yao committed over 1 year ago

[Misc] update requires-python in pyproject.toml (#16116)

Reid committed over 1 year ago

[Bugfix] add hf_token to EngineArgs (#16093)

paolovic committed over 1 year ago

[Bugfix] LoRA : Fix the order in which the kernels process LoRAs (#16040)

Varun Sundar Rabindranath committed over 1 year ago

[Model] use AutoWeightsLoader for stablelm,starcoder2,zamba2 (#16103)

rongfu.leng committed over 1 year ago

[Misc] Improve model redirect to accept json dictionary (#16119)

Isotr0py committed over 1 year ago

[Doc][Bugfix] Add missing EOF in k8s deploy doc (#16025)

Paul Schweigert committed over 1 year ago

[Misc] refactor example eagle (#16100)

Reid committed over 1 year ago

[CI][V1] Fix passing `tokenizer` as kwarg to `validate_guidance_grammar` (#16117)

Roger Wang committed over 1 year ago

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

Ben Jackson committed over 1 year ago