[Misc] add `use_tqdm_on_load` to reduce logs (#14407)

Aaron Pham committed over 1 year ago

[VLM] Add TP support for Phi-4-MM (#14453)

Isotr0py committed over 1 year ago

[V1] TPU - Add tensor parallel support via Ray (#13618)

Alexander Matveev committed over 1 year ago

[CI/Build] Use a fixed seed to avoid flaky tests (#14480)

Cyrus Leung committed over 1 year ago

Add RLHF document (#14482)

Harry Mellor committed over 1 year ago

[Build/BugFix] Fix hopper 12.8 build (#14354)

Lucas Wilkinson committed over 1 year ago

Add training doc signposting to TRL (#14439)

Harry Mellor committed over 1 year ago

[Bugfix] Make the deviceprofiler include LoRA memory. (#14469)

Jee Jee Li committed over 1 year ago

[Doc] Added QwQ-32B to the supported models list in the reasoning out… (#14479)

Robin committed over 1 year ago

[Doc]add doc for Qwen models tool calling (#14478)

Robin committed over 1 year ago

Default to `generation_config` from model (#12622)

Harry Mellor committed over 1 year ago

[CI/Build] refactor: set timezone of container to UTC (#12888)

Roger Meier committed over 1 year ago

[core] add `extra_args` to `SamplingParams` (#13300)

Aviv Keshet committed over 1 year ago

[MISC][V1] Register process killing handler only in the main thread (#14380)

Cody Yu committed over 1 year ago

[Bugfix][Disaggregated] Add a check in send_kv_caches_and_hidden_states and fix the reshape of the KVCache (#14369)

Mathis Felardos committed over 1 year ago

Revert "[Perf] Reduce MLA CPU overheads in V1 (#14384)" (#14471)

Tyler Michael Smith committed over 1 year ago

[Bugfix][V1] Handle MLA in kv_cache_interface (#14462)

Tyler Michael Smith committed over 1 year ago

[V1] Prompt logprobs + APC compatibility; prompt logprobs reqs cannot fill APC (#13949)

afeldman-nm committed over 1 year ago

[Bugfix] Fix torch_xla which can't handle None seed introduced in #14274 (#14459)

yarongmu-google committed over 1 year ago

[V1][Metrics] Fix traceback with preemptions+LoRA (#14220)

Mark McLoughlin committed over 1 year ago