[CPU][Bugfix] Using custom allreduce for CPU backend (#15934)

Li, Jiang committed over 1 year ago

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483)

Matthias Matt committed over 1 year ago

[Metrics] Hide deprecated metrics (#15458)

Mark McLoughlin committed over 1 year ago

[Bugfix] Fix the issue where the model name is empty string, causing no response with the model name. (#15938)

Chauncey committed over 1 year ago

[CI] Remove duplicate entrypoints-test (#15940)

Kay Yan committed over 1 year ago

[Bugfix][Benchmarks] Ensure `async_request_deepspeed_mii` uses the OpenAI choices key (#15926)

Brayden Zhong committed over 1 year ago

Add minimum version for `huggingface_hub` to enable Xet downloads (#15873)

Harry Mellor committed over 1 year ago

[V1] Fix json_object support with xgrammar (#15488)

Russell Bryant committed over 1 year ago

[core] Add tags parameter to wake_up() (#15500)

Eric Tang committed over 1 year ago

[Kernel] Add more dtype support for GGUF dequantization (#15879)

LukasBluebaum committed over 1 year ago

[Build/CI] Update lm-eval to 0.4.8 (#15912)

Chris Thi committed over 1 year ago

[Bugfix] Fix cache block size calculation for CPU MLA (#15848)

Thien Tran committed over 1 year ago

[CI/Build] Further clean up LoRA tests (#15920)

Jee Jee Li committed over 1 year ago

[Misc] Replace print with logger (#15923)

Chauncey committed over 1 year ago

[Benchmark]Fix error message (#15866)

Li Wang committed over 1 year ago

[V1][Bugfix] Fix typo in MoE TPU checking (#15927)

Roger Wang committed over 1 year ago

[Doc] Update rocm.inc.md (#15917)

chun committed over 1 year ago

[V1][Minor] Enhance SpecDecoding Metrics Log in V1 (#15902)

Woosuk Kwon committed over 1 year ago

[Bugfix] Fix imports for MoE on CPU (#15841)

Thien Tran committed over 1 year ago

[V1] Fix: make sure `k_index` is int64 for `apply_top_k_only` (#15907)

Brayden Zhong committed over 1 year ago