[Misc] Cleanup more configs and processors (#37560)

Cyrus Leung committed 8 months ago

[Bug] Fix fp8 trtllm MoE modular kernel supported routing methods (#37346)

Wei Zhao committed 8 months ago

[MRV2] Use fp32 for draft logits (#37526)

Woosuk Kwon committed 8 months ago

[1/n] Migrate permute_cols to libtorch stable ABI (#31509)

mikaylagawarecki committed 8 months ago

Remove deprecated reasoning_content message field(part-2) (#37480)

Ifta khairul Alam Adil committed 8 months ago

[LoRA] Minor improvements to LoRA log (#37557)

Jee Jee Li committed 8 months ago

Cap the number of API servers to 1 when using Elastic EP. (#37466)

Sage Moore committed 8 months ago

Stop bench CLI from recursively casting all configs to `dict` (#37559)

Harry Mellor committed 8 months ago

[Misc] Clean up processing logic (#37541)

Cyrus Leung committed 8 months ago

[Bugfix] Add Kimi-K2.5 reasoning/tool parser aliases and tool_call_id support (#37438)

DorBernsohn committed 8 months ago

[CI] Merge `cleanup_pr_body.yml` and `reminder_comment.yml` (#37552)

Harry Mellor committed 8 months ago

Fix KV Offloading + MLA AssertionError by using num_kv_heads=1 in cpu… (#37536)

XueLiang Yang committed 8 months ago

[Model] Remove unnecessary `get_language_model` (#37545)

Cyrus Leung committed 8 months ago

[CI/Build] Split out MM pooling tests (#37542)

Cyrus Leung committed 8 months ago

[Docs] Reorganize pooling docs. (#35592)

wang.yuqi committed 8 months ago

Don't log `exc_info` when vLLM tries to doenload a file that doesn't exist (#37458)

Harry Mellor committed 8 months ago

[Bugfix] Avoid more OpenMP thread reallocation in CPU torch compile (#37538)

Li, Jiang committed 8 months ago

[Bugfix] Fix Nemotron Parse loading (#37407)

Cyrus Leung committed 8 months ago

[Bugfix][ROCm] Fix MoRI + AITER FP8 dispatch compatibility for defer_input_quant (#37418)

Duyi-Wang committed 8 months ago

fix(cpu): add null check for aligned_alloc in ScratchPadManager (#37369)

yassha committed 8 months ago