[Fix] Align fused moe lora_b shape with peft (#31534)

B-201 committed 10 months ago

Add docker buildx bake configuration (#31477)

Amr Mahdi committed 10 months ago

[Bugfix]Fix pooling model always disabled due to incorrect PP rank check (#31505)

vintipandey committed 11 months ago

[BugFix] add select_gemm_impl on CompressedTensorsWNA16MoEMethod to support LoRA (#31453)

JartX committed 11 months ago

[Model] Add support for openPangu moe model (#28775)

yt0428 committed 11 months ago

[CPU] Disable async schedule on CPU (#31525)

Li, Jiang committed 11 months ago

[CI][NIXL] Split DPEP tests (#31491)

Nicolò Lucchesi committed 11 months ago

[ROCm][Bugfix] Fix accuracy issue on fmoe when `VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS` enabled (#31523)

Pleaplusone committed 11 months ago

[Frontend] add continue_final_message parameter to /embeddings endpoint (#31497)

Kevin committed 11 months ago

[xpu] [bugfix] upgrade to latest oneccl in dockerfile (#31522)

Roger Feng committed 11 months ago

[Minor] Various small code cleanups/simplifications (#31508)

Nick Hill committed 11 months ago

Add Loraconfig parameter to get_punica_wrapper function (#31408)

ZT-AIA committed 11 months ago

Migrate meetups & sponsors [2/N] (#31500)

Roy Wang committed 11 months ago

feat(frontend): add --default-chat-template-kwargs CLI argument (#31343)

Hojin Yang committed 11 months ago

[Core] Deduplicate generate/encode logic in `AsyncLLM` (#31510)

Nick Hill committed 11 months ago

fix: update kimi k2 tool parser logic (#31207)

wangln19 committed 11 months ago

[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)

Sage committed 11 months ago

[CI]Test Group 'NixlConnector PD accuracy tests' is fixed (#31460)

qli88 committed 11 months ago

[CI/ROCm] Fixing "V1 Test attention (H100)" test group. (#31187)

Alexei-V-Ivanov-AMD committed 11 months ago

[Bugfix][ROCm] Fix Static Quant Issue (#31502)

Robert Shaw committed 11 months ago