[CI][BugFix][AMD][FP8] Fix test_rms_norm so it runs correctly on ROCm (#32372)

rasmith committed 10 months ago

[ROCM] Add ROCm image build to release pipeline (#31995)

Douglas Lehr committed 10 months ago

[Refactor] [11/N] to simplify the mcp architecture (#32396)

Chauncey committed 10 months ago

[Benchmark] [Feature] add vllm bench sweep startup command (#32337)

rongfu.leng committed 10 months ago

[2/N] Move cache factories to MM registry (#32382)

Cyrus Leung committed 10 months ago

[Model] Avoid token selection in SigLIP pooling head (#32389)

Cyrus Leung committed 10 months ago

fix: avoid crash on zero-arg tool calls in glm4 parser (#32321)

seeksky committed 10 months ago

[Bugfix] Strengthen the check of X-data-parallel-rank in Hybrid LB mode (#32314)

dtc committed 10 months ago

[Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369)

Chauncey committed 10 months ago

[ROCm][CI] Pin transformers 4.57.3 to fix jina test failures (#32350)

Andreas Karatzas committed 10 months ago

[Bugfix] Fix stale `common_attn_metadata.max_seq_len` in speculative decoding with Eagle (#32312)

Ofir Zafrir committed 10 months ago

[BugFix] Fix DeepSeek-V3.1 + DeepGEMM incompatible scale shapes (#32361)

Lucas Wilkinson committed 10 months ago

[code clean] remove duplicate check (#32376)

Ning Xie committed 10 months ago

[CI][AMD][Quantization][BugFix] Fix fp8 max in quant_utils.py and update test_fp8_quant.::test_static_fp8_quant_group_2d to use correct fp8 dtype and adjust atol/rtol (#32201)

rasmith committed 10 months ago

[ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355)

Micah Williamson committed 10 months ago

[Bugfix] Add CpuCommunicator.dispatch and combine to fix DP+MoE inference (#31867)

kzwrime committed 10 months ago

[Misc] Remove redundant line (#32366)

Li Wang committed 10 months ago

Support configure skip_special_tokens in openai response api (#32345)

Shiyan Deng committed 10 months ago

Fix optional parameter parsing in MiniMax M2 tool parser #32278 (#32342)

baonudesifeizhai committed 10 months ago

[CI/Build][Hardware][AMD] Fix v1/shutdown (#31997)

Ryan Rock committed 10 months ago