[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007)

Ranran committed 8 months ago

[Bug][MoE] Strengthen _supports_current_device() checks in the TRTLLM FP8, NVFP4, and FlashInfer CuteDSL MoE experts (#36728)

yzong-rh committed 8 months ago

[Bug][MoE] Fix TRTLLM NVFP4 Routing Kernel Precision (#36725)

Robert Shaw committed 8 months ago

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799)

Kyle Sayers committed 8 months ago

[Async][Spec Decoding] Zero-bubble async scheduling + spec decoding (#32951)

Matthew Bonanni committed 8 months ago

[MRV2] Consider spec decoding in warmup (#37812)

Woosuk Kwon committed 8 months ago

[CI] split Entrypoints Integration (API Server 1) into 3 jobs (#37882)

Kunshang Ji committed 8 months ago

[CI][PD] Add Hybrid SSM integration tests to CI (#37657)

Nicolò Lucchesi committed 8 months ago

Use lazy graph module during split_module to defer recompile() (#37609)

Angela Yi committed 8 months ago

[Bugfix] Fix RoBERTa position_ids accumulation on CUDA graph padding (#37884)

Yufeng He committed 8 months ago

[Bugfix] RoBERTa position_id accumulation in CUDA graph padding region (#37873)

yanghui1-arch committed 8 months ago

[Mypy] Fix mypy for `vllm/config` (#37808)

Wentao Ye committed 8 months ago

[ROCm] fix sleep mode not releasing GPU memory problem on ROCm (#37533)

Zhaodong Bing committed 8 months ago

[Bugfix][LoRA] Fix incorrect LoRA Log (#37877)

Jee Jee Li committed 8 months ago

[Bugfix] Fix CPU backend crash in KV cache block zeroing (#37550)

DorBernsohn committed 8 months ago

[XPU][MoE Refactor] Refactor xpu mxfp4 support into oracle (#37784)

Kunshang Ji committed 8 months ago

[Frontend][Responses API] Fix arrival_time recording for TTFT on initial request (#37498)

Andrew Xia committed 8 months ago

[FP8]add FP8 WoQ kernel abstraction. (#32929)

Kunshang Ji committed 8 months ago

[Misc]Update gitignore (#37863)

wangxiyuan committed 8 months ago

[ROCm] Fix fused_moe_fake signature mismatch and other AITER bugs (#36100)

Chuan (Richard) Li committed 8 months ago