[Bugfix] correct h matrix layout in chunk_kda output kernel (#40956)

Chenxi Qian committed 6 months ago

Fix Gemma4 MoE expert weight remapping (#41206)

Baekpica committed 6 months ago

Fix Cohere ASR after HF upgrade (#40582)

Ekagra Ranjan committed 6 months ago

[Frontend] Add VLLM_SKIP_MODEL_NAME_VALIDATION environment variable (#34676)

Dhruv Singal committed 6 months ago

[Bugfix] Fix persistent_topk cooperative deadlock at TopK=1024 (#41189)

Yongye Zhu committed 6 months ago

[Refactor][kv_offload] KV Offloading maintainability improvements (#40538)

Martin Hickey committed 6 months ago

[Bugfix] Fix failure to allocate KV blocks error (#41282)

Wei Zhao committed 6 months ago

[CI] Add key field to all test_areas pipeline steps (#41201)

Kevin H. Luu committed 6 months ago

[ROCm][Bugfix][GPTOSS]: fix input_ids and expert_map args for quark w4a8 gptoss (#41165)

Rohan Potdar committed 6 months ago

[Ci][BugFix] Fix slow DP tests due to bad teardown logic (#41166)

Nick Hill committed 6 months ago

[DSv4] Use `cvt` PTX for FP32->FP4 conversion (#41015)

Thien Tran committed 6 months ago

[Bugfix][MLA] Size arange_buffer to max_num_batched_tokens to prevent CUDA IMA (#39277)

Uranus committed 6 months ago

[ROCm] Add env flags to disable dynamic MXFP4 quant and enable AITER tuned GEMMs for Attention Projection Layers (#39987)

Hemanth Acharya committed 6 months ago

[Bugfix][Compile] Fix gc.collect/empty_cache patch arity in CUDAGraphWrapper (#41235)

roikoren755 committed 6 months ago

Create tests/distributed/test_mnnvl_alltoall.py (#35241)

Rishi Puri committed 6 months ago

[BUG] Two phase pause to prevent deadlock (#39366)

Aaron Hao committed 6 months ago

[ROCm][Bugfix]: W4A4 MOE using emulation instead of AITER on MXFP4-supported hardware (#41175)

Rohan Potdar committed 6 months ago

[Perf][Spec Decode] Avoid per-step numpy allocation in prepare_next_t… (#41043)

Luochao Wang committed 6 months ago

[Multimodal][Render] Skip mm processor initialization and warmup for text-only mode (#41246)

Isotr0py committed 6 months ago

[CI] Add temperature to bfcl eval, default greedy (#41059)

yzong-rh committed 6 months ago