[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532)

Lucas Wilkinson committed 11 months ago

[Bugfix] Fix CMakeLists Environment Variable (#21804)

吴坎 committed 11 months ago

[Bugfix] Schedule failure due to wrong get_image_size_with_most_features (#29692)

Jaehwang Jung committed 11 months ago

[CI/Build][AMD] Fix ref_dynamic_per_token_quant reference implementation on ROCm. (#30291)

rasmith committed 11 months ago

[Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729)

Ben Browning committed 11 months ago

[compile] Parse compile range cache keys as Range during cache loading. (#30516)

Zhengxu Chen committed 11 months ago

[ROCm][CI] Skip multi-GPU speculative decoding tests when insufficient GPUs available (#30527)

Andreas Karatzas committed 11 months ago

[CI/Build] Use spawn subprocess for ROCm (#30272)

Ryan Rock committed 11 months ago

[LMCache] Relax lmcache version requirement (#30425)

Nick Hill committed 11 months ago

[Bugfix][Model] Fix Afmoe rope_parameters issue (#30505)

Michael Goin committed 11 months ago

gptq marlin quantization support for fused moe with lora (#30254)

Bhanu Prakash Voutharoja committed 11 months ago

[CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481)

Fadi Arafeh committed 11 months ago

[Core] Refactor `_build_attention_metadata` (#29628)

Lucas Wilkinson committed 11 months ago

[ROCm][CI] Use mi325_4 agent pool for V1 e2e tests (#30526)

Andreas Karatzas committed 11 months ago

[CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require cutlass_pack_scale_fp8 (#30508)

rasmith committed 11 months ago

[fix] fix SM check for Flashinfer TRTLLM MOE (#30314)

jiahanc committed 11 months ago

[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm (#30417)

rasmith committed 11 months ago

[FIX]Patch run-cluster.sh (fix for #28328) (#30002)

Ev Lacey committed 11 months ago

[ROCM][CI] Fix AMD Examples Test Group (#30276)

Concurrensee committed 11 months ago

[EPLB] Support EPLB w/ NVFP4 (#29804)

Andrew Briand committed 11 months ago