[ROCm][CI] Fix language generation test accuracy by disabling HF flash_sdp and mem_efficient_sdp (#31597)

Andreas Karatzas committed 10 months ago

[CI] Skip Phi-MoE test due to old API util (#31632)

Andreas Karatzas committed 10 months ago

[BugFix] Async scheduling: handle model forward errors more cleanly (#31611)

Nick Hill committed 10 months ago

[misc] Sort uvicorn log level description according to verbosity (#31137)

Ning Xie committed 10 months ago

fix no think of GLM-4.5 / GLM-4.7 (#31449)

Yuxuan Zhang committed 10 months ago

[Docs] Fix argparse include path for mm-processor benchmark (#31654)

Reagan Lee committed 10 months ago

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533)

Robert Shaw committed 10 months ago

[CI][Bugfix] Fix token counting in chunked prefill compl test (#31630)

Andreas Karatzas committed 10 months ago

Improve HF qwen3_omni: preserve audio_sample_rate in kwargs restructuring (#29255)

jeremyteboul committed 10 months ago

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

Xingyu Liu committed 10 months ago

[Benchmark] Fix OOM during MoE kernel tuning for large models (#31604)

Alfred committed 10 months ago

[MoE Refactor] Explicit construct mk for flashinfer bf16 kernel (#31504)

Yongye Zhu committed 10 months ago

[MoE Refactor] Split `invoke_fused_moe_kernel` (#31050)

Yongye Zhu committed 10 months ago

[MoE] Fix output_shape calculation in Attention layer to handle 3D query inputs (#31596)

Andreas Karatzas committed 10 months ago

[BugFix] Support online dense model DP without overhead (#30739)

Nick Hill committed 10 months ago

CustomOp: test forward dispatch for grouped_topk (#31530)

Xinyu Chen committed 10 months ago

Add multimodal input method in the documentation (#31601)

labAxiaoming committed 10 months ago

[Bugfix] Fix weight_loader v1 block scale (#31103)

Kyuyeun Kim committed 10 months ago

[Bugfix][Hardware][AMD] Fix last_page_len calculation in AITER MLA decode (#31282)

Kevin McKay committed 10 months ago

Remove unused `use_marlin` variable in `Mxfp4MoEMethod` (#31549)

Vaibhav Sourirajan committed 10 months ago