[Attention][TurboQuant] Share dequant buffers, eliminate float16_copy (#40941)

Bhoomit committed 6 months ago

[Perf] FP8 FlashInfer Attn for ViT (#38065)

Zhanda Zhu committed 6 months ago

Cutlass W4A16 (Machete) Tests (#35450)

ojhaanshika committed 6 months ago

[Bugfix] Cap SWA/chunked-local runtime admission to startup pool-sizing bound (#40946)

Dao007forever committed 6 months ago

[Tests] Gate Isaac under Transformers v5 (#40907)

Silu Panda committed 6 months ago

[Model Runner V2] Fix rejection sampling acceptance rate gap vs MRV1 (#40651)

Giancarlo Delfin committed 6 months ago

Auto-disable expandable_segments around cumem memory pool (#40812)

youkaichao committed 6 months ago

[Feat] DeepSeek V4 Rebased (#40860)

Yifan Qiao committed 6 months ago

[torch.compile]: Disable Sequence Parallelism (SP) for piecewise compilation (#38373)

Xinan Miao committed 6 months ago

[KV Offload] Offload all KV blocks when doing prefill in P/D (#40346)

omerpaz95 committed 6 months ago

[Bugfix] Size FlashInfer NVLink MNNVL workspace to EP group (#40893)

Dao007forever committed 6 months ago

[LoRA] MoE LoRA Refactor (#40338)

Jee Jee Li committed 6 months ago

[Bugfix] Fix the DSML token leakage in DSV4/3.2 (#40806)

Chauncey committed 6 months ago

[Bugfix][MoE] Only unpad routed output before shared expert add or routed output transform (#40865)

Netanel Haber committed 6 months ago

[kv_offload+HMA][11/N]: Support store with multiple KV groups (#39403)

Or Ozeri committed 6 months ago

[CI][AMD]BugFix] Fix deadlock occuring in test_moe_layer (#40767)

rasmith committed 6 months ago

[Opt] Optimize deepstack buffer handling for multimodal Qwen3 models (#40145)

labAxiaoming committed 6 months ago

[ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503)

Andreas Karatzas committed 6 months ago

[Feature] Warm up readonly multimodal processor during renderer startup (#40797)

Chenguang Zheng committed 6 months ago

[ROCm][CI] Fix `trust_remote_code` AttributeError in EAGLE3 acceptance length test (#40306)

Andreas Karatzas committed 6 months ago