[Bugfix] Fix OOM in tensorizer LoRA deserialization (#41845)

Or Ozeri committed 6 months ago

[ROCm] Profiler api support for ROCm MORI toy proxy server in PD Disaggregation (#40264)

tej committed 6 months ago

[CPU] Add FP8 W8A16 MoE support (#41314)

Yuwen Zhou committed 6 months ago

[Feat][CPU] Enable Gated DeltaNet Attention (Qwen 3.5 / 3.6) (#41025)

Fadi Arafeh committed 6 months ago

[ROCm] Enable SimpleCPUOffloadConnector on ROCm (#40549)

Hongxia Yang committed 6 months ago

[Docs] add cache directory security guidance (#38920)

Russell Bryant committed 6 months ago

[ROCm][CI] Remove `TORCH_NCCL_BLOCKING_WAIT=1` After Bugfix In ROCm 7.2 (#41840)

Micah Williamson committed 6 months ago

[Bugfix] Fix condition to clear persistent topk so that it can be captured regardless (#41665)

Yongye Zhu committed 6 months ago

[Bugfix] DeepSeekV32/v4: respect string='true|false' attribute andunwrap arguments/input wrapper (#41801)

Chauncey committed 6 months ago

Fix Qwen3 streaming content routing (#40820)

xy3 committed 6 months ago

[Doc] Add ModernBertForSequenceClassification to scoring.md cross-en… (#41832)

JackyLiu committed 6 months ago

[CI] Enable gemma4 parser test on CI (#41857)

Flora Feng committed 6 months ago

Upgrade tpu-inference to v0.19.0 (#41844)

Johnny Yang committed 6 months ago

[Bugfix] Align block table for TRTLLM MLA edge-case (#39324)

Benjamin Chislett committed 6 months ago

[Bugfix] Fix token loss in PP mode which causes degraded accuracy (#41133)

Jing Wang committed 6 months ago

[ROCm] aiter_unified_attn fp8 q scale refactor (#38296)

Divakar Verma committed 6 months ago

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

Viktor Pus committed 6 months ago

[Bugfix] Fix spawn_new_process_for_each_test silently swallowing test failures (#41423)

David Zheng committed 6 months ago

[Spec Decode] Add Gemma4 MTP speculative decoding support (#41745)

Luciano Martins committed 6 months ago

[KV Offload] Return None from lookup() for in-flight blocks (#41795)

Ronen Schaffer committed 6 months ago