[Refactor] Simplify FutureWrapper in MultiprocExecutor (#38644)

yzong-rh committed 7 months ago

[Bugfix] Restrict TRTLLM attention to SM100, fixing GB300 (SM103) hang (#38730)

Stefano Castagnetta committed 7 months ago

Feature/silu block quant fusion v1 (#32996)

Monishver committed 7 months ago

[Compile] Fix nvfp4 compile warning (#38573)

Wentao Ye committed 7 months ago

[Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242)

Chauncey committed 7 months ago

[Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664)

Michael Goin committed 7 months ago

[NIXL][BUG] Fix Triton heterogeneous TP (#37940)

yzong-rh committed 7 months ago

Add ibm-granite/granite-vision-3.3-2b to supported models documentation (#38714)

Jesus Talavera committed 7 months ago

[Misc] Fix docstring typo: buildin -> builtin (#38722)

majianhan committed 7 months ago

Fix shape comment in extract_hidden_states example (#38723)

Fynn Schmitt-Ulms committed 7 months ago

[MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153)

bnellnm committed 7 months ago

[Bugfix] Revert "Zero-init MLA attention output buffers to prevent NaN from CUDA graph padding" (#38359)

Elvir Crnčević committed 7 months ago

[Bugfix] Fix Qwen3CoderToolParser anyOf/oneOf type resolution for nullable params (#37831)

손세정 committed 7 months ago

[KVTransfer] Fix TpKVTopology.is_kv_replicated equality case (#38179)

yjz committed 7 months ago

(security) Enforce frame limit in VideoMediaIO (#38636)

Juan Pérez de Algaba committed 7 months ago

Add `verified` label to trigger `pre-commit` (#38708)

Harry Mellor committed 7 months ago

[Perf] triton bilinear_pos_embed kernel for ViT (#37948)

Zhanda Zhu committed 7 months ago

[Core] Simplify multimodal masking (#34246)

Lukas Geiger committed 7 months ago

[CPU] Support head_size 512 in cpu_attn (#38676)

Li, Jiang committed 7 months ago

[Bugfix] Lazy import diskcache to avoid sqlite3/libstdc++ ImportError at startup (#38649)

Jeffrey Wang committed 7 months ago