Replace deprecated enable_fusion with fuse_norm_quant in test_rms_group_quant (#30817)

Michael Goin committed 11 months ago

[ROCm] [Bugfix] Fix torch sdpa hallucination (#30789)

TJian committed 11 months ago

[Perf][Kernels] Vectorize `csrc/activations_kernels.cu` (#29512)

Michael Goin committed 11 months ago

[CI] Skip ci failure test (#30804)

Wentao Ye committed 11 months ago

[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901)

Jinzhen Lin committed 11 months ago

[Bugfix][DSV32] Fix overflow in topk. (#30754)

Daniel Cámpora committed 11 months ago

[Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475)

Roger Wang committed 11 months ago

[Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627)

Lucas Wilkinson committed 11 months ago

[Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014)

jiahanc committed 11 months ago

[Refactor] Small refactor for group topk (#30562)

Wentao Ye committed 11 months ago

[Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769)

Nicolò Lucchesi committed 11 months ago

[CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723)

Michael Goin committed 11 months ago

[Docs][API] Remove warning about LoRARequest being internal-only (#30774)

Mark McLoughlin committed 11 months ago

Update where `bytes_to_unicode` is imported from (#30771)

Harry Mellor committed 11 months ago

Remove `head_mask` from Ultravox and Swin (#30764)

Harry Mellor committed 11 months ago

Fix instantiation of `HfHubHTTPError` in LoRA test (#30768)

Harry Mellor committed 11 months ago

[TRTLLM] Remove the MoE GEMM weight name change (#30713)

Ming Yang committed 11 months ago

[Feat] Enable eplb with default all2all backend (#30559)

Wentao Ye committed 11 months ago

[BugFix] Fix memory spike in workspace allocation (#30744)

Lucas Wilkinson committed 11 months ago

[CI/Build] Skip broken ViT backend functionality test tempoarily (#30782)

Isotr0py committed 11 months ago