[MoE] Migrate W4A8 CT to oracle kernel setup (#42680)

Siddharth Bedekar committed 5 months ago

[Docs] Fix stale version number in token_classify.md (#43489)

Holegots committed 5 months ago

[Docs] Fix stale version number in token_embed.md (#43488)

Holegots committed 5 months ago

[MM] Enable FlashInfer metadata support for Qwen2.5-VL vision attention (#42787)

Hua Huang committed 5 months ago

[Bugfix][Frontend] Fix input_audio parsing when uuid is present (#43414)

ffggs committed 5 months ago

[ROCm][CI] Remove benchmarks test group and shard long test groups (#41669)

Andreas Karatzas committed 5 months ago

[Kernel] Batch invariant NVFP4 linear using cutlass (#39912)

Jakub Zakrzewski committed 5 months ago

fix(eagle3): read norm_before_fc from eagle_config for NVIDIA checkpoint (#42143)

GuangYaoZheng committed 5 months ago

Keep scheduler alive for delayed KV connector frees (#43433)

Gabriel Wu committed 5 months ago

[ModelOpt] Support Qwen3.5/3.6 VLM quantized prefix mapping (#42546)

Wei-Ming Chen committed 5 months ago

[Bugfix] Fix native Triton top-k/top-p kernel assumes contiguous logi… (#42739)

Xiaogang Zhou committed 5 months ago

[Misc] Added missing return type annotations to improve mypy and IDE tooling (#43383)

Taneem Ibrahim committed 5 months ago

[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued) (#43209)

Chris Leonard committed 5 months ago

[XPU] reudce host overhead of XPU MOE (#42915)

Qiming Zhang committed 5 months ago

[XPU]feat: enable FP8 block-scaled quantization on XPU (#42952)

Ma Jian committed 5 months ago

[ROCm][CI] Fix ROCm LoRA Transformers fallback with full CUDA graphs (#41577)

Andreas Karatzas committed 5 months ago

[Bugfix] Auto-raise max_num_batched_tokens for prefix-LM multimodal models (#43051)

Ashwin Giridharan committed 5 months ago

[ROCm][CI] Stabilize Granite tool-use and test URL construction (#43017)

Andreas Karatzas committed 5 months ago

[ROCm][CI] Stabilize runner teardown between sampler tests (#43023)

Andreas Karatzas committed 5 months ago

[DSV4] More multi-stream enablement for c4a (#42925)

Yongye Zhu committed 5 months ago