[Bugfix]Reject invalid FlashInfer MNNVL workspaces (#49043)

rongfu.leng committed 3 months ago

Improve Transformers modelling backend `fx` tracer (#49957)

Harry Mellor committed 3 months ago

[KV Offloading] Per-request tier filtering with TierFilter/TierMatcher (#48123)

Ronen Schaffer committed 3 months ago

[ROCm] Use backend-default dot precision for ReplaySSM (#49909)

Andreas Karatzas committed 3 months ago

[ROCm] [Model] Enable TML inkling (#48841)

TJian committed 3 months ago

[ROCm][CI] Skip three torchao tests of gfx950 until `torchao==0.18` is released (#49732)

fxmarty committed 3 months ago

[CI][ROCm] Make hf-xet reconstruction safe on shared NFS (#49837)

Andreas Karatzas committed 3 months ago

[Bugfix][ROCm] Use batch DMA for CPU KV cache loads (#49843)

Andreas Karatzas committed 3 months ago

[communication] [bugfix] fix quickreduce acc error in cudagraph mode (#46913)

haoyangli0109 committed 3 months ago

[Bugfix][CPU] Zero-pad MoE intermediate size for grouped-gemm TP alignment (#49591)

Li, Jiang committed 3 months ago

[Tokenizer] Use HF config for HF tokenizers (#49907)

Andreas Karatzas committed 3 months ago

[XPU][CI] Use platform device in InputBatch V2 test (#49939)

liuzhenwei committed 3 months ago

[Bugfix] Normalize sparse MLA warmup compression ratios (#49392)

Xiaochang Wu committed 3 months ago

[Rust Frontend] Keep `--max-model-len` engine-owned (#49944)

Bugen Zhao committed 3 months ago

[CI][ROCm] Reduce kernel test runtime (#49915)

Andreas Karatzas committed 3 months ago

[Quantization][INC]Add MXFP8 Linear Support (#47514)

Zhenzhong Xu committed 3 months ago

[3/N][Core][KV Connector] Support reliable partial-tail KV offload for sub-block prompts (#49502)

Dao007forever committed 3 months ago

[CPU][Spec Decode] Optimize GDN conv path for speculative decoding (#48577)

Tianmu Li committed 3 months ago

[CPU][Perf] INT8 Fused MoE Kernel for Arm CPUs (#48637)

Fadi Arafeh committed 3 months ago

[Hardware][Power] Add FAST_EXP for Power (#49571)

Akash kaothalkar committed 3 months ago