A high-throughput and memory-efficient inference and serving engine for LLMs

main

Add Humming indexed-MoE regression test (#50468)

Michael Goin committed 3 months ago

[compile] Fix fake kernel return dtype (#50444)

Richard Zou committed 3 months ago

[ROCm] Pass pointers to FlyDSL MoE kernels (#50378)

Andreas Karatzas committed 3 months ago

[CI] Initialize fused gated RMSNorm weights (#50377)

Andreas Karatzas committed 3 months ago

[Bugfix] Shut down private Tensorizer engines (#49840)

Andreas Karatzas committed 3 months ago

[Build] Fix CUDA release wheel builds (#50243)

Kevin H. Luu committed 3 months ago

[XPU][CI] skip kimi-k3 test (#50447)

Kunshang Ji committed 3 months ago

← Newer Page 153 of 1120 Older →