A high-throughput and memory-efficient inference and serving engine for LLMs

main

[Kimi-K3] Overlap low-M TP8 KDA projections (#54697)

Yongye Zhu committed about 2 months ago

[CI] Shard long kernel test groups (#54754)

Kevin H. Luu committed about 2 months ago

[CI] Split nightly MTP acceptance tests (#52353)

Kevin H. Luu committed about 2 months ago

[CI] Remove MRV2-specific tests (#54823)

Nick Hill committed about 2 months ago

[CI] Disable CUDA graphs for GLM PCP evals (#54745)

Kevin H. Luu committed about 2 months ago

← Newer Page 84 of 1120 Older →