A high-throughput and memory-efficient inference and serving engine for LLMs

main

[Bugfix] Remove bad startup assertion (#50869)

Benjamin Chislett committed 3 months ago

[CI] Mooncake PD integration tests (#46844)

Nicolò Lucchesi committed 3 months ago

[Model] Add K-EXAONE-2.0-750B-A37B (#50524)

Kyungmin Lee committed 3 months ago

Support quantized DSpark Markov heads (#50424)

Andrii Skliar committed 3 months ago

[CI] KimiLinear PD in nightlies (#50266)

Nicolò Lucchesi committed 3 months ago

[CPU] Refine CPU kernel dispatch (#50801)

Li, Jiang committed 3 months ago

K3: Move LatentMoERunner (#50678)

Jee Jee Li committed 3 months ago

[INC] fix w4a4 model (#50807)

Qiming Zhang committed 3 months ago

← Newer Page 147 of 1120 Older →