A high-throughput and memory-efficient inference and serving engine for LLMs

main

[XPU] bump up xpu kernel to v0.1.12.3 (#50441)

Kunshang Ji committed 3 months ago

[CI] Upgrade huggingface-hub to 1.27.0 (#51422)

Andreas Karatzas committed 3 months ago

Add tiering offloading metrics (#48798)

Srinivas Krovvidi committed 3 months ago

← Newer Page 133 of 1120 Older →