A high-throughput and memory-efficient inference and serving engine for LLMs

main

[CI] Shard entrypoints API-server tests (#52344)

Kevin H. Luu committed about 2 months ago

[CI] Shard H100 MoE refactor integration tests (#52352)

Kevin H. Luu committed about 2 months ago

[Frontend] Gate scale-out endpoints behind opt-in flag (#54579)

Francisco Javier Arceo committed about 2 months ago

[XPU][UT] skip fp8_per_channel test on XPU (#54861)

Qiming Zhang committed about 2 months ago

[CI] Shard basic model initialization tests (#54753)

Kevin H. Luu committed about 2 months ago

← Newer Page 83 of 1120 Older →