A high-throughput and memory-efficient inference and serving engine for LLMs

main

Include chat template fallbacks in package_data (#53762)

Tarun Kumar committed about 2 months ago

[CI] Shard CPU jobs above the 24h P90 threshold (#54751)

Kevin H. Luu committed about 2 months ago

[Model] Fix GLM-OCR MTP weight loading (#49869)

jackLei committed about 2 months ago

[CI][ROCm] Prefetch safetensors weights in AMD CI (#54898)

Andreas Karatzas committed about 2 months ago

[CI] Shard LoRA TP distributed tests (#52350)

Kevin H. Luu committed about 2 months ago

← Newer Page 82 of 1120 Older →