A high-throughput and memory-efficient inference and serving engine for LLMs

main

[Bugfix] Retain vocab embeddings during replacement (#55083)

Taneem Ibrahim committed about 2 months ago

[Kernel] Warm up Qwen GDN gated RMSNorm (#54251)

Zupeng Wang committed about 2 months ago

[CI][AMD] Avoid expandable segments in LoRA TP tests (#55094)

Andreas Karatzas committed about 2 months ago

[CI] Bump Transformers version to 5.16.1 (#53905)

Harry Mellor committed about 2 months ago

[ROCm][CI] Add MiniMax reduce RMS kernel coverage (#55057)

Andreas Karatzas committed about 2 months ago

[Model] Add K2-Horizon model support (#55063)

Bowen Tan committed about 2 months ago

[Bugfix] Wait for offload keys before storing chunks (#52923)

chuanzhisongshu committed about 2 months ago

[CI] Fix DeepSeek-V4 registry platform guard (#55042)

Taneem Ibrahim committed about 2 months ago

[CI] Force HTTP/1.1 for runtime Git installs (#55044)

Kevin H. Luu committed about 2 months ago

[Skills] Add kernel benchmark sanity references (#54995)

Woosuk Kwon committed about 2 months ago

← Newer Page 80 of 1120 Older →