A high-throughput and memory-efficient inference and serving engine for LLMs

main

[CPU] add CPU support for Voxtral (#53921)

LironKesem committed about 2 months ago

[CI/Build] Fix Kimi K3 Eagle3 test fixture (#54482)

Jee Jee Li committed about 2 months ago

[Frontend] Add video embeds input support (#54242)

Isotr0py committed about 2 months ago

[codeowners] Add jperezdealgaba to security file ownership (#54358)

Juan Pérez de Algaba committed about 2 months ago

[Bugfix] Validate scale-out transfer params (#54324)

Taneem Ibrahim committed about 2 months ago

[Doc] Fix griffe warnings in HYV4 tool parser (#54412)

Harry Mellor committed about 2 months ago

ci: add MIG slice size to H200 job labels (#54420)

Kevin H. Luu committed about 2 months ago

[Perf][ROCm] Dual-stream decode with hipgraphs (#52033)

Simon Danielsson committed about 2 months ago

← Newer Page 91 of 1120 Older →