A high-throughput and memory-efficient inference and serving engine for LLMs

main

[Core] MRV2 support for fast-prefill (#56145)

Nick Hill committed about 1 month ago

[ROCm][Perf] Add bpreshuffled blockscaled fp8 GEMM (#51692)

Simon Danielsson committed about 1 month ago

[Docs]: quote variable-bearing wheel URLs (#56286)

Josiah Davis committed about 1 month ago

[Mypy] Fix typing for R/S models (#54157)

Taneem Ibrahim committed about 1 month ago

[Fast Start] Support fp4 (#55465)

siyu committed about 1 month ago

← Newer Page 64 of 1120 Older →