A high-throughput and memory-efficient inference and serving engine for LLMs

main

Bump flashinfer version to 0.6.13 (#46683)

Wei Zhao committed 4 months ago

[FS-Offloading] Batch Lookup in C (#46713)

Varun Sundar Rabindranath committed 4 months ago

[Kernel] Triton MLA logits workspace (#46819)

Nicolò Lucchesi committed 4 months ago

[mypy] Enable mypy for tests directory (#47018)

Martin Hickey committed 4 months ago

← Newer Page 211 of 1120 Older →