A high-throughput and memory-efficient inference and serving engine for LLMs

main

[BugFxi] Fix DeepGEMM FP8 workspace over allocation (#53914)

Lucas Wilkinson committed about 1 month ago

Fix Laguna patch mutating flat RoPE parameters (#57189)

Laura Lopez-Real committed about 1 month ago

[Compile] Fix compile warning #177-D (#56609)

Wentao Ye committed about 1 month ago

[Perf][EPD] Batch image requests per encoder (#57095)

Tianyu Guo committed about 1 month ago

← Newer Page 44 of 1120 Older →