A high-throughput and memory-efficient inference and serving engine for LLMs

main

[ROCm][CI] Add ROCm misc ops and env tests (#53279)

Divakar Verma committed about 2 months ago

[CI] Speed up quantization test group (#53291)

fxmarty-amd committed about 2 months ago

[Perf][Kernel] Initialize NVFP4 padding in quant kernel (#53568)

Roberto L. Castro committed about 2 months ago

[Bugfix] Support Sentence Transformers 5.4+ serialized configs (#54533)

Eli Nabro Yeongmin Oh committed about 2 months ago

← Newer Page 85 of 1120 Older →