A high-throughput and memory-efficient inference and serving engine for LLMs

main

[CI] Reuse loaded config for cached tokenizer (#49509)

Andreas Karatzas committed 3 months ago

Add `sm_107` for Rubin (#49387)

Tyler Michael Smith committed 3 months ago

[CI][AMD] Deprecate DinD for MI355 tests (#49257)

Andreas Karatzas committed 3 months ago

Encoder cache extension hooks (#48218)

hotTea committed 3 months ago

Remove Quantization test parallelism (#49693)

Kevin H. Luu committed 3 months ago

Bump Transformers version to 5.14.1 (#49223)

Harry Mellor committed 3 months ago

[CI] Use explicit devices in IR tests (#49513)

Andreas Karatzas committed 3 months ago

← Newer Page 167 of 1120 Older →