A high-throughput and memory-efficient inference and serving engine for LLMs

main

[Pooling] Report LoRA adapter names in responses (#56004)

Taneem Ibrahim committed about 1 month ago

Fix ROCm AITER FP8 KV test tolerances. (#53590)

Aarushi Jain committed about 1 month ago

[ROCm] Bump AITER to v0.1.21.post2 (#55968)

Micah Williamson committed about 1 month ago

[Refactor][kv_offload]: rename `block`→`chunk` (#52615)

Ronen Schaffer committed about 1 month ago

[CI] Add e2e test for scale-out EC connector flow (#54973)

Nicolò Lucchesi committed about 1 month ago

← Newer Page 67 of 1120 Older →