@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 9, 14:45 UTC

main

[CPU] Improve CPU Docker build (#30953)

Maryam Tahhan committed 10 months ago

[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950)

Lucas Wilkinson committed 10 months ago

Update CPU doc according to feedback (#32963)

Louie Tsai committed 10 months ago

← Newer Page 457 of 1120 Older →