@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / e7d9d9c08c
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 09:15 UTC

Initial commit

Woosuk Kwon committed Feb 9, 2023 at 11:24 UTC e7d9d9c08c79b386f6d0477e87b77a572390317d
1 file changed +1
README.md new
+1
@@ -0,0 +1 @@
1 +# CacheFlow