A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 09:15 UTC
Initial commit
Woosuk Kwon committed
Feb 9, 2023 at 11:24 UTC
e7d9d9c08c79b386f6d0477e87b77a572390317d
1 file changed
+1
README.md
new
+1
@@ -0,0 +1 @@
1
+# CacheFlow