A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 04:45 UTC
[Misc] update cuda version (#19526)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
Jun 20, 2025 at 15:25 UTC
089a306f197dcc1152f2802ba1c56fbdeb86ac27
1 file changed
+2
-1
examples/others/lmcache/cpu_offload_lmcache.py
+2
-1
@@ -17,7 +17,8 @@ Usage:
17
(Without enable_chunked_prefill)
18
19
Note that `lmcache` is needed to run this example.
20
-Requirements: Linux, Python: 3.10 or higher, CUDA: 12.1
20
+Requirements:
21
+https://docs.lmcache.ai/getting_started/installation.html#prerequisites
22
Learn more about LMCache environment setup, please refer to:
23
https://docs.lmcache.ai/getting_started/installation.html
24
"""