A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 07:00 UTC
Bump to compressed-tensors v0.8.0 (#10279)
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Dipika Sikka committed
Nov 13, 2024 at 00:54 UTC
56a955e7748e497d8c24c79a76c75f3f982fab4a
1 file changed
+1
-1
requirements-common.txt
+1
-1
@@ -31,4 +31,4 @@ pyyaml
31
six>=1.16.0; python_version > '3.11' # transitive dependency of pandas that needs to be the latest version for python 3.12
32
setuptools>=74.1.1; python_version > '3.11' # Setuptools is used by triton, we need to ensure a modern version is installed for 3.12+ so that it does not try to import distutils, which was removed in 3.12
33
einops # Required for Qwen2-VL.
34
-compressed-tensors == 0.7.1 # required for compressed-tensors
34
+compressed-tensors == 0.8.0 # required for compressed-tensors
\ No newline at end of file