A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 02:00 UTC
[Hardware][Gaudi][BugFix] Fix dataclass error due to triton package update (#12338)
Signed-off-by: zhenwei <zhenweiliu@habana.ai>
liuzhenwei committed
Jan 23, 2025 at 16:35 UTC
8ae5ff20093f74671bcdf2c9d4e078839c7a7732
1 file changed
+1
-1
requirements-hpu.txt
+1
-1
@@ -3,7 +3,7 @@
3
4
# Dependencies for HPU code
5
ray
6
-triton
6
+triton==3.1.0
7
pandas
8
tabulate
9
setuptools>=61