A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 04:30 UTC
[ci/build] Fix AMD CI dependencies (#11087)
Kevin H. Luu committed
Dec 11, 2024 at 00:39 UTC
3fb4b4f1634a896653acc12c72b8e5d6d87a8f82
1 file changed
+2
-1
requirements-rocm.txt
+2
-1
@@ -5,7 +5,8 @@
5
awscli
6
boto3
7
botocore
8
+datasets
9
ray >= 2.10.0
10
peft
11
pytest-asyncio
11
-tensorizer>=2.9.0
\ No newline at end of file
12
+tensorizer>=2.9.0