A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 04:30 UTC
[Bugfix] torch nightly version in ROCm installation guide (#11423)
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
Yuan Tang committed
Dec 23, 2024 at 12:20 UTC
2e726680b386a06dfac1144853fd58964da3914f
1 file changed
+1
-1
docs/source/getting_started/amd-installation.rst
+1
-1
@@ -145,7 +145,7 @@ Note to get your gfx architecture, run `rocminfo |grep gfx`.
145
146
$ # Install PyTorch
147
$ pip uninstall torch -y
148
- $ pip install --no-cache-dir --pre torch==2.6.0.dev20240918 --index-url https://download.pytorch.org/whl/nightly/rocm6.2
148
+ $ pip install --no-cache-dir --pre torch==2.6.0.dev20241024 --index-url https://download.pytorch.org/whl/nightly/rocm6.2
149
150
$ # Build & install AMD SMI
151
$ pip install /opt/rocm/share/amd_smi