@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 2e726680b3
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

[Bugfix] torch nightly version in ROCm installation guide (#11423)

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>

Yuan Tang committed Dec 23, 2024 at 12:20 UTC 2e726680b386a06dfac1144853fd58964da3914f
1 file changed +1 -1
docs/source/getting_started/amd-installation.rst
+1 -1
@@ -145,7 +145,7 @@ Note to get your gfx architecture, run `rocminfo |grep gfx`.
145
146 $ # Install PyTorch
147 $ pip uninstall torch -y
148 - $ pip install --no-cache-dir --pre torch==2.6.0.dev20240918 --index-url https://download.pytorch.org/whl/nightly/rocm6.2
148 + $ pip install --no-cache-dir --pre torch==2.6.0.dev20241024 --index-url https://download.pytorch.org/whl/nightly/rocm6.2
149
150 $ # Build & install AMD SMI
151 $ pip install /opt/rocm/share/amd_smi