@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 63e8b28a99
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

[Doc] minor fix of spelling in amd-installation.rst (#3506)

Jim Burtoft committed Mar 19, 2024 at 16:32 UTC 63e8b28a990ef1584975c642b1ee5ae8a65b3183
1 file changed +1 -1
docs/source/getting_started/amd-installation.rst
+1 -1
@@ -100,7 +100,7 @@ You can build and install vLLM from source:
100
101 Build a docker image from `Dockerfile.rocm`, and launch a docker container.
102
103 -The `Dokerfile.rocm` is designed to support both ROCm 5.7 and ROCm 6.0 and later versions. It provides flexibility to customize the build of docker image using the following arguments:
103 +The `Dockerfile.rocm` is designed to support both ROCm 5.7 and ROCm 6.0 and later versions. It provides flexibility to customize the build of docker image using the following arguments:
104
105 * `BASE_IMAGE`: specifies the base image used when running ``docker build``, specifically the PyTorch on ROCm base image. We have tested ROCm 5.7 and ROCm 6.0. The default is `rocm/pytorch:rocm6.0_ubuntu20.04_py3.9_pytorch_2.1.1`
106 * `FX_GFX_ARCHS`: specifies the GFX architecture that is used to build flash-attention, for example, `gfx90a;gfx942` for MI200 and MI300. The default is `gfx90a;gfx942`