A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 04:15 UTC
[Doc] minor fix of spelling in amd-installation.rst (#3506)
Jim Burtoft committed
Mar 19, 2024 at 16:32 UTC
63e8b28a990ef1584975c642b1ee5ae8a65b3183
1 file changed
+1
-1
docs/source/getting_started/amd-installation.rst
+1
-1
@@ -100,7 +100,7 @@ You can build and install vLLM from source:
100
101
Build a docker image from `Dockerfile.rocm`, and launch a docker container.
102
103
-The `Dokerfile.rocm` is designed to support both ROCm 5.7 and ROCm 6.0 and later versions. It provides flexibility to customize the build of docker image using the following arguments:
103
+The `Dockerfile.rocm` is designed to support both ROCm 5.7 and ROCm 6.0 and later versions. It provides flexibility to customize the build of docker image using the following arguments:
104
105
* `BASE_IMAGE`: specifies the base image used when running ``docker build``, specifically the PyTorch on ROCm base image. We have tested ROCm 5.7 and ROCm 6.0. The default is `rocm/pytorch:rocm6.0_ubuntu20.04_py3.9_pytorch_2.1.1`
106
* `FX_GFX_ARCHS`: specifies the GFX architecture that is used to build flash-attention, for example, `gfx90a;gfx942` for MI200 and MI300. The default is `gfx90a;gfx942`