@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 1475847a14
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 02:00 UTC

[Doc] Add instructions on using Podman when SELinux is active (#12136)

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>

Yuan Tang committed Jan 16, 2025 at 23:45 UTC 1475847a14e3693128fcc4f8740493d12074ed93
1 file changed +3
docs/source/deployment/docker.md
+3
@@ -42,6 +42,9 @@ DOCKER_BUILDKIT=1 docker build . --target vllm-openai --tag vllm/vllm-openai
42 By default vLLM will build for all GPU types for widest distribution. If you are just building for the
43 current GPU type the machine is running on, you can add the argument `--build-arg torch_cuda_arch_list=""`
44 for vLLM to find the current GPU type and build for that.
45 +
46 +If you are using Podman instead of Docker, you might need to disable SELinux labeling by
47 +adding `--security-opt label=disable` when running `podman build` command to avoid certain [existing issues](https://github.com/containers/buildah/discussions/4184).
48 ```
49
50 ## Building for Arm64/aarch64