main
md 22 lines 898 Bytes
Rendered Raw
1 # Installation
2
3 vLLM supports the following hardware platforms:
4
5 - [GPU](gpu.md)
6 - [NVIDIA CUDA](gpu.md)
7 - [AMD ROCm](gpu.md)
8 - [Intel XPU](gpu.md)
9 - [Apple Silicon](gpu.md) (via [vLLM-Metal](https://github.com/vllm-project/vllm-metal))
10 - [CPU](cpu.md)
11 - [Intel/AMD x86](cpu.md#intelamd-x86)
12 - [ARM AArch64](cpu.md#arm-aarch64)
13 - [Apple silicon](cpu.md#apple-silicon)
14 - [IBM Z (S390X)](cpu.md#ibm-z-s390x)
15
16 ## Hardware Plugins
17
18 vLLM supports third-party hardware plugins that live **outside** the main `vllm` repository. These follow the [Hardware-Pluggable RFC](../../design/plugin_system.md).
19
20 A list of all supported hardware can be found on the vLLM website, see [Universal Compatibility - Hardware](https://vllm.ai/#compatibility).
21
22 If you want to add new hardware, please contact us on [Slack](https://slack.vllm.ai/) or [Email](mailto:collaboration@vllm.ai).