A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 13, 17:00 UTC
[Doc] Add Arm CPUs are on the list of supported targets in vLLM (#26018)
Signed-off-by: Milos Puzovic <milos.puzovic@arm.com>
Milos Puzovic committed
Nov 6, 2025 at 15:30 UTC
2176778cd384ca930ebcf5c0630f7bbefe4a9aad
1 file changed
+1
-1
docs/README.md
+1
-1
@@ -56,7 +56,7 @@ vLLM is flexible and easy to use with:
56
- Tensor, pipeline, data and expert parallelism support for distributed inference
57
- Streaming outputs
58
- OpenAI-compatible API server
59
-- Support for NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs and GPUs, PowerPC CPUs, and TPU. Additionally, support for diverse hardware plugins such as Intel Gaudi, IBM Spyre and Huawei Ascend.
59
+- Support for NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs and GPUs, PowerPC CPUs, Arm CPUs and TPU. Additionally, support for diverse hardware plugins such as Intel Gaudi, IBM Spyre and Huawei Ascend.
60
- Prefix caching support
61
- Multi-LoRA support
62