A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 17:15 UTC
Correct PowerPC to modern IBM Power (#15635)
Signed-off-by: Christy Norman <christy@linux.vnet.ibm.com>
cnorman committed
Mar 27, 2025 at 17:04 UTC
32d669275b1068e3261a47715d30e842817e000b
1 file changed
+1
-1
docs/source/index.md
+1
-1
@@ -43,7 +43,7 @@ vLLM is flexible and easy to use with:
43
- Tensor parallelism and pipeline parallelism support for distributed inference
44
- Streaming outputs
45
- OpenAI-compatible API server
46
-- Support NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs, Gaudi® accelerators and GPUs, PowerPC CPUs, TPU, and AWS Trainium and Inferentia Accelerators.
46
+- Support NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs, Gaudi® accelerators and GPUs, IBM Power CPUs, TPU, and AWS Trainium and Inferentia Accelerators.
47
- Prefix caching support
48
- Multi-lora support
49