A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 22:00 UTC
[Doc] Fix Typo in Doc (#6392)
Co-authored-by: Saliya Ekanayake <esaliya@d-matrix.ai>
Saliya Ekanayake committed
Jul 12, 2024 at 17:48 UTC
a27f87da3429eafbbaf4f5372bf458ae40e30618
2 files changed
+2
-2
README.md
+1
-1
@@ -58,7 +58,7 @@ vLLM is flexible and easy to use with:
58
59
- Seamless integration with popular Hugging Face models
60
- High-throughput serving with various decoding algorithms, including *parallel sampling*, *beam search*, and more
61
-- Tensor parallelism and pipieline parallelism support for distributed inference
61
+- Tensor parallelism and pipeline parallelism support for distributed inference
62
- Streaming outputs
63
- OpenAI-compatible API server
64
- Support NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs and GPUs, PowerPC CPUs
docs/source/index.rst
+1
-1
@@ -38,7 +38,7 @@ vLLM is flexible and easy to use with:
38
39
* Seamless integration with popular HuggingFace models
40
* High-throughput serving with various decoding algorithms, including *parallel sampling*, *beam search*, and more
41
-* Tensor parallelism and pipieline parallelism support for distributed inference
41
+* Tensor parallelism and pipeline parallelism support for distributed inference
42
* Streaming outputs
43
* OpenAI-compatible API server
44
* Support NVIDIA GPUs and AMD GPUs