@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / a27f87da34
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

[Doc] Fix Typo in Doc (#6392)

Co-authored-by: Saliya Ekanayake <esaliya@d-matrix.ai>

Saliya Ekanayake committed Jul 12, 2024 at 17:48 UTC a27f87da3429eafbbaf4f5372bf458ae40e30618
2 files changed +2 -2
README.md
+1 -1
@@ -58,7 +58,7 @@ vLLM is flexible and easy to use with:
58
59 - Seamless integration with popular Hugging Face models
60 - High-throughput serving with various decoding algorithms, including *parallel sampling*, *beam search*, and more
61 -- Tensor parallelism and pipieline parallelism support for distributed inference
61 +- Tensor parallelism and pipeline parallelism support for distributed inference
62 - Streaming outputs
63 - OpenAI-compatible API server
64 - Support NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs and GPUs, PowerPC CPUs
docs/source/index.rst
+1 -1
@@ -38,7 +38,7 @@ vLLM is flexible and easy to use with:
38
39 * Seamless integration with popular HuggingFace models
40 * High-throughput serving with various decoding algorithms, including *parallel sampling*, *beam search*, and more
41 -* Tensor parallelism and pipieline parallelism support for distributed inference
41 +* Tensor parallelism and pipeline parallelism support for distributed inference
42 * Streaming outputs
43 * OpenAI-compatible API server
44 * Support NVIDIA GPUs and AMD GPUs