A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 07:15 UTC
[Doc] Remove duplicate TOCs during MkDocs migration (#19021)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Hyogeun Oh (오효근) committed
Jun 3, 2025 at 11:49 UTC
5bc1ad6cee754405464a9957e86cf3a9302e4986
2 files changed
-23
docs/cli/README.md
-13
@@ -12,19 +12,6 @@ Available Commands:
12
vllm {chat,complete,serve,bench,collect-env,run-batch}
13
```
14
15
-## Table of Contents
16
-
17
-- [serve](#serve)
18
-- [chat](#chat)
19
-- [complete](#complete)
20
-- [bench](#bench)
21
- - [latency](#latency)
22
- - [serve](#serve-1)
23
- - [throughput](#throughput)
24
-- [collect-env](#collect-env)
25
-- [run-batch](#run-batch)
26
-- [More Help](#more-help)
27
-
15
## serve
16
17
Start the vLLM OpenAI Compatible API server.
docs/deployment/nginx.md
-10
@@ -5,16 +5,6 @@ title: Using Nginx
5
6
This document shows how to launch multiple vLLM serving containers and use Nginx to act as a load balancer between the servers.
7
8
-Table of contents:
9
-
10
-1. [Build Nginx Container][nginxloadbalancer-nginx-build]
11
-2. [Create Simple Nginx Config file][nginxloadbalancer-nginx-conf]
12
-3. [Build vLLM Container][nginxloadbalancer-nginx-vllm-container]
13
-4. [Create Docker Network][nginxloadbalancer-nginx-docker-network]
14
-5. [Launch vLLM Containers][nginxloadbalancer-nginx-launch-container]
15
-6. [Launch Nginx][nginxloadbalancer-nginx-launch-nginx]
16
-7. [Verify That vLLM Servers Are Ready][nginxloadbalancer-nginx-verify-nginx]
17
-
8
[](){ #nginxloadbalancer-nginx-build }
9
10
## Build Nginx Container