mirror of
https://git.datalinker.icu/vllm-project/vllm.git
synced 2026-03-16 13:57:12 +08:00
[Doc] Remove duplicate TOCs during MkDocs migration (#19021)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
This commit is contained in:
parent
9112b443a0
commit
5bc1ad6cee
@ -12,19 +12,6 @@ Available Commands:
|
||||
vllm {chat,complete,serve,bench,collect-env,run-batch}
|
||||
```
|
||||
|
||||
## Table of Contents
|
||||
|
||||
- [serve](#serve)
|
||||
- [chat](#chat)
|
||||
- [complete](#complete)
|
||||
- [bench](#bench)
|
||||
- [latency](#latency)
|
||||
- [serve](#serve-1)
|
||||
- [throughput](#throughput)
|
||||
- [collect-env](#collect-env)
|
||||
- [run-batch](#run-batch)
|
||||
- [More Help](#more-help)
|
||||
|
||||
## serve
|
||||
|
||||
Start the vLLM OpenAI Compatible API server.
|
||||
|
||||
@ -5,16 +5,6 @@ title: Using Nginx
|
||||
|
||||
This document shows how to launch multiple vLLM serving containers and use Nginx to act as a load balancer between the servers.
|
||||
|
||||
Table of contents:
|
||||
|
||||
1. [Build Nginx Container][nginxloadbalancer-nginx-build]
|
||||
2. [Create Simple Nginx Config file][nginxloadbalancer-nginx-conf]
|
||||
3. [Build vLLM Container][nginxloadbalancer-nginx-vllm-container]
|
||||
4. [Create Docker Network][nginxloadbalancer-nginx-docker-network]
|
||||
5. [Launch vLLM Containers][nginxloadbalancer-nginx-launch-container]
|
||||
6. [Launch Nginx][nginxloadbalancer-nginx-launch-nginx]
|
||||
7. [Verify That vLLM Servers Are Ready][nginxloadbalancer-nginx-verify-nginx]
|
||||
|
||||
[](){ #nginxloadbalancer-nginx-build }
|
||||
|
||||
## Build Nginx Container
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user