xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-13 22:04:58 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Doc] cleanup deprecated flag for doc (#18715)

Browse Source 
Signed-off-by: calvin chen <120380290@qq.com>
This commit is contained in:
Calvin Chen 2025-05-27 15:12:02 +08:00 committed by GitHub
parent bbd9a84dc5
commit 4693a3438c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
benchmarks/README.md
View File

@ -146,10 +146,9 @@ python3 vllm/benchmarks/benchmark_serving.py \
``` bash ``` bash
VLLM_USE_V1=1 vllm serve meta-llama/Meta-Llama-3-8B-Instruct \ VLLM_USE_V1=1 vllm serve meta-llama/Meta-Llama-3-8B-Instruct \
--speculative-model "[ngram]" \
--ngram_prompt_lookup_min 2 \ --ngram_prompt_lookup_min 2 \
--ngram-prompt-lookup-max 5 \ --ngram-prompt-lookup-max 5 \
--num_speculative_tokens 5 --speculative_config '{"model": "[ngram]", "num_speculative_tokens": 5}
``` ```
``` bash ``` bash
@ -274,10 +273,9 @@ python3 vllm/benchmarks/benchmark_throughput.py \
--output-len=100 \ --output-len=100 \
--num-prompts=2048 \ --num-prompts=2048 \
--async-engine \ --async-engine \
--speculative-model="[ngram]" \
--ngram_prompt_lookup_min=2 \ --ngram_prompt_lookup_min=2 \
--ngram-prompt-lookup-max=5 \ --ngram-prompt-lookup-max=5 \
--num_speculative_tokens=5 --speculative_config '{"model": "[ngram]", "num_speculative_tokens": 5}
``` ```
``` ```