xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-07-09 12:37:16 +08:00
Code Issues Packages Projects Releases Wiki Activity

[bugfix]fix empty prompts for async-engine mode in benchmark throughput (#27494)

Browse Source 
Signed-off-by: Lucia Fang <fanglu@fb.com>
This commit is contained in:
Lucia Fang 2025-10-26 01:16:35 -07:00 committed by GitHub
parent 87c41c26ad
commit 315b860abe
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/benchmarks/throughput.py
View File

@ -221,6 +221,7 @@ async def run_vllm_async(
detokenize=not disable_detokenize, detokenize=not disable_detokenize,
) )
) )
prompts.append(prompt)
lora_requests.append(request.lora_request) lora_requests.append(request.lora_request)
generators = [] generators = []