xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2025-12-09 17:45:19 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Minor] Fix benchmark_throughput.py (#151)

Browse Source
This commit is contained in:
Woosuk Kwon 2023-06-16 21:00:52 -07:00 committed by GitHub
parent eedb46bf03
commit bab8f3dd0d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
benchmarks/benchmark_throughput.py
View File

@ -97,6 +97,7 @@ def run_cacheflow(
# FIXME(woosuk): Do not use internal method.
llm._add_request(
prompt=prompt,
prompt_token_ids=None,
sampling_params=sampling_params,
)