xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-05-27 09:47:53 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Misc] Consistent case for vllm bench serve results (#30403)

Browse Source 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
This commit is contained in:
Matthew Bonanni 2025-12-10 12:44:02 -05:00 committed by GitHub
parent 2dcbac9077
commit 794a7875ee
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
benchmarks/benchmark_serving_structured_output.py
View File

@ -574,7 +574,7 @@ async def benchmark(
) )
print( print(
"{:<40} {:<10.2f}".format( "{:<40} {:<10.2f}".format(
"Total Token throughput (tok/s):", metrics.total_token_throughput "Total token throughput (tok/s):", metrics.total_token_throughput
) )
) )

2
docs/benchmarking/cli.md
View File

@ -84,7 +84,7 @@ Total input tokens: 1369
Total generated tokens: 2212 Total generated tokens: 2212
Request throughput (req/s): 1.73 Request throughput (req/s): 1.73
Output token throughput (tok/s): 382.89 Output token throughput (tok/s): 382.89
Total Token throughput (tok/s): 619.85 Total token throughput (tok/s): 619.85
---------------Time to First Token---------------- ---------------Time to First Token----------------
Mean TTFT (ms): 71.54 Mean TTFT (ms): 71.54
Median TTFT (ms): 73.88 Median TTFT (ms): 73.88

2
vllm/benchmarks/serve.py
View File

@ -788,7 +788,7 @@ async def benchmark(
) )
print( print(
"{:<40} {:<10.2f}".format( "{:<40} {:<10.2f}".format(
"Total Token throughput (tok/s):", metrics.total_token_throughput "Total token throughput (tok/s):", metrics.total_token_throughput
) )
) )