xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-05-29 07:27:04 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Benchmark] Fix regression in structured output benchmark (#25500)

Browse Source 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
This commit is contained in:
Russell Bryant 2025-09-24 06:40:42 -04:00 committed by yewentao256
parent f98d4d38c0
commit 0cb913b0a2
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
benchmarks/benchmark_serving_structured_output.py
View File

@ -449,7 +449,8 @@ async def benchmark(
def prepare_extra_body(request) -> dict: def prepare_extra_body(request) -> dict:
extra_body = {} extra_body = {}
# Add the schema to the extra_body # Add the schema to the extra_body
extra_body[request.structure_type] = request.schema extra_body["structured_outputs"] = {}
extra_body["structured_outputs"][request.structure_type] = request.schema
return extra_body return extra_body
print("Starting initial single prompt test run...") print("Starting initial single prompt test run...")