[BugFix] Use unique ids for different transcription prompts (#29372)

Signed-off-by: Nick Hill <nhill@redhat.com>
This commit is contained in:
Nick Hill 2025-11-24 22:55:16 -08:00 committed by GitHub
parent 40a6f53f6c
commit 7992324f23
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -201,10 +201,10 @@ class OpenAISpeechToText(OpenAIServing):
self.engine_client.generate(
prompt,
sampling_params,
request_id,
f"{request_id}_{i}",
lora_request=lora_request,
)
for prompt in prompts
for i, prompt in enumerate(prompts)
]
except ValueError as e:
# TODO: Use a vllm-specific Validation Error