xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-06-04 09:42:17 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] catch AssertionError in MistralTokenizer as ValueError (#16344)

Browse Source 
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
This commit is contained in:
Guillaume Calmettes 2025-04-09 19:33:24 +02:00 committed by GitHub
parent a25866ac8d
commit c3b5189137
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 12 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
vllm/entrypoints/chat_utils.py
View File

@ -1193,8 +1193,15 @@ def apply_mistral_chat_template(
**kwargs, **kwargs,
) )
return tokenizer.apply_chat_template( try:
messages=messages, return tokenizer.apply_chat_template(
tools=tools, messages=messages,
**kwargs, tools=tools,
) **kwargs,
)
# mistral-common uses assert statements to stop processing of input
# if input does not comply with the expected format.
# We convert those assertion errors to ValueErrors so they can be
# are properly caught in the preprocessing_input step
except AssertionError as e:
raise ValueError from e