From 7b6fd6e48666b60cb2eed53b2f0f7373e25cab8d Mon Sep 17 00:00:00 2001 From: Robin <863579016@qq.com> Date: Sat, 8 Mar 2025 14:58:46 +0800 Subject: [PATCH] [Doc]add doc for Qwen models tool calling (#14478) Signed-off-by: WangErXiao <863579016@qq.com> --- docs/source/features/tool_calling.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/docs/source/features/tool_calling.md b/docs/source/features/tool_calling.md index 85a9e03739863..2e1081bf8d14b 100644 --- a/docs/source/features/tool_calling.md +++ b/docs/source/features/tool_calling.md @@ -209,6 +209,15 @@ AI21's Jamba-1.5 models are supported. Flags: `--tool-call-parser jamba` +### Qwen Models + +For Qwen2.5, the chat template in tokenizer_config.json has already included support for the Hermes-style tool use. Therefore, you can use the `hermes` parser to enable tool calls for Qwen models. For more detailed information, please refer to the official [Qwen documentation](https://qwen.readthedocs.io/en/latest/framework/function_call.html#vllm) + +* `Qwen/Qwen2.5-*` +* `Qwen/QwQ-32B` + +Flags: `--tool-call-parser hermes` + ### Models with Pythonic Tool Calls (`pythonic`) A growing number of models output a python list to represent tool calls instead of using JSON. This has the advantage of inherently supporting parallel tool calls and removing ambiguity around the JSON schema required for tool calls. The `pythonic` tool parser can support such models.