xinyun/vllm
1
0
Fork 0
mirror of https://git.datalinker.icu/vllm-project/vllm.git synced 2026-03-22 09:47:57 +08:00
Code Issues Packages Projects Releases Wiki Activity

docs: add GPT-OSS (openai) tool parser documentation

Browse Source 
Add documentation for the `openai` tool call parser that supports
GPT-OSS models. This parser was previously only documented in the
cookbook but not in the main tool calling documentation.

Fixes: #31211

Signed-off-by: yurekami <yurekami@users.noreply.github.com>

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
yurekami 2025-12-24 22:55:25 +09:00
parent 7cd288a4b3
commit 24617166ce
1 changed files with 18 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
docs/features/tool_calling.md
View File

@ -396,6 +396,24 @@ Supported models:
Flags: `--tool-call-parser gigachat3`
### GPT-OSS Models (`openai`)
OpenAI's GPT-OSS models use a special token-based format (Harmony format) for tool calling that is parsed using the `openai` tool parser.
Supported models:
* `openai/gpt-oss-120b`
* `openai/gpt-oss-20b`
Known limitations:
* Only `tool_choice='auto'` is currently supported
* Streaming tool calls have limited support
Flags: `--tool-call-parser openai --enable-auto-tool-choice`
For more detailed examples and usage patterns, see the [GPT-OSS cookbook](https://docs.vllm.ai/projects/recipes/en/latest/OpenAI/GPT-OSS.html).
### Models with Pythonic Tool Calls (`pythonic`)
A growing number of models output a python list to represent tool calls instead of using JSON. This has the advantage of inherently supporting parallel tool calls and removing ambiguity around the JSON schema required for tool calls. The `pythonic` tool parser can support such models.