From e0986ea07bd7f1f01cd3c54d91523aea91589b59 Mon Sep 17 00:00:00 2001 From: Maximilien de Bayser Date: Sun, 5 Oct 2025 04:35:42 -0300 Subject: [PATCH] Add documentation for granite 4 tool calling (#26175) Signed-off-by: Max de Bayser --- docs/features/tool_calling.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/docs/features/tool_calling.md b/docs/features/tool_calling.md index 241438ae55780..6a0bcfac66d0a 100644 --- a/docs/features/tool_calling.md +++ b/docs/features/tool_calling.md @@ -191,10 +191,14 @@ VLLM also provides a pythonic and JSON-based chat template for Llama 4, but pyth For Llama 4 model, use `--tool-call-parser llama4_pythonic --chat-template examples/tool_chat_template_llama4_pythonic.jinja`. -#### IBM Granite +### IBM Granite Supported models: +* `ibm-granite/granite-4.0-h-small` and other Granite 4.0 models + + Recommended flags: `--tool-call-parser hermes` + * `ibm-granite/granite-3.0-8b-instruct` Recommended flags: `--tool-call-parser granite --chat-template examples/tool_chat_template_granite.jinja`