Nick Hill 15dac210f0

[V1] AsyncLLM data parallel (#13923) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-03-27 16:14:41 -07:00

..

offline_inference

[V1] AsyncLLM data parallel (#13923)

2025-03-27 16:14:41 -07:00

online_serving

[Model] Add Reasoning Parser for Granite Models (#14202)

2025-03-26 14:28:07 +00:00

other

[Doc] Fix typo in documentation (#14783)

2025-03-13 20:33:09 -07:00

template_alpaca.jinja

…

template_baichuan.jinja

…

template_blip2.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_deepseek_vl2.jinja

[Misc] Correct deepseek-vl2 chat template (#14558)

2025-03-11 04:37:11 +00:00

template_dse_qwen2_vl.jinja

[Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944)

2024-11-13 08:28:13 +00:00

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_llava.jinja

…

template_teleflm.jinja

[Model] Support Tele-FLM Model (#15023)

2025-03-22 02:04:44 -07:00

template_vlm2vec.jinja

[Frontend] Use a proper chat template for VLM2Vec (#9912)

2024-11-01 14:09:07 +00:00

tool_chat_template_granite_20b_fc.jinja

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339)

2024-10-29 15:07:37 -07:00

tool_chat_template_granite.jinja

Change granite chat template to keep json list formatting for tool calls (#10452)

2024-11-19 18:16:54 -07:00

tool_chat_template_hermes.jinja

…

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

[Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (#10164)

2024-11-23 10:17:38 +08:00

tool_chat_template_llama3.2_json.jinja

[Misc] Update llama 3.2 template to support system prompt with images (#10901)

2024-12-05 05:54:06 +00:00

tool_chat_template_llama3.2_pythonic.jinja

[Frontend] Pythonic tool parser (#9859)

2024-11-14 04:14:34 +00:00

tool_chat_template_mistral_parallel.jinja

…

tool_chat_template_mistral.jinja

…

tool_chat_template_toolace.jinja

[Frontend] Pythonic tool parser (#9859)

2024-11-14 04:14:34 +00:00