Mark McLoughlin 2417798471

[Metrics] Deprecate TPOT in favor of ITL (#24110) ...

Signed-off-by: Mark McLoughlin <markmc@redhat.com>

2025-09-02 18:10:10 +00:00

..

offline_inference

[Model]: support KeyeVL-1_5-8B (#23838)

2025-09-01 03:50:27 -07:00

online_serving

[Metrics] Deprecate TPOT in favor of ITL (#24110)

2025-09-02 18:10:10 +00:00

others

[LMCache][Example] Align the PYTHONHASHSEED for prefillers and decoders for KV chunks hashing (#21161)

2025-08-12 02:05:14 -07:00

pyproject.toml

…

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_dse_qwen2_vl.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_teleflm.jinja

…

template_vlm2vec.jinja

…

tool_chat_template_deepseekr1.jinja

Fix DeepSeek-R1-0528 chat template (#20717)

2025-07-10 17:47:36 +00:00

tool_chat_template_deepseekv3.jinja

…

tool_chat_template_deepseekv31.jinja

Support DeepSeek-V3.1 tool call (#23454)

2025-08-23 05:50:16 +00:00

tool_chat_template_gemma3_pythonic.jinja

[Misc] Add gemma3 chat template with pythonic-style function calling (#17149)

2025-08-21 21:06:50 -07:00

tool_chat_template_granite_20b_fc.jinja

…

tool_chat_template_granite.jinja

…

tool_chat_template_hermes.jinja

…

tool_chat_template_hunyuan_a13b.jinja

[Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820)

2025-07-17 09:10:09 +00:00

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

…

tool_chat_template_llama3.2_json.jinja

…

tool_chat_template_llama3.2_pythonic.jinja

…

tool_chat_template_llama4_json.jinja

…

tool_chat_template_llama4_pythonic.jinja

…

tool_chat_template_minimax_m1.jinja

[Feature] Support MiniMax-M1 function calls features (#20297)

2025-07-03 06:48:27 +00:00

tool_chat_template_mistral3.jinja

…

tool_chat_template_mistral_parallel.jinja

…

tool_chat_template_mistral.jinja

…

tool_chat_template_phi4_mini.jinja

[Bugfix] set system_message in phi4mini chat template (#23309)

2025-08-21 14:22:39 +00:00

tool_chat_template_qwen3coder.jinja

[Bugfix]: Qwen3 Coder Tool Parser (#23099)

2025-08-26 19:58:32 -07:00

tool_chat_template_toolace.jinja

…

tool_chat_template_xlam_llama.jinja

…

tool_chat_template_xlam_qwen.jinja

…