Tao He 60f7624334

Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)

2025-05-12 19:52:47 -07:00

..

lmcache

Construct KVTransferConfig properly from Python instead of using JSON blobs without CLI (#17994)

2025-05-12 11:25:33 -07:00

offline_inference

Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)

2025-05-12 19:52:47 -07:00

online_serving

[Frontend] Add /classify endpoint (#17032)

2025-05-11 07:57:07 +00:00

other

…

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_dse_qwen2_vl.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_teleflm.jinja

…

template_vlm2vec.jinja

…

tool_chat_template_deepseekv3.jinja

[Feature] Support DeepSeekV3 Function Call (#17784)

2025-05-12 00:45:21 -07:00

tool_chat_template_granite_20b_fc.jinja

…

tool_chat_template_granite.jinja

…

tool_chat_template_hermes.jinja

…

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

…

tool_chat_template_llama3.2_json.jinja

…

tool_chat_template_llama3.2_pythonic.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00

tool_chat_template_llama4_json.jinja

Add chat template for Llama 4 models (#16428)

2025-04-24 20:19:36 +00:00

tool_chat_template_llama4_pythonic.jinja

[Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463)

2025-04-12 06:26:17 +08:00

tool_chat_template_mistral3.jinja

[Bugfix] Fix tool call template validation for Mistral models (#17644)

2025-05-08 09:47:19 +00:00

tool_chat_template_mistral_parallel.jinja

…

tool_chat_template_mistral.jinja

…

tool_chat_template_phi4_mini.jinja

…

tool_chat_template_toolace.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00