Benjamin Chislett e858bfe051

[Cleanup] Refactor profiling env vars into a CLI config (#29912) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-12-09 13:29:33 -05:00

..

offline_inference

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

online_serving

kv_transfer: Rename the shared storage connectors (#30201)

2025-12-08 20:46:09 -08:00

others

[Disagg] Support large batch size in proxy server and update NixlConnector doc for DP (#28782)

2025-12-09 00:01:08 +00:00

pooling

[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)

2025-12-08 12:01:21 +00:00

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_dse_qwen2_vl.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_teleflm.jinja

…

template_vlm2vec_phi3v.jinja

[Doc] Improve MM Pooling model documentation (#25966)

2025-09-30 18:58:29 +00:00

template_vlm2vec_qwen2vl.jinja

[Doc] Improve MM Pooling model documentation (#25966)

2025-09-30 18:58:29 +00:00

tool_chat_template_deepseekr1.jinja

…

tool_chat_template_deepseekv3.jinja

…

tool_chat_template_deepseekv31.jinja

Support DeepSeek-V3.1 tool call (#23454)

2025-08-23 05:50:16 +00:00

tool_chat_template_gemma3_pythonic.jinja

[Misc] Add gemma3 chat template with pythonic-style function calling (#17149)

2025-08-21 21:06:50 -07:00

tool_chat_template_granite_20b_fc.jinja

…

tool_chat_template_granite.jinja

…

tool_chat_template_hermes.jinja

…

tool_chat_template_hunyuan_a13b.jinja

…

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

…

tool_chat_template_llama3.2_json.jinja

…

tool_chat_template_llama3.2_pythonic.jinja

…

tool_chat_template_llama4_json.jinja

…

tool_chat_template_llama4_pythonic.jinja

…

tool_chat_template_minimax_m1.jinja

…

tool_chat_template_mistral3.jinja

…

tool_chat_template_mistral_parallel.jinja

…

tool_chat_template_mistral.jinja

…

tool_chat_template_phi4_mini.jinja

[Doc]: fixing typos to improve docs (#24480)

2025-09-08 23:06:04 -07:00

tool_chat_template_qwen3coder.jinja

[Bugfix]: Qwen3 Coder Tool Parser (#23099)

2025-08-26 19:58:32 -07:00

tool_chat_template_toolace.jinja

…

tool_chat_template_xlam_llama.jinja

…

tool_chat_template_xlam_qwen.jinja

…