jmswen c8dcc15921

Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) ...

Signed-off-by: Jon Swenson <jmswen@gmail.com>

2025-06-04 08:26:47 -07:00

..

offline_inference

Fix #19130 (#19132)

2025-06-04 01:42:06 -07:00

online_serving

Allow AsyncLLMEngine.generate to target a specific DP rank (#19102)

2025-06-04 08:26:47 -07:00

others

[Misc] Fix path and python alias errors in disagg_prefill exmaples (#18919)

2025-06-03 17:15:18 -07:00

pyproject.toml

Convert examples to ruff-format (#18400)

2025-05-26 16:57:54 +00:00

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_dse_qwen2_vl.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_teleflm.jinja

…

template_vlm2vec.jinja

…

tool_chat_template_deepseekr1.jinja

Add DeepSeek-R1-0528 function call chat template (#18874)

2025-06-04 13:24:18 +00:00

tool_chat_template_deepseekv3.jinja

[Feature] Support DeepSeekV3 Function Call (#17784)

2025-05-12 00:45:21 -07:00

tool_chat_template_granite_20b_fc.jinja

…

tool_chat_template_granite.jinja

…

tool_chat_template_hermes.jinja

…

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

…

tool_chat_template_llama3.2_json.jinja

…

tool_chat_template_llama3.2_pythonic.jinja

…

tool_chat_template_llama4_json.jinja

…

tool_chat_template_llama4_pythonic.jinja

[Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917)

2025-05-22 16:44:08 -07:00

tool_chat_template_mistral3.jinja

…

tool_chat_template_mistral_parallel.jinja

…

tool_chat_template_mistral.jinja

…

tool_chat_template_phi4_mini.jinja

…

tool_chat_template_toolace.jinja

…