jiangkuaixue123 eb2355c600 ffn server use vllm serve and dp ...

Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>

2025-12-16 15:49:36 +08:00

..

anthropic

[Frontend] Fixes anthropic streaming message_start usage nesting (#30266)

2025-12-12 16:28:54 +00:00

cli

ffn server use vllm serve and dp

2025-12-16 15:49:36 +08:00

openai

ffn server use vllm serve and dp

2025-12-16 15:49:36 +08:00

pooling

[Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596)

2025-12-14 14:57:15 +00:00

sagemaker

[Refactor] [1/N] to simplify the vLLM serving architecture (#28040)

2025-12-03 01:26:39 -08:00

serve

[Chore] Remove redundant RequestPrompt (#30612)

2025-12-14 09:22:37 +00:00

__init__.py

…

afd_ffn_server.py

1.add afd

2025-12-16 15:49:35 +08:00

api_server.py

[Refactor] [1/N] to simplify the vLLM serving architecture (#28040)

2025-12-03 01:26:39 -08:00

chat_utils.py

[Frontend] add tools for dsv32 developer role (#30040)

2025-12-15 15:08:47 +00:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

context.py

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

2025-12-16 13:54:59 +08:00

launcher.py

…

llm.py

[UX][Attention] Add attention_config argument to LLM() (#30710)

2025-12-15 17:29:09 -05:00

logger.py

…

renderer.py

additional protection for CVE-2025-62164 (#30649)

2025-12-15 03:07:10 +00:00

responses_utils.py

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

2025-12-16 13:54:59 +08:00

score_utils.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

ssl.py

…

tool_server.py

[Frontend] Add tool filtering support to ToolServer (#29224)

2025-12-01 08:03:57 +00:00

tool.py

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798)

2025-12-05 11:11:50 -05:00

utils.py

[Chore] Adjust tokenizer import to avoid circular imports (#30601)

2025-12-13 04:42:39 -08:00