Nathan Price 05a83dc6ee

feat(api): Eager chat template warmup to eliminate first-request latency (#30700) ...

Signed-off-by: Nathan Price <nathan@abridge.com>

2025-12-18 00:01:29 +00:00

..

anthropic

[Frontend] Fixes anthropic streaming message_start usage nesting (#30266)

2025-12-12 16:28:54 +00:00

cli

[Misc] Add a script to benchmark compilation time (#29919)

2025-12-14 13:02:39 +00:00

openai

feat(api): Eager chat template warmup to eliminate first-request latency (#30700)

2025-12-18 00:01:29 +00:00

pooling

[Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596)

2025-12-14 14:57:15 +00:00

sagemaker

[Refactor] [1/N] to simplify the vLLM serving architecture (#28040)

2025-12-03 01:26:39 -08:00

serve

[Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749)

2025-12-17 02:27:30 -08:00

__init__.py

…

api_server.py

[Refactor] [1/N] to simplify the vLLM serving architecture (#28040)

2025-12-03 01:26:39 -08:00

chat_utils.py

[Frontend] add tools for dsv32 developer role (#30040)

2025-12-15 15:08:47 +00:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

context.py

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

2025-12-16 13:54:59 +08:00

launcher.py

…

llm.py

[UX][Attention] Add attention_config argument to LLM() (#30710)

2025-12-15 17:29:09 -05:00

logger.py

…

renderer.py

additional protection for CVE-2025-62164 (#30649)

2025-12-15 03:07:10 +00:00

responses_utils.py

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

2025-12-16 13:54:59 +08:00

score_utils.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

ssl.py

…

tool_server.py

[Frontend] Add tool filtering support to ToolServer (#29224)

2025-12-01 08:03:57 +00:00

tool.py

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798)

2025-12-05 11:11:50 -05:00

utils.py

[Chore] Adjust tokenizer import to avoid circular imports (#30601)

2025-12-13 04:42:39 -08:00