Nathan Price 05a83dc6ee

feat(api): Eager chat template warmup to eliminate first-request latency (#30700) ...

Signed-off-by: Nathan Price <nathan@abridge.com>

2025-12-18 00:01:29 +00:00

..

parser

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

2025-12-16 13:54:59 +08:00

tool_parsers

[Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675)

2025-12-15 12:54:52 +00:00

__init__.py

…

api_server.py

feat(api): Eager chat template warmup to eliminate first-request latency (#30700)

2025-12-18 00:01:29 +00:00

cli_args.py

[Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675)

2025-12-15 12:54:52 +00:00

orca_metrics.py

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

protocol.py

[Doc][ResponsesAPI] add documentation (#30840)

2025-12-17 01:53:02 -08:00

run_batch.py

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00

serving_chat.py

feat(api): Eager chat template warmup to eliminate first-request latency (#30700)

2025-12-18 00:01:29 +00:00

serving_completion.py

[P/D] KV Load Failure Recovery/Abort Configuration (#26813)

2025-12-10 11:00:52 -08:00

serving_engine.py

[Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675)

2025-12-15 12:54:52 +00:00

serving_models.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

serving_responses.py

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

2025-12-16 13:54:59 +08:00

serving_transcription.py

[Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209)

2025-12-01 18:19:17 +01:00

speech_to_text.py

[Frontend] Add max-completion-token option to transcription/translation endpoints (#30769)

2025-12-16 19:36:49 +00:00

utils.py

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00