rookie 56f45eddaf

[Frontend] Optimize beam search loop by sorting and then splicing (#19347) ...

Signed-off-by: zhangguozhu <zhangguozhu@360.cn>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: zhangguozhu <zhangguozhu@360.cn>
Co-authored-by: mgoin <mgoin64@gmail.com>

2025-11-20 09:02:30 -08:00

..

tool_parsers

[Bugfix] Fix Kimi-K2 tool parser concatenated tool calls parsing (#28831)

2025-11-17 19:13:25 -08:00

__init__.py

…

api_server.py

[RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037)

2025-11-20 03:01:03 -08:00

cli_args.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

orca_metrics.py

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

protocol.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

run_batch.py

[Core] add support for reasoning parser plugins (#28075)

2025-11-06 01:15:06 +08:00

serving_chat.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

serving_classification.py

[Frontend] Added chat-style multimodal support to /classify. (#27516)

2025-11-14 11:03:55 +00:00

serving_completion.py

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

serving_embedding.py

[Model] Add num_cached_tokens for PoolingRequestOutput (#27378)

2025-10-23 14:03:42 +08:00

serving_engine.py

[Frontend] Optimize beam search loop by sorting and then splicing (#19347)

2025-11-20 09:02:30 -08:00

serving_models.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588)

2025-10-28 12:20:46 +00:00

serving_pooling.py

Fix io processor pooling #28273 (#28484)

2025-11-13 11:34:14 +00:00

serving_responses.py

[Frontend][responsesAPI][1/n] convert responses API tool input to chat completions tool format (#28231)

2025-11-13 04:47:22 +00:00

serving_score.py

…

serving_tokenization.py

…

serving_tokens.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

serving_transcription.py

…

speech_to_text.py

[Model, Core] Support Granite Speech & LoRA for STT (#24455)

2025-11-05 08:33:48 +01:00