cong-meta a2981c4272

[EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) ...

Co-authored-by: Cong Chen <prowindy@gmail.com>

2025-10-30 12:10:16 -07:00

..

tool_parsers

Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565)

2025-10-28 11:11:50 +00:00

__init__.py

…

api_server.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

cli_args.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

protocol.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

run_batch.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

serving_chat.py

[EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945)

2025-10-30 12:10:16 -07:00

serving_classification.py

…

serving_completion.py

[EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945)

2025-10-30 12:10:16 -07:00

serving_embedding.py

[Model] Add num_cached_tokens for PoolingRequestOutput (#27378)

2025-10-23 14:03:42 +08:00

serving_engine.py

[EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945)

2025-10-30 12:10:16 -07:00

serving_models.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588)

2025-10-28 12:20:46 +00:00

serving_pooling.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

serving_responses.py

[Frontend] [gpt-oss] Mcp type bug (#27689)

2025-10-29 10:01:32 +00:00

serving_score.py

[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)

2025-10-19 05:20:55 -07:00

serving_tokenization.py

…

serving_transcription.py

…

speech_to_text.py

[Chore] Separate out vllm.utils.importlib (#27022)

2025-10-17 00:48:59 +00:00