Benjamin Chislett 975676d174

[Feat] Drop-in Torch CUDA Profiler (#27841) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

2025-11-08 14:07:37 -08:00

..

tool_parsers

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

__init__.py

…

api_server.py

[Feat] Drop-in Torch CUDA Profiler (#27841)

2025-11-08 14:07:37 -08:00

cli_args.py

[Refactor] Lazy import tool_parser (#27974)

2025-11-04 10:10:10 +08:00

orca_metrics.py

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

protocol.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

run_batch.py

[Core] add support for reasoning parser plugins (#28075)

2025-11-06 01:15:06 +08:00

serving_chat.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

serving_classification.py

…

serving_completion.py

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

serving_embedding.py

[Model] Add num_cached_tokens for PoolingRequestOutput (#27378)

2025-10-23 14:03:42 +08:00

serving_engine.py

[Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874)

2025-11-06 10:40:03 +00:00

serving_models.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588)

2025-10-28 12:20:46 +00:00

serving_pooling.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

serving_responses.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

serving_score.py

…

serving_tokenization.py

…

serving_transcription.py

…

speech_to_text.py

[Model, Core] Support Granite Speech & LoRA for STT (#24455)

2025-11-05 08:33:48 +01:00