Nick Hill 4fdd6f5cbf

[Core] Support async scheduling with uniproc executor (#24219) ...

Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

2025-09-12 16:34:28 -07:00

..

attention

Add FLASHINFER_MLA to backend selector test (#24753)

2025-09-12 22:30:07 +00:00

core

[Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548)

2025-09-12 21:42:23 +08:00

cudagraph

[Attention] FlashAttention MLA cudagraph support (#23958)

2025-09-08 22:05:26 +00:00

e2e

fix some typos (#24167)

2025-09-10 06:21:23 -07:00

engine

[Core] Support async scheduling with uniproc executor (#24219)

2025-09-12 16:34:28 -07:00

entrypoints

Extend renderer with embedding support and integrate completion endpoint (#24405)

2025-09-10 01:46:46 +08:00

executor

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

kv_connector

[Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673)

2025-09-08 21:34:37 -07:00

logits_processors

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

metrics

[Misc] Have AsyncLLM custom_stat_loggers extend default logger list (#20952)

2025-09-04 14:25:30 -07:00

sample

[Sampler] Support returning all prompt logprobs (#23868)

2025-09-07 19:34:31 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

Move LoadConfig from config/__init__.py to config/load.py (#24566)

2025-09-10 06:14:18 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705)

2025-09-12 15:45:53 -06:00

tracing

[V1] feat:add engine v1 tracing (#20372)

2025-09-11 17:10:39 -07:00

worker

[Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548)

2025-09-12 21:42:23 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[BugFix] Async scheduling and PP compatibility with DP (#23770)

2025-08-29 08:17:27 -07:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_internal_lb_dp.py

[BugFix] Fix port lookup in internal DP LB tests (#22252)

2025-08-15 11:17:11 +08:00

test_kv_sharing.py

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00