Sage Moore 567939953b

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

2025-09-16 12:21:48 -04:00

..

attention

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

core

[Tests] fix initialization of kv hash in tests (#24273)

2025-09-15 21:48:27 +00:00

cudagraph

[Attention] FlashAttention MLA cudagraph support (#23958)

2025-09-08 22:05:26 +00:00

e2e

[CI][Spec Decode] Adjust threshold for flaky ngram spec decoding test again (#24771)

2025-09-13 15:45:11 +08:00

engine

Move MultiModalConfig from config/__init__.py to config/multimodal.py (#24659)

2025-09-15 17:43:16 +00:00

entrypoints

Extend renderer with embedding support and integrate completion endpoint (#24405)

2025-09-10 01:46:46 +08:00

executor

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

kv_connector

[Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673)

2025-09-08 21:34:37 -07:00

logits_processors

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

metrics

[Misc] Have AsyncLLM custom_stat_loggers extend default logger list (#20952)

2025-09-04 14:25:30 -07:00

sample

[Sampler] Support returning all prompt logprobs (#23868)

2025-09-07 19:34:31 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Hybrid Allocator] Support Pipeline Parallel (#23974)

2025-09-14 15:55:17 -07:00

tracing

[V1] feat:add engine v1 tracing (#20372)

2025-09-11 17:10:39 -07:00

worker

[Hybrid Allocator] Support Pipeline Parallel (#23974)

2025-09-14 15:55:17 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[BugFix] Async scheduling and PP compatibility with DP (#23770)

2025-08-29 08:17:27 -07:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_internal_lb_dp.py

[BugFix] Fix port lookup in internal DP LB tests (#22252)

2025-08-15 11:17:11 +08:00

test_kv_sharing.py

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00