Nick Hill 8e7a891602

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-11-28 20:52:23 +08:00

..

attention

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

core

[BugFix] Fix ValueError in NewRequestData repr methods (#29392)

2025-11-28 13:42:30 +08:00

cudagraph

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847)

2025-11-27 01:55:58 -08:00

determinism

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

distributed

[CI/Build] Skip ray tests on ROCm (#29556)

2025-11-27 07:01:37 -08:00

e2e

[Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594)

2025-11-27 22:05:45 -08:00

ec_connector

[Bugfix] Fix pre-commit (#29601)

2025-11-27 02:23:06 -08:00

engine

[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

2025-11-14 18:39:57 +00:00

entrypoints

Scheduled removal of guided_* config fields (#29326)

2025-11-25 05:24:05 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

kv_offload

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

2025-11-27 07:54:44 +00:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

shutdown

…

spec_decode

[CI/Build][AMD] Add check for flash_att_varlen_func to test_tree_attention.py (#29252)

2025-11-23 04:45:08 +00:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

tracing

…

worker

[Attention] Remove imports from vllm/attention/__init__.py (#29342)

2025-11-26 10:53:15 -07:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

…

test_serial_utils.py

…

utils.py

…