usberkeley 81fe3f82af

[BugFix] Fix index error in ngram_proposer (#29779) ...

Signed-off-by: Bradley <bradley.b.pitt@gmail.com>

2025-12-02 04:48:11 +00:00

..

attention

[v1] Add real sliding window calculation to FlexAttention direct BlockMask building (#26015)

2025-12-01 13:12:51 +00:00

core

[Core] Support reseting all running requests' KV while calling reset_prefix_cache (#28827)

2025-12-02 02:25:05 +00:00

cudagraph

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847)

2025-11-27 01:55:58 -08:00

determinism

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

distributed

[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698)

2025-11-28 20:19:01 -08:00

e2e

[BugFix] Preserve spec decoding uniform decode when scheduling (#29759)

2025-12-01 17:15:52 -08:00

ec_connector

[Bugfix] Fix pre-commit (#29601)

2025-11-27 02:23:06 -08:00

engine

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

entrypoints

[Misc] Unify tokenizer registration (#29767)

2025-12-01 11:34:58 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

kv_offload

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

2025-11-27 07:54:44 +00:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

shutdown

…

spec_decode

[BugFix] Fix index error in ngram_proposer (#29779)

2025-12-02 04:48:11 +00:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

…

tracing

…

worker

[Attention] Remove imports from vllm/attention/__init__.py (#29342)

2025-11-26 10:53:15 -07:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

…

test_serial_utils.py

…

utils.py

…