Woosuk Kwon c11d1e6781 optimize spec ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2025-08-31 16:40:54 -07:00

..

attention

[Misc] add reorder_batch AttentionMetadataBuilder (#23798)

2025-08-30 06:41:45 -07:00

core

[Bugfix] Fix for V1 priority scheduling crashes at preemption (#23713)

2025-08-28 00:44:52 +00:00

engine

vllm fix check on max vocab size (#22471)

2025-08-31 20:57:05 +08:00

executor

[BugFix] Async scheduling and PP compatibility with DP (#23770)

2025-08-29 08:17:27 -07:00

metrics

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

pool

[Performance] V1 Pooling Models E2E Performance Optimization (#23162)

2025-08-21 13:26:09 +00:00

sample

merge

2025-08-31 10:44:36 -07:00

spec_decode

[FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795)

2025-08-20 09:08:29 -07:00

structured_output

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

worker

optimize spec

2025-08-31 16:40:54 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[CI] Fix linting error on main (#23835)

2025-08-28 06:52:01 -07:00

kv_cache_interface.py

[v1] Add cross-attention KV cache support for encoder-decoder models (#23664)

2025-08-26 18:49:06 +00:00

outputs.py

[Spec Decode] Make propose_draft_token_ids non-blocking for lower TTFT (#23041)

2025-08-18 17:20:38 -07:00

request.py

[Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779)

2025-08-29 18:36:57 +08:00

serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

utils.py

[Misc] Move CpuGpuBuffer to vllm/v1/utils.py (#23728)

2025-08-27 03:25:00 -07:00