Lucas Wilkinson abe93bce59

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

2025-12-09 17:18:10 -08:00

..

attention

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)

2025-12-09 17:18:10 -08:00

core

kv_transfer: Rename the shared storage connectors (#30201)

2025-12-08 20:46:09 -08:00

cudagraph

[BugFix] Fix assert batch_descriptor.num_tokens == num_tokens_padded (#30173)

2025-12-09 10:36:12 -05:00

determinism

[Feature] Batch-Invariant Support for FA2 and LoRA (#30018)

2025-12-09 10:01:38 -05:00

distributed

Mark DBO test as flaky on b200 for Distributed B200 test (#29913)

2025-12-04 10:38:03 -05:00

e2e

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)

2025-12-09 17:18:10 -08:00

ec_connector

kv_transfer: Rename the shared storage connectors (#30201)

2025-12-08 20:46:09 -08:00

engine

kv_transfer: Rename the shared storage connectors (#30201)

2025-12-08 20:46:09 -08:00

entrypoints

[Misc] Various cleanups for MM input processing (#29970)

2025-12-04 06:22:20 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

kv_transfer: Rename the shared storage connectors (#30201)

2025-12-08 20:46:09 -08:00

kv_offload

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

2025-11-27 07:54:44 +00:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189)

2025-12-09 00:08:48 +00:00

sample

[CI] Fix Bad_words test for tokenizer encode/decode asymmetry (#28193)

2025-12-02 00:02:12 -08:00

shutdown

…

spec_decode

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)

2025-12-09 17:18:10 -08:00

structured_output

[Structured Output][Reasoning] Improves decoding throughput for models using single-token reasoning endings. (#30056)

2025-12-09 18:54:08 +08:00

tpu

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

tracing

…

worker

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

__init__.py

…

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

…

test_serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

…