JartX 3b11b26b50

[FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795) ...

Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

2025-08-20 09:08:29 -07:00

..

attention

[Misc] Add max_seq_len to CommonAttentionMetadata (#23216)

2025-08-20 09:05:29 -07:00

core

[BugFix] Fix stuck stats/metrics after requests are aborted (#22995)

2025-08-20 13:50:29 +08:00

engine

[Core] Add torch profiler CPU traces for AsyncLLM. (#21794)

2025-08-20 02:32:47 +00:00

executor

[Spec Decode] Make propose_draft_token_ids non-blocking for lower TTFT (#23041)

2025-08-18 17:20:38 -07:00

metrics

[BugFix] Improve internal DP load balancing (#21617)

2025-08-01 19:45:27 -07:00

pool

[Model][1/N] Support multiple poolers at model level (#21227)

2025-07-21 02:22:21 -07:00

sample

[V1] Logits processors extensibility (#19912)

2025-08-16 12:59:17 -07:00

spec_decode

[FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795)

2025-08-20 09:08:29 -07:00

structured_output

[Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding (#21862)

2025-08-05 19:57:49 -07:00

worker

[Misc] Add max_seq_len to CommonAttentionMetadata (#23216)

2025-08-20 09:05:29 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)

2025-08-15 10:01:39 -04:00

kv_cache_interface.py

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928)

2025-08-15 12:57:06 +00:00

outputs.py

[Spec Decode] Make propose_draft_token_ids non-blocking for lower TTFT (#23041)

2025-08-18 17:20:38 -07:00

request.py

[Misc] Convert use_structured_output property into constant (#23060)

2025-08-17 12:41:38 -07:00

serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

utils.py

[refactor] improve ConstantList exception specificity (#22156)

2025-08-03 22:14:49 -07:00