Lucas Wilkinson 48fc8b1e59

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

2025-11-19 10:04:07 -05:00

..

mla

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990)

2025-11-19 10:04:07 -05:00

__init__.py

…

cpu_attn.py

[CI Failure] Fix backend selection for encoder-only models (#28534)

2025-11-13 10:11:27 -05:00

flash_attn.py

[Attention] FlashAttention ViT support, make default backend (#28763)

2025-11-18 20:06:21 -08:00

flashinfer.py

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438)

2025-11-14 11:24:10 +00:00

flex_attention.py

[CI Failure] Fix backend selection for encoder-only models (#28534)

2025-11-13 10:11:27 -05:00

gdn_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

linear_attn.py

…

mamba1_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

mamba2_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

mamba_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

pallas.py

[V0 deprecation] Remove no longer used get_metadata_cls (#28370)

2025-11-10 14:32:09 +08:00

rocm_aiter_fa.py

[ROCm][Qwen3-32B] Fix AITER MHA accuracy issue cause by #25763 (#28670)

2025-11-16 20:52:11 -08:00

rocm_aiter_unified_attn.py

[V0 deprecation] Remove no longer used get_metadata_cls (#28370)

2025-11-10 14:32:09 +08:00

rocm_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

short_conv_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

tree_attn.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

triton_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

utils.py

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990)

2025-11-19 10:04:07 -05:00

xformers.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00