Benjamin Chislett 304419576a

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>

2025-11-13 01:56:40 +09:00

..

mla

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

__init__.py

…

cpu_attn.py

[CPU] Refactor CPU attention backend (#27954)

2025-11-12 09:43:06 +08:00

flash_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

flashinfer.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

flex_attention.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

gdn_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

linear_attn.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

mamba1_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

mamba2_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

mamba_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

pallas.py

[V0 deprecation] Remove no longer used get_metadata_cls (#28370)

2025-11-10 14:32:09 +08:00

rocm_aiter_fa.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

rocm_aiter_unified_attn.py

[V0 deprecation] Remove no longer used get_metadata_cls (#28370)

2025-11-10 14:32:09 +08:00

rocm_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

short_conv_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

tree_attn.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

triton_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

utils.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

xformers.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00