drslark add1b9d3de

[main][BugFix] Fixed an accuracy bug of Qwen3-next-MTP when batched inferring (#30632) ...

Signed-off-by: drslark <slarksblood@qq.com>

2025-12-14 01:32:16 -08:00

..

mla

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484)

2025-12-12 19:34:23 -08:00

__init__.py

…

cpu_attn.py

[CPU] Support for Whisper (#30062)

2025-12-10 04:58:42 -08:00

flash_attn.py

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

2025-12-05 09:48:43 -08:00

flashinfer.py

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484)

2025-12-12 19:34:23 -08:00

flex_attention.py

[v1] Add PrefixLM support to FlexAttention backend (#27938)

2025-12-07 15:51:36 +00:00

gdn_attn.py

[main][BugFix] Fixed an accuracy bug of Qwen3-next-MTP when batched inferring (#30632)

2025-12-14 01:32:16 -08:00

linear_attn.py

[Attention] add _cudagraph_support for linear attention (#28934)

2025-11-25 12:25:20 +08:00

mamba1_attn.py

[Attention][CUDAGraph] Remove CG padding from attention backends (#29352)

2025-12-02 13:48:08 -05:00

mamba2_attn.py

[Attention][CUDAGraph] Remove CG padding from attention backends (#29352)

2025-12-02 13:48:08 -05:00

mamba_attn.py

[Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579)

2025-11-26 14:07:13 -05:00

pallas.py

…

rocm_aiter_fa.py

[ROCm][Attention] Sliding window support for AiterFlashAttentionBackend (#29234)

2025-11-30 11:31:50 +00:00

rocm_aiter_unified_attn.py

[ROCm] Support for Whisper v1 with Aiter Unified Attention and Aiter Flash Attention (#28376)

2025-11-24 03:26:00 +00:00

rocm_attn.py

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

2025-12-05 09:48:43 -08:00

short_conv_attn.py

[Attention][CUDAGraph] Remove CG padding from attention backends (#29352)

2025-12-02 13:48:08 -05:00

tree_attn.py

[Attention] Refactor FA block_size limitations to hybrid models only (#29084)

2025-11-22 06:38:44 -08:00

triton_attn.py

[Kernel] Support CUDA Graphs in 3D Triton Attention Kernel (#28306)

2025-12-12 16:55:40 +01:00

utils.py

[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532)

2025-12-12 05:57:47 -08:00