Or Ozeri 647464719b

[KVConnector][Core] Support cross-layer KV blocks (#27743) ...

Signed-off-by: Or Ozeri <oro@il.ibm.com>

2025-11-20 19:09:59 +01:00

..

mla

[KVConnector][Core] Support cross-layer KV blocks (#27743)

2025-11-20 19:09:59 +01:00

__init__.py

…

cpu_attn.py

[CI Failure] Fix backend selection for encoder-only models (#28534)

2025-11-13 10:11:27 -05:00

flash_attn.py

[KVConnector][Core] Support cross-layer KV blocks (#27743)

2025-11-20 19:09:59 +01:00

flashinfer.py

[KVConnector][Core] Support cross-layer KV blocks (#27743)

2025-11-20 19:09:59 +01:00

flex_attention.py

[CI Failure] Fix backend selection for encoder-only models (#28534)

2025-11-13 10:11:27 -05:00

gdn_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

linear_attn.py

…

mamba1_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

mamba2_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

mamba_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

pallas.py

[V0 deprecation] Remove no longer used get_metadata_cls (#28370)

2025-11-10 14:32:09 +08:00

rocm_aiter_fa.py

[ROCm][Qwen3-32B] Fix AITER MHA accuracy issue cause by #25763 (#28670)

2025-11-16 20:52:11 -08:00

rocm_aiter_unified_attn.py

[V0 deprecation] Remove no longer used get_metadata_cls (#28370)

2025-11-10 14:32:09 +08:00

rocm_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

short_conv_attn.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00

tree_attn.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

triton_attn.py

[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

2025-11-13 01:56:40 +09:00

utils.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

xformers.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00