Varun Sundar Rabindranath c2ec430ab5

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) ...

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

2024-09-27 13:32:07 -07:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Encoder decoder] Add cuda graph support during decoding for encoder-decoder models (#7631)

2024-09-17 07:35:01 -07:00

blocksparse_attn.py

[torch.compile] use empty tensor instead of None for profiling (#8875)

2024-09-27 08:11:32 -07:00

flash_attn.py

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378)

2024-09-27 13:32:07 -07:00

flashinfer.py

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378)

2024-09-27 13:32:07 -07:00

ipex_attn.py

[torch.compile] use empty tensor instead of None for profiling (#8875)

2024-09-27 08:11:32 -07:00

openvino.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

pallas.py

[torch.compile] use empty tensor instead of None for profiling (#8875)

2024-09-27 08:11:32 -07:00

rocm_flash_attn.py

[torch.compile] use empty tensor instead of None for profiling (#8875)

2024-09-27 08:11:32 -07:00

torch_sdpa.py

[torch.compile] use empty tensor instead of None for profiling (#8875)

2024-09-27 08:11:32 -07:00

utils.py

[CI/Build] Update Ruff version (#8469)

2024-09-18 11:00:56 +00:00

xformers.py

[torch.compile] use empty tensor instead of None for profiling (#8875)

2024-09-27 08:11:32 -07:00