Pavani Majety 6c1208d083

[Core] Add Sliding Window Support with Flashinfer (#10462) ...

Signed-off-by: Pavani Majety <pmajety@nvidia.com>

2024-11-20 19:56:47 -08:00

..

backends

[Core] Add Sliding Window Support with Flashinfer (#10462)

2024-11-20 19:56:47 -08:00

ops

[Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355)

2024-11-20 10:57:39 +00:00

__init__.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

layer.py

[Kernel] Support sliding window in flash attention backend (#9403)

2024-10-20 10:57:52 -07:00

selector.py

[Platform][Refactor] Extract func get_default_attn_backend to Platform (#10358)

2024-11-19 11:22:26 +08:00