Woosuk Kwon 5510cf0e8a

[Misc] Add get_name method to attention backends (#4685)

2024-05-08 09:59:31 -07:00

..

backends

[Misc] Add get_name method to attention backends (#4685)

2024-05-08 09:59:31 -07:00

ops

[Bugfix][Kernel] allow non-power-of-2 for prefix prefill with alibi (#4573)

2024-05-08 09:19:58 -07:00

__init__.py

[Core][5/N] Fully working chunked prefill e2e (#3884)

2024-04-10 17:56:48 -07:00

layer.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

selector.py

[Kernel] Use flashinfer for decoding (#4353)

2024-05-03 15:51:27 -07:00