Lily Liu 43c413ec57

[Kernel] Use flashinfer for decoding (#4353) ...

Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>

2024-05-03 15:51:27 -07:00

..

backends

[Kernel] Use flashinfer for decoding (#4353)

2024-05-03 15:51:27 -07:00

ops

[Core][Model runner refactoring 1/N] Refactor attn metadata term (#4518)

2024-05-03 10:20:12 -07:00

__init__.py

[Core][5/N] Fully working chunked prefill e2e (#3884)

2024-04-10 17:56:48 -07:00

layer.py

[Misc]Add customized information for models (#4132)

2024-04-30 21:18:14 -07:00

selector.py

[Kernel] Use flashinfer for decoding (#4353)

2024-05-03 15:51:27 -07:00