5 Commits

Author	SHA1	Message	Date
Lily Liu	43c413ec57	[Kernel] Use flashinfer for decoding (#4353) ... Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>	2024-05-03 15:51:27 -07:00
SangBin Cho	01bfb22b41	[CI] Try introducing isort. (#3495)	2024-03-25 07:59:47 -07:00
zhaoyang-star	9090bf02e7	Support FP8-E5M2 KV Cache (#2279) ... Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn> Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>	2024-01-28 16:43:54 -08:00
Jee Li	77af974b40	[FIX] Support non-zero CUDA devices in custom kernels (#1959)	2024-01-02 19:09:59 -08:00
Woosuk Kwon	fbd80ad409	Clean up kernel unit tests (#938)	2023-09-05 16:57:38 -07:00