5 Commits

Author	SHA1	Message	Date
SangBin Cho	6e435de766	[1/n][Chunked Prefill] Refactor input query shapes (#3236)	2024-03-20 14:46:05 -07:00
Zhuohan Li	2f8844ba08	Re-enable the 80 char line width limit (#3305)	2024-03-10 19:49:14 -07:00
Zhuohan Li	f48c6791b7	[FIX] Fix prefix test error on main (#3286)	2024-03-08 17:16:14 -08:00
Woosuk Kwon	1cb0cc2975	[FIX] Make flash_attn optional (#3269)	2024-03-08 10:52:20 -08:00
Woosuk Kwon	2daf23ab0c	Separate attention backends (#3005)	2024-03-07 01:45:50 -08:00