17 Commits

Author	SHA1	Message	Date
Woosuk Kwon	762fd1c3fa	Refactor and annotate types for attention	2023-02-24 08:58:46 +00:00
Woosuk Kwon	7f22f90e8c	Remove xformers	2023-02-24 08:36:16 +00:00
Woosuk Kwon	932844f1cd	Fix attention	2023-02-23 23:02:25 +00:00
Woosuk Kwon	ba84b8728a	Fix attention	2023-02-23 22:29:46 +00:00
Woosuk Kwon	87e0bcd426	Fix attention	2023-02-23 21:32:02 +00:00
Woosuk Kwon	1ce1333573	Set default dtype to half	2023-02-23 21:31:39 +00:00
Woosuk Kwon	de0fabbc5c	Fix sampler	2023-02-23 20:30:12 +00:00
Woosuk Kwon	fdd0f2f472	Minor	2023-02-23 20:23:47 +00:00
Woosuk Kwon	7f985166f7	Consider pempty tensor	2023-02-23 20:20:33 +00:00
Woosuk Kwon	86f9eb6d39	Fix typo	2023-02-23 20:19:24 +00:00
Woosuk Kwon	d4bc1a4d24	Add unoptimized OPT Attention	2023-02-23 09:31:55 +00:00
Woosuk Kwon	b56b6ca0d6	Add greedy sampler	2023-02-23 09:26:09 +00:00
Woosuk Kwon	343cea3dbc	Add seq_ids to input metadata	2023-02-23 09:25:01 +00:00
Woosuk Kwon	4b1ac23f53	Fix slot mapping	2023-02-23 00:10:07 +00:00
Woosuk Kwon	7b6844e590	Add input metadata	2023-02-22 19:01:20 +00:00
Woosuk Kwon	608f74ffe5	Minor	2023-02-22 18:08:25 +00:00
Woosuk Kwon	709a69176e	Move worker/models -> models	2023-02-22 18:03:48 +00:00