11 Commits

Author	SHA1	Message	Date
Woosuk Kwon	de0fabbc5c	Fix sampler	2023-02-23 20:30:12 +00:00
Woosuk Kwon	fdd0f2f472	Minor	2023-02-23 20:23:47 +00:00
Woosuk Kwon	7f985166f7	Consider pempty tensor	2023-02-23 20:20:33 +00:00
Woosuk Kwon	86f9eb6d39	Fix typo	2023-02-23 20:19:24 +00:00
Woosuk Kwon	d4bc1a4d24	Add unoptimized OPT Attention	2023-02-23 09:31:55 +00:00
Woosuk Kwon	b56b6ca0d6	Add greedy sampler	2023-02-23 09:26:09 +00:00
Woosuk Kwon	343cea3dbc	Add seq_ids to input metadata	2023-02-23 09:25:01 +00:00
Woosuk Kwon	4b1ac23f53	Fix slot mapping	2023-02-23 00:10:07 +00:00
Woosuk Kwon	7b6844e590	Add input metadata	2023-02-22 19:01:20 +00:00
Woosuk Kwon	608f74ffe5	Minor	2023-02-22 18:08:25 +00:00
Woosuk Kwon	709a69176e	Move worker/models -> models	2023-02-22 18:03:48 +00:00