9 Commits

Author	SHA1	Message	Date
Woosuk Kwon	897cb2ae28	Optimize data movement (#20)	2023-04-02 00:30:17 -07:00
Zhuohan Li	2f49f15585	Support tensor parallel (#2)	2023-03-21 13:45:42 -07:00
Woosuk Kwon	1a7eb7da61	Support beam search & parallel generation (#7)	2023-03-10 09:58:21 -08:00
Woosuk Kwon	04e5acc08e	Fix a bug in 1D input shape (#5)	2023-03-06 10:05:27 -08:00
Woosuk Kwon	932844f1cd	Fix attention	2023-02-23 23:02:25 +00:00
Woosuk Kwon	7f985166f7	Consider pempty tensor	2023-02-23 20:20:33 +00:00
Woosuk Kwon	343cea3dbc	Add seq_ids to input metadata	2023-02-23 09:25:01 +00:00
Woosuk Kwon	4b1ac23f53	Fix slot mapping	2023-02-23 00:10:07 +00:00
Woosuk Kwon	7b6844e590	Add input metadata	2023-02-22 19:01:20 +00:00