9 Commits

Author	SHA1	Message	Date
Woosuk Kwon	6208d622ca	Minor code cleaning for SamplingParams (#99)	2023-05-12 18:07:09 -07:00
Woosuk Kwon	42f1042e1c	Enhance SamplingParams (#96)	2023-05-11 15:45:30 -07:00
Woosuk Kwon	55f8b0a5de	Implement presence and frequency penalties (#95)	2023-05-10 23:39:12 -07:00
Woosuk Kwon	9f88db35da	Support top-k sampling (#94)	2023-05-10 12:51:36 -07:00
Woosuk Kwon	8d66a7b6d7	Rename variables and methods (#91)	2023-05-10 00:58:31 -07:00
Zhuohan Li	721fa3df15	FastAPI-based working frontend (#10)	2023-03-29 14:48:56 +08:00
Woosuk Kwon	1a7eb7da61	Support beam search & parallel generation (#7)	2023-03-10 09:58:21 -08:00
Woosuk Kwon	46ce1356f7	Add max_num_steps to SamplingParams	2023-02-24 11:44:40 +00:00
Woosuk Kwon	501c4bd0cd	decoding.py -> sampling_params.py	2023-02-23 07:39:20 +00:00