261 Commits

Author	SHA1	Message	Date
Ikko Eltociear Ashimine	805de738f6	Fix typo in tokenizer.py (#750) ... conjuction -> conjunction	2023-08-14 22:26:36 -07:00
Qing	a57d13cc96	add QWen-7b (#685) ... Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>	2023-08-08 13:50:38 -07:00
Zhuohan Li	1b0bd0fe8a	Add Falcon support (new) (#592)	2023-08-02 14:04:39 -07:00
codethazine	20b0d88d16	Add support for baichuan (#365)	2023-07-17 13:50:55 -07:00
xcnick	c6dfc3cdbe	Fix handling of special tokens in decoding. (#418)	2023-07-12 11:14:56 -04:00
Woosuk Kwon	ddfdf470ae	Add trust_remote_code arg to get_config (#405)	2023-07-08 15:24:17 -07:00
codethazine	a945fcc2ae	Add trust-remote-code flag to handle remote tokenizers (#364)	2023-07-07 11:04:58 -07:00
Woosuk Kwon	404422f42e	[Model] Add support for MPT (#334)	2023-07-03 16:47:53 -07:00
Zhuohan Li	d6fa1be3a8	[Quality] Add code formatter and linter (#326)	2023-07-03 11:31:55 -07:00
Woosuk Kwon	998d9d1509	[Tokenizer] Add tokenizer mode (#298)	2023-06-28 14:19:22 -07:00
Woosuk Kwon	4338cc4750	[Tokenizer] Add an option to specify tokenizer (#284)	2023-06-28 09:46:58 -07:00