57 Commits

Author	SHA1	Message	Date
comfyanonymous	33e584b3bc	Make it possible to load tokenizer data from checkpoints.	2024-07-24 16:43:53 -04:00
comfyanonymous	fe94df0894	Support MT5.	2024-07-23 15:35:28 -04:00
comfyanonymous	f5ebfaba43	Allow SPieceTokenizer to load model from a byte string.	2024-07-23 14:17:42 -04:00
comfyanonymous	a7f1068957	Rename LLAMATokenizer to SPieceTokenizer.	2024-07-22 12:21:45 -04:00
comfyanonymous	553fbe3407	Refactor: Move some code to the comfy/text_encoders folder.	2024-07-15 17:36:24 -04:00
comfyanonymous	edce34f55e	Better tokenizing code for AuraFlow.	2024-07-12 01:15:25 -04:00
comfyanonymous	4c066c4bc4	AuraFlow model implementation.	2024-07-11 16:52:26 -04:00