7 Commits

Author	SHA1	Message	Date
comfyanonymous	df67f25c28	More flexible long clip support. ... Add clip g long clip support. Text encoder refactor. Support llama models with different vocab sizes.	2025-04-15 10:32:21 -04:00
comfyanonymous	03c874ec6e	Add model_options for text encoder.	2024-08-17 11:17:20 -04:00
comfyanonymous	33e584b3bc	Make it possible to load tokenizer data from checkpoints.	2024-07-24 16:43:53 -04:00
comfyanonymous	a7f1068957	Rename LLAMATokenizer to SPieceTokenizer.	2024-07-22 12:21:45 -04:00
comfyanonymous	553fbe3407	Refactor: Move some code to the comfy/text_encoders folder.	2024-07-15 17:36:24 -04:00
comfyanonymous	edce34f55e	Better tokenizing code for AuraFlow.	2024-07-12 01:15:25 -04:00
comfyanonymous	4c066c4bc4	AuraFlow model implementation.	2024-07-11 16:52:26 -04:00