34 Commits

Author SHA1 Message Date
comfyanonymous
b04064af86 Add simpletuner lycoris format for SD unet. 2024-09-30 06:03:27 -04:00
comfyanonymous
25ecfd9295 Fix model merging issue. 2024-09-20 02:31:44 -04:00
comfyanonymous
8690bb10f0 Fix lora issue. 2024-09-08 10:10:47 -04:00
comfyanonymous
035e8c218c Support onetrainer text encoder Flux lora. 2024-09-08 09:31:41 -04:00
comfyanonymous
f45e0da17d Support a generic Comfy format for text encoder loras.
This is a format with keys like:
text_encoders.clip_l.transformer.text_model.encoder.layers.9.self_attn.v_proj.lora_up.weight

Instead of waiting for me to add support for specific lora formats you can
convert your text encoder loras to this format instead.

If you want to see an example save a text encoder lora with the SaveLora
node with the commit right after this one.
2024-09-07 02:20:39 -04:00
comfyanonymous
e86a521904 Support newer glora format. 2024-09-03 17:02:19 -04:00
comfyanonymous
8fe38e1bbf Flux onetrainer lora. 2024-09-02 08:22:15 -04:00
comfyanonymous
ece9de35de Fix glora lowvram issue. 2024-08-29 19:07:23 -04:00
Chenlei Hu
2f6fe893b3 Support weight padding on diff weight patch (#4576) 2024-08-27 13:55:37 -04:00
comfyanonymous
49cd4f5123 Fix dora. 2024-08-23 04:58:59 -04:00
comfyanonymous
c6f6298c52 Missing imports. 2024-08-22 17:20:51 -04:00
comfyanonymous
59d0907512 Move calculate function to comfy.lora 2024-08-22 17:12:00 -04:00
comfyanonymous
8addad7f2c Simpletrainer lycoris format. 2024-08-20 12:05:13 -04:00
comfyanonymous
90c65ed934 Implement text encoder part of HunyuanDiT loras. 2024-08-09 03:21:10 -04:00
comfyanonymous
25bcb846a8 Fix "Comfy" lora keys.
They are in this format now:
diffusion_model.full.model.key.name.lora_up.weight
2024-08-07 13:49:31 -04:00
comfyanonymous
a6d6c2d378 Support for "Comfy" lora format.
The keys are just: model.full.model.key.name.lora_up.weight

It is supported by all comfyui supported models.

Now people can just convert loras to this format instead of having to ask
for me to implement them.
2024-08-07 13:18:32 -04:00
comfyanonymous
261c6ba855 Support simple diffusers Flux loras. 2024-08-04 22:05:48 -04:00
comfyanonymous
080a8326a3 Hunyuan DiT lora support. 2024-07-25 22:42:54 -04:00
comfyanonymous
29c17be75e Support AuraFlow Lora and loading model weights in diffusers format.
You can load model weights in diffusers format using the UNETLoader node.
2024-07-13 13:51:40 -04:00
comfyanonymous
26af0384a0 Support OneTrainer SD3 lora format. 2024-06-22 13:08:04 -04:00
comfyanonymous
ffc4037b46 Support full SD3 loras. 2024-06-19 10:13:33 -04:00
Janek Mann
95028b4402 Fix lora keys for SimpleTuner (#3759) 2024-06-17 07:55:06 -04:00
comfyanonymous
77b1aa430f Support SD3 diffusers lora. 2024-06-13 18:26:10 -04:00
comfyanonymous
ec14272c0a dora_scale support for lora file. 2024-03-25 18:09:23 -04:00
comfyanonymous
35d0fd9a5d Replace prints with logging and add --verbose argument. 2024-03-10 12:14:23 -04:00
comfyanonymous
766b45c2c1 Always return unprojected pooled output for gligen. 2024-02-25 07:33:13 -05:00
comfyanonymous
c2c8c2e398 Support text encoder text_projection in lora. 2024-02-24 23:50:46 -05:00
comfyanonymous
011603557d Support lora keys with lora_prior_unet_ and lora_prior_te_ 2024-02-23 12:21:20 -05:00
comfyanonymous
733ff9e5ab Implement GLora. 2023-12-09 18:15:26 -05:00
comfyanonymous
4d9a8c68bd Make lora code a bit cleaner. 2023-12-09 14:15:09 -05:00
comfyanonymous
591d338ce3 Add support for full diff lora keys. 2023-11-08 22:05:31 -05:00
comfyanonymous
3ad424ff47 SD1 and SD2 clip and tokenizer code is now more similar to the SDXL one. 2023-10-27 15:54:04 -04:00
comfyanonymous
daae7db069 Implement loras with norm keys. 2023-08-28 11:20:06 -04:00
comfyanonymous
7fb8cbb5ac Move lora code to comfy/lora.py 2023-08-25 17:11:51 -04:00