41 Commits

Author SHA1 Message Date
comfyanonymous
5eb529ced1 Remove useless code. 2024-06-02 19:23:37 -04:00
comfyanonymous
358f3230d4 Fix DORA strength.
This is a different version of #3298 with more correct behavior.
2024-05-25 02:50:11 -04:00
comfyanonymous
8ece946997 Reduce memory usage when applying DORA: #3557 2024-05-24 23:36:48 -04:00
Chenlei Hu
cc9c2a3144 Add type annotation UnetWrapperFunction (#3531)
* Add type annotation UnetWrapperFunction

* nit

* Add types.py
2024-05-22 02:07:27 -04:00
comfyanonymous
affe07f17d Fix lowvram dora issue. 2024-05-15 02:47:40 -04:00
comfyanonymous
43079b39cd Fix lowvram issue with saving checkpoints.
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
2024-05-12 06:13:45 -04:00
comfyanonymous
ae31a1b885 Fix issue with lowvram mode breaking model saving. 2024-05-11 21:55:20 -04:00
comfyanonymous
0c38c2d09c Add basic PAG node. 2024-04-14 23:49:50 -04:00
kk-89
a9c852912f Fix typo in lowvram patcher (#3209) 2024-04-05 12:02:13 -04:00
comfyanonymous
897d5b6569 Fix object_patches_backup not being the same object across clones. 2024-04-05 00:22:44 -04:00
comfyanonymous
50463b3e5a Fix issue with get_model_object on patched model. 2024-04-04 23:01:02 -04:00
comfyanonymous
22462103f3 Fix model needing to be loaded on GPU to generate the sigmas. 2024-04-04 22:08:49 -04:00
comfyanonymous
ec14272c0a dora_scale support for lora file. 2024-03-25 18:09:23 -04:00
comfyanonymous
1681937288 Don't unload model weights for non weight patches. 2024-03-20 02:27:58 -04:00
comfyanonymous
7e04cdafc0 Lower memory usage for loras in lowvram mode at the cost of perf. 2024-03-13 20:07:27 -04:00
comfyanonymous
35d0fd9a5d Replace prints with logging and add --verbose argument. 2024-03-10 12:14:23 -04:00
comfyanonymous
03ccdd76a7 Simplify differential diffusion code. 2024-03-03 15:34:42 -05:00
comfyanonymous
e7fb76e67b utils.set_attr can now be used to set any attribute.
The old set_attr has been renamed to set_attr_param.
2024-03-02 17:27:23 -05:00
comfyanonymous
b5931a324c Let model patches patch sub objects. 2024-03-02 11:43:27 -05:00
comfyanonymous
004cf09984 Fix model patches not working in custom sampling scheduler nodes. 2024-01-03 12:16:30 -05:00
comfyanonymous
7602677b54 Use function to calculate model size in model patcher. 2023-12-28 21:46:20 -05:00
comfyanonymous
bf90151704 Fix SAG not working with cfg 1.0 2023-12-18 17:03:32 -05:00
comfyanonymous
b83523b241 Refactor and improve the sag node.
Moved all the sag related code to comfy_extras/nodes_sag.py
2023-12-13 16:11:26 -05:00
comfyanonymous
733ff9e5ab Implement GLora. 2023-12-09 18:15:26 -05:00
comfyanonymous
4d9a8c68bd Make lora code a bit cleaner. 2023-12-09 14:15:09 -05:00
comfyanonymous
7676c8f41a Make deep shrink behave like it should. 2023-11-16 15:26:28 -05:00
comfyanonymous
3d07161f42 Fix potential issues. 2023-11-16 14:59:54 -05:00
comfyanonymous
f6333be536 Add a way to add patches to the input block. 2023-11-14 00:08:12 -05:00
comfyanonymous
21ea9c3263 Allow different models to estimate memory usage differently. 2023-11-12 04:03:52 -05:00
comfyanonymous
3520471621 Fix bug. 2023-11-11 12:20:16 -05:00
comfyanonymous
b8824accfa Add option to use in place weight updating in ModelPatcher. 2023-11-11 01:11:12 -05:00
comfyanonymous
67744beb00 Fix model merge bug.
Unload models before getting weights for model patching.
2023-11-10 03:19:05 -05:00
comfyanonymous
7b2806fee6 Fix issue with object patches not being copied with patcher. 2023-11-07 22:15:15 -05:00
comfyanonymous
4d21372152 Add: advanced->model->ModelSamplingDiscrete node.
This allows changing the sampling parameters of the model (eps or vpred)
or set the model to use zsnr.
2023-11-07 03:28:53 -05:00
gameltb
b7d50f3d80 fix unet_wrapper_function name in ModelPatcher 2023-11-05 17:11:44 +08:00
comfyanonymous
e095eadda5 Let unet wrapper functions have .to attributes. 2023-10-11 01:34:38 -04:00
comfyanonymous
a990441ba0 Add a way to set output block patches to modify the h and hsp. 2023-09-22 20:26:47 -04:00
comfyanonymous
795f5b3163 Only do the cast on the device if the device supports it. 2023-09-20 17:52:41 -04:00
comfyanonymous
a6511d69b0 Do lora cast on GPU instead of CPU for higher performance. 2023-09-18 23:04:49 -04:00
Simon Lui
c902fd7505 Fix error message in model_patcher.py
Found while tinkering.
2023-08-30 00:25:04 -07:00
comfyanonymous
201631e61d Move ModelPatcher to model_patcher.py 2023-08-28 14:51:31 -04:00