73 Commits

Author SHA1 Message Date
comfyanonymous
4358515768 Fix issue with loras, lowvram and --fast fp8. 2024-09-28 14:42:32 -04:00
comfyanonymous
29c18d1e69 get_key_patches now works without unloading the model. 2024-09-17 01:57:59 -04:00
comfyanonymous
16568f960c types -> comfy_types to fix import issue. 2024-09-12 03:57:46 -04:00
comfyanonymous
f2a13e96b4 Make the stochastic fp8 rounding reproducible. 2024-08-26 15:12:06 -04:00
comfyanonymous
0144d62aa9 Fix potential memory leak. 2024-08-26 02:07:32 -04:00
comfyanonymous
49cd4f5123 Fix dora. 2024-08-23 04:58:59 -04:00
comfyanonymous
59d0907512 Move calculate function to comfy.lora 2024-08-22 17:12:00 -04:00
comfyanonymous
23836e6596 Code cleanups. 2024-08-22 17:05:12 -04:00
comfyanonymous
f2d98aa557 Bug fixes. 2024-08-19 16:28:55 -04:00
comfyanonymous
0f356a9212 Use better dtype for the lowvram lora system. 2024-08-19 15:35:25 -04:00
comfyanonymous
48335ad8ca Remove duplication. 2024-08-19 15:26:50 -04:00
comfyanonymous
939c35d580 Code cleanup. 2024-08-19 12:48:59 -04:00
comfyanonymous
1fb6ab1bcd Fix loras having a weak effect when applied on fp8. 2024-08-17 15:20:17 -04:00
comfyanonymous
6e3ba4f578 calculate_weight function to use a different dtype. 2024-08-17 01:06:08 -04:00
comfyanonymous
bd13b4c6f5 Fix potential lowvram issue. 2024-08-16 17:12:42 -04:00
comfyanonymous
a552dfba70 Fix some issues with TE being in lowvram mode. 2024-08-12 23:42:21 -04:00
comfyanonymous
c58216564d Fix some issues with the model sometimes not getting patched. 2024-08-12 12:27:54 -04:00
comfyanonymous
446d2ce502 Fix some lora loading slowdowns. 2024-08-12 11:50:32 -04:00
comfyanonymous
14ff1639db Change name of log. 2024-08-12 10:35:06 -04:00
comfyanonymous
cbb1bde521 Fix some issues with inference slowing down. 2024-08-10 16:21:25 -04:00
comfyanonymous
075b187132 Fix regression. 2024-08-09 14:02:38 -04:00
comfyanonymous
4d842f2344 Better fix for lowvram issue. 2024-08-09 12:16:25 -04:00
comfyanonymous
502ace54a4 Fix issue with some lowvram weights. 2024-08-09 03:58:28 -04:00
comfyanonymous
37d704b5d6 Better prints. 2024-08-08 17:29:27 -04:00
comfyanonymous
ede5622146 Partial model shift support. 2024-08-08 14:45:06 -04:00
comfyanonymous
57697eb7cf Workaround for lora OOM on lowvram mode. 2024-08-07 14:30:54 -04:00
comfyanonymous
001ff4d6a6 Fix OOMs happening in some cases.
A cloned model patcher sometimes reported a model was loaded on a device
when it wasn't.
2024-08-06 13:36:04 -04:00
Extraltodeus
e02530182b Add sampler_pre_cfg_function (#3979)
* Update samplers.py

* Update model_patcher.py
2024-07-09 16:20:49 -04:00
comfyanonymous
43694c43b2 Add SamplerEulerCFG++ node.
This node should match the DDIM implementation of CFG++ when "regular" is
selected.

"alternative" is a slightly different take on CFG++
2024-06-23 13:21:18 -04:00
comfyanonymous
aeac10ce20 Fix issue with full diffusers SD3 loras. 2024-06-19 22:32:04 -04:00
comfyanonymous
8dbd876a23 Print key names for easier debugging. 2024-06-14 18:18:53 -04:00
comfyanonymous
468f9b8d49 Support setting weight offsets in weight patcher. 2024-06-13 17:21:26 -04:00
comfyanonymous
5eb529ced1 Remove useless code. 2024-06-02 19:23:37 -04:00
comfyanonymous
358f3230d4 Fix DORA strength.
This is a different version of #3298 with more correct behavior.
2024-05-25 02:50:11 -04:00
comfyanonymous
8ece946997 Reduce memory usage when applying DORA: #3557 2024-05-24 23:36:48 -04:00
Chenlei Hu
cc9c2a3144 Add type annotation UnetWrapperFunction (#3531)
* Add type annotation UnetWrapperFunction

* nit

* Add types.py
2024-05-22 02:07:27 -04:00
comfyanonymous
affe07f17d Fix lowvram dora issue. 2024-05-15 02:47:40 -04:00
comfyanonymous
43079b39cd Fix lowvram issue with saving checkpoints.
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
2024-05-12 06:13:45 -04:00
comfyanonymous
ae31a1b885 Fix issue with lowvram mode breaking model saving. 2024-05-11 21:55:20 -04:00
comfyanonymous
0c38c2d09c Add basic PAG node. 2024-04-14 23:49:50 -04:00
kk-89
a9c852912f Fix typo in lowvram patcher (#3209) 2024-04-05 12:02:13 -04:00
comfyanonymous
897d5b6569 Fix object_patches_backup not being the same object across clones. 2024-04-05 00:22:44 -04:00
comfyanonymous
50463b3e5a Fix issue with get_model_object on patched model. 2024-04-04 23:01:02 -04:00
comfyanonymous
22462103f3 Fix model needing to be loaded on GPU to generate the sigmas. 2024-04-04 22:08:49 -04:00
comfyanonymous
ec14272c0a dora_scale support for lora file. 2024-03-25 18:09:23 -04:00
comfyanonymous
1681937288 Don't unload model weights for non weight patches. 2024-03-20 02:27:58 -04:00
comfyanonymous
7e04cdafc0 Lower memory usage for loras in lowvram mode at the cost of perf. 2024-03-13 20:07:27 -04:00
comfyanonymous
35d0fd9a5d Replace prints with logging and add --verbose argument. 2024-03-10 12:14:23 -04:00
comfyanonymous
03ccdd76a7 Simplify differential diffusion code. 2024-03-03 15:34:42 -05:00
comfyanonymous
e7fb76e67b utils.set_attr can now be used to set any attribute.
The old set_attr has been renamed to set_attr_param.
2024-03-02 17:27:23 -05:00