807 Commits

Author SHA1 Message Date
comfyanonymous
358f3230d4 Fix DORA strength.
This is a different version of #3298 with more correct behavior.
2024-05-25 02:50:11 -04:00
comfyanonymous
8ece946997 Reduce memory usage when applying DORA: #3557 2024-05-24 23:36:48 -04:00
comfyanonymous
94a508adc2 Fix OSX latent2rgb previews. 2024-05-22 13:56:28 -04:00
Chenlei Hu
cc9c2a3144 Add type annotation UnetWrapperFunction (#3531)
* Add type annotation UnetWrapperFunction

* nit

* Add types.py
2024-05-22 02:07:27 -04:00
comfyanonymous
bdbaa4491c Work around black image bug on Mac 14.5 by forcing attention upcasting. 2024-05-21 16:56:33 -04:00
comfyanonymous
e0c00cac39 Disable xformers when tracing model. 2024-05-21 13:55:49 -04:00
comfyanonymous
a8c173cc1b Fix potential issue. 2024-05-20 08:19:54 -04:00
comfyanonymous
bcc5cd02c7 Log the pytorch version. 2024-05-20 06:22:29 -04:00
comfyanonymous
fc6cc5fafc Fix controlnet not upcasting on models that have it enabled. 2024-05-19 17:58:03 -04:00
comfyanonymous
c19335f030 Cleanup. 2024-05-18 10:11:44 -04:00
comfyanonymous
fddf60ebb7 Remove unnecessary code. 2024-05-18 09:36:44 -04:00
comfyanonymous
367f84be8d Don't automatically switch to lowvram mode on GPUs with low memory. 2024-05-17 00:31:32 -04:00
comfyanonymous
e2d71cc7b6 Add debug options to force on and off attention upcasting. 2024-05-16 04:09:41 -04:00
comfyanonymous
affe07f17d Fix lowvram dora issue. 2024-05-15 02:47:40 -04:00
comfyanonymous
e02598e417 Fix SAG. 2024-05-14 18:02:27 -04:00
comfyanonymous
d4db823cfe Only enable attention upcasting on models that actually need it. 2024-05-14 17:00:50 -04:00
comfyanonymous
89e38bcd63 Refactor attention upcasting code part 1. 2024-05-14 12:47:31 -04:00
Simon Lui
4cd1bc2cce Fix Intel GPU memory allocation accuracy and documentation update. (#3459)
* Change calculation of memory total to be more accurate, allocated is actually smaller than reserved.

* Update README.md install documentation for Intel GPUs.
2024-05-12 06:36:30 -04:00
comfyanonymous
43079b39cd Fix lowvram issue with saving checkpoints.
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
2024-05-12 06:13:45 -04:00
comfyanonymous
397b840846 No longer necessary. 2024-05-12 05:34:43 -04:00
comfyanonymous
ae31a1b885 Fix issue with lowvram mode breaking model saving. 2024-05-11 21:55:20 -04:00
comfyanonymous
c655ec59dc Remove warnings that confuse people. 2024-05-09 05:29:42 -04:00
comfyanonymous
bcc865f6ac Typo fix. 2024-05-08 18:36:56 -04:00
comfyanonymous
d90e593478 Make the load checkpoint with config function call the regular one.
I was going to completely remove this function because it is unmaintainable
but I think this is the best compromise.

The clip skip and v_prediction parts of the configs should still work but
not the fp16 vs fp32.
2024-05-06 20:04:39 -04:00
Simon Lui
87e7b35146 Change torch.xpu to ipex.optimize, xpu device initialization and remove workaround for text node issue from older IPEX. (#3388) 2024-05-02 03:26:50 -04:00
comfyanonymous
b04267ce30 Fix some edge cases with samplers and arrays with a single sigma. 2024-05-01 17:05:30 -04:00
comfyanonymous
95e80c5df1 Workaround xformers bug. 2024-04-30 21:23:40 -04:00
Garrett Sutula
533ddd78a0 Add TLS Support (#3312)
* Add TLS Support

* Add to readme

* Add guidance for windows users on generating certificates

* Add guidance for windows users on generating certificates

* Fix typo
2024-04-30 20:17:02 -04:00
Jedrzej Kosinski
7a37c3088d Fix error when more cond masks passed in than batch size (#3353) 2024-04-26 12:51:12 -04:00
comfyanonymous
e7cd70ed48 Don't init a VAE model when there are no VAE weights. 2024-04-24 09:20:31 -04:00
comfyanonymous
918d7520c3 Support VAE without quant_conv. 2024-04-18 21:05:33 -04:00
comfyanonymous
0c38c2d09c Add basic PAG node. 2024-04-14 23:49:50 -04:00
comfyanonymous
982b8e2276 Fix some memory related issues. 2024-04-14 12:08:58 -04:00
comfyanonymous
4c7f73bb85 Support SDXS 512 model. 2024-04-12 22:12:35 -04:00
comfyanonymous
6334ac514b Fix issue with sampling_settings persisting across models. 2024-04-09 23:20:43 -04:00
comfyanonymous
ef332e5355 Support properly saving CosXL checkpoints. 2024-04-08 00:36:22 -04:00
comfyanonymous
d93e3f1991 Fix issue with controlnet models getting loaded multiple times. 2024-04-06 18:38:39 -04:00
kk-89
a9c852912f Fix typo in lowvram patcher (#3209) 2024-04-05 12:02:13 -04:00
comfyanonymous
bc8bef3daa Support for CosXL models. 2024-04-05 10:53:41 -04:00
comfyanonymous
897d5b6569 Fix object_patches_backup not being the same object across clones. 2024-04-05 00:22:44 -04:00
comfyanonymous
c618084a1c Fix missing arguments in cfg_function. 2024-04-04 23:38:57 -04:00
comfyanonymous
50463b3e5a Fix issue with get_model_object on patched model. 2024-04-04 23:01:02 -04:00
comfyanonymous
22462103f3 Fix model needing to be loaded on GPU to generate the sigmas. 2024-04-04 22:08:49 -04:00
comfyanonymous
58a02039bc Make zero denoise a NOP. 2024-04-04 11:41:27 -04:00
comfyanonymous
1f511af362 Small cleanup. 2024-04-04 11:16:49 -04:00
comfyanonymous
bcb4f07071 Refactor sampler code for more advanced sampler nodes part 2. 2024-04-04 01:26:41 -04:00
comfyanonymous
f9e7f0e695 Refactor sampling code for more advanced sampler nodes. 2024-04-03 22:09:51 -04:00
comfyanonymous
41f74d8e93 Fix saving text encoder in fp8. 2024-04-02 11:46:34 -04:00
comfyanonymous
1ba93001e4 Refactor calc_cond_uncond_batch into calc_cond_batch.
calc_cond_batch can take an arbitrary amount of cond inputs.

Added a calc_cond_uncond_batch wrapper with a warning so custom nodes
won't break.
2024-04-01 18:07:47 -04:00
comfyanonymous
284361ba73 IP2P model loading support.
This is the code to load the model and inference it with only a text
prompt. This commit does not contain the nodes to properly use it with an
image input.

This supports both the original SD1 instructpix2pix model and the
diffusers SDXL one.
2024-03-31 03:10:28 -04:00