798 Commits

Author SHA1 Message Date
comfyanonymous
c19335f030 Cleanup. 2024-05-18 10:11:44 -04:00
comfyanonymous
fddf60ebb7 Remove unnecessary code. 2024-05-18 09:36:44 -04:00
comfyanonymous
367f84be8d Don't automatically switch to lowvram mode on GPUs with low memory. 2024-05-17 00:31:32 -04:00
comfyanonymous
e2d71cc7b6 Add debug options to force on and off attention upcasting. 2024-05-16 04:09:41 -04:00
comfyanonymous
affe07f17d Fix lowvram dora issue. 2024-05-15 02:47:40 -04:00
comfyanonymous
e02598e417 Fix SAG. 2024-05-14 18:02:27 -04:00
comfyanonymous
d4db823cfe Only enable attention upcasting on models that actually need it. 2024-05-14 17:00:50 -04:00
comfyanonymous
89e38bcd63 Refactor attention upcasting code part 1. 2024-05-14 12:47:31 -04:00
Simon Lui
4cd1bc2cce Fix Intel GPU memory allocation accuracy and documentation update. (#3459)
* Change calculation of memory total to be more accurate, allocated is actually smaller than reserved.

* Update README.md install documentation for Intel GPUs.
2024-05-12 06:36:30 -04:00
comfyanonymous
43079b39cd Fix lowvram issue with saving checkpoints.
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
2024-05-12 06:13:45 -04:00
comfyanonymous
397b840846 No longer necessary. 2024-05-12 05:34:43 -04:00
comfyanonymous
ae31a1b885 Fix issue with lowvram mode breaking model saving. 2024-05-11 21:55:20 -04:00
comfyanonymous
c655ec59dc Remove warnings that confuse people. 2024-05-09 05:29:42 -04:00
comfyanonymous
bcc865f6ac Typo fix. 2024-05-08 18:36:56 -04:00
comfyanonymous
d90e593478 Make the load checkpoint with config function call the regular one.
I was going to completely remove this function because it is unmaintainable
but I think this is the best compromise.

The clip skip and v_prediction parts of the configs should still work but
not the fp16 vs fp32.
2024-05-06 20:04:39 -04:00
Simon Lui
87e7b35146 Change torch.xpu to ipex.optimize, xpu device initialization and remove workaround for text node issue from older IPEX. (#3388) 2024-05-02 03:26:50 -04:00
comfyanonymous
b04267ce30 Fix some edge cases with samplers and arrays with a single sigma. 2024-05-01 17:05:30 -04:00
comfyanonymous
95e80c5df1 Workaround xformers bug. 2024-04-30 21:23:40 -04:00
Garrett Sutula
533ddd78a0 Add TLS Support (#3312)
* Add TLS Support

* Add to readme

* Add guidance for windows users on generating certificates

* Add guidance for windows users on generating certificates

* Fix typo
2024-04-30 20:17:02 -04:00
Jedrzej Kosinski
7a37c3088d Fix error when more cond masks passed in than batch size (#3353) 2024-04-26 12:51:12 -04:00
comfyanonymous
e7cd70ed48 Don't init a VAE model when there are no VAE weights. 2024-04-24 09:20:31 -04:00
comfyanonymous
918d7520c3 Support VAE without quant_conv. 2024-04-18 21:05:33 -04:00
comfyanonymous
0c38c2d09c Add basic PAG node. 2024-04-14 23:49:50 -04:00
comfyanonymous
982b8e2276 Fix some memory related issues. 2024-04-14 12:08:58 -04:00
comfyanonymous
4c7f73bb85 Support SDXS 512 model. 2024-04-12 22:12:35 -04:00
comfyanonymous
6334ac514b Fix issue with sampling_settings persisting across models. 2024-04-09 23:20:43 -04:00
comfyanonymous
ef332e5355 Support properly saving CosXL checkpoints. 2024-04-08 00:36:22 -04:00
comfyanonymous
d93e3f1991 Fix issue with controlnet models getting loaded multiple times. 2024-04-06 18:38:39 -04:00
kk-89
a9c852912f Fix typo in lowvram patcher (#3209) 2024-04-05 12:02:13 -04:00
comfyanonymous
bc8bef3daa Support for CosXL models. 2024-04-05 10:53:41 -04:00
comfyanonymous
897d5b6569 Fix object_patches_backup not being the same object across clones. 2024-04-05 00:22:44 -04:00
comfyanonymous
c618084a1c Fix missing arguments in cfg_function. 2024-04-04 23:38:57 -04:00
comfyanonymous
50463b3e5a Fix issue with get_model_object on patched model. 2024-04-04 23:01:02 -04:00
comfyanonymous
22462103f3 Fix model needing to be loaded on GPU to generate the sigmas. 2024-04-04 22:08:49 -04:00
comfyanonymous
58a02039bc Make zero denoise a NOP. 2024-04-04 11:41:27 -04:00
comfyanonymous
1f511af362 Small cleanup. 2024-04-04 11:16:49 -04:00
comfyanonymous
bcb4f07071 Refactor sampler code for more advanced sampler nodes part 2. 2024-04-04 01:26:41 -04:00
comfyanonymous
f9e7f0e695 Refactor sampling code for more advanced sampler nodes. 2024-04-03 22:09:51 -04:00
comfyanonymous
41f74d8e93 Fix saving text encoder in fp8. 2024-04-02 11:46:34 -04:00
comfyanonymous
1ba93001e4 Refactor calc_cond_uncond_batch into calc_cond_batch.
calc_cond_batch can take an arbitrary amount of cond inputs.

Added a calc_cond_uncond_batch wrapper with a warning so custom nodes
won't break.
2024-04-01 18:07:47 -04:00
comfyanonymous
284361ba73 IP2P model loading support.
This is the code to load the model and inference it with only a text
prompt. This commit does not contain the nodes to properly use it with an
image input.

This supports both the original SD1 instructpix2pix model and the
diffusers SDXL one.
2024-03-31 03:10:28 -04:00
comfyanonymous
56b08f7b30 Cleanup to support different types of inpaint models. 2024-03-29 14:44:13 -04:00
comfyanonymous
cd0be2a31e Fix some performance issues with weight loading and unloading.
Lower peak memory usage when changing model.

Fix case where model weights would be unloaded and reloaded.
2024-03-28 18:04:42 -04:00
comfyanonymous
494bd7579e Support SDXS 0.9 2024-03-27 23:58:58 -04:00
comfyanonymous
ec14272c0a dora_scale support for lora file. 2024-03-25 18:09:23 -04:00
comfyanonymous
af7900cd79 Optimize memory unload strategy for more optimized performance. 2024-03-24 02:36:30 -04:00
comfyanonymous
6b490edbab Add inverse noise scaling function. 2024-03-21 14:49:11 -04:00
comfyanonymous
4e8d2577a9 Fix regression with lcm not working with batches. 2024-03-20 20:48:54 -04:00
comfyanonymous
2db9fdbacc Fix regression with model merging. 2024-03-20 13:56:12 -04:00
comfyanonymous
1681937288 Don't unload model weights for non weight patches. 2024-03-20 02:27:58 -04:00