672 Commits

Author SHA1 Message Date
comfyanonymous
50fb52bc5b Remove some unused imports. 2024-01-25 23:42:37 -05:00
Dr.Lt.Data
f91644b5e9 typo fix - calculate_sigmas_scheduler (#2619)
self.scheduler -> scheduler_name

Co-authored-by: Lt.Dr.Data <lt.dr.data@gmail.com>
2024-01-23 03:47:01 -05:00
comfyanonymous
2f33a09886 Cleanup some unused imports. 2024-01-21 21:51:22 -05:00
comfyanonymous
3d6af7145d Remove useless import. 2024-01-19 15:38:05 -05:00
comfyanonymous
8739736c6e Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
2024-01-17 19:46:21 -05:00
comfyanonymous
96232a0a45 Only auto enable bf16 VAE on nvidia GPUs that actually support it. 2024-01-15 03:10:22 -05:00
comfyanonymous
30b062a477 Make unclip more deterministic.
Pass a seed argument note that this might make old unclip images different.
2024-01-14 17:28:31 -05:00
comfyanonymous
75966467dc Make server storage the default.
Remove --server-storage argument.
2024-01-11 17:21:40 -05:00
comfyanonymous
50b460c768 Don't round noise mask. 2024-01-11 03:29:58 -05:00
comfyanonymous
006560b913 Add InpaintModelConditioning node.
This is an alternative to VAE Encode for inpaint that should work with
lower denoise.

This is a different take on #2501
2024-01-11 03:15:27 -05:00
comfyanonymous
e0235effa4 Fix issue when using multiple t2i adapters with batched images. 2024-01-10 04:00:49 -05:00
comfyanonymous
62a7bf2919 Use basic attention implementation for small inputs on old pytorch. 2024-01-09 13:46:52 -05:00
pythongosssss
9f2a191a0e Store user settings/data on the server and multi user support (#2160)
* wip per user data

* Rename, hide menu

* better error
rework default user

* store pretty

* Add userdata endpoints
Change nodetemplates to userdata

* add multi user message

* make normal arg

* Fix tests

* Ignore user dir

* user tests

* Changed to default to browser storage and add server-storage arg

* fix crash on empty templates

* fix settings added before load

* ignore parse errors
2024-01-08 17:06:44 -05:00
comfyanonymous
8cf0a2dfe7 Update optimized_attention_for_device function for new functions that
support masked attention.
2024-01-07 13:52:08 -05:00
comfyanonymous
f9f0822512 Add attention mask support to sub quad attention. 2024-01-07 04:13:58 -05:00
comfyanonymous
59259b0de3 Support attention mask in split attention. 2024-01-06 13:16:48 -05:00
comfyanonymous
1240b45932 Implement attention mask on xformers. 2024-01-06 04:33:03 -05:00
comfyanonymous
a36114ce30 Implement noise augmentation for SD 4X upscale model. 2024-01-03 14:27:11 -05:00
comfyanonymous
004cf09984 Fix model patches not working in custom sampling scheduler nodes. 2024-01-03 12:16:30 -05:00
comfyanonymous
7629685d08 Add support for the stable diffusion x4 upscaling model.
This is an old model.

Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
2024-01-03 03:37:56 -05:00
comfyanonymous
16da9f6446 Fix regression. 2024-01-02 14:41:33 -05:00
comfyanonymous
5e3372d45c Refactor VAE code.
Replace constants with downscale_ratio and latent_channels.
2024-01-02 13:24:34 -05:00
comfyanonymous
4fd8339694 Auto detect out_channels from model. 2024-01-02 01:50:57 -05:00
comfyanonymous
d41cf1e412 Remove useless code. 2024-01-02 01:50:29 -05:00
comfyanonymous
25ec26ff9c Add argument to run the VAE on the CPU. 2023-12-30 05:49:07 -05:00
comfyanonymous
7602677b54 Use function to calculate model size in model patcher. 2023-12-28 21:46:20 -05:00
comfyanonymous
48d2b242ee Load weights that can't be lowvramed to target device. 2023-12-28 21:41:10 -05:00
comfyanonymous
8390f209db Fix clip vision lowvram mode not working. 2023-12-27 13:50:57 -05:00
comfyanonymous
7a3a00563b Fix taesd VAE in lowvram mode. 2023-12-26 12:52:21 -05:00
comfyanonymous
09dfd709f2 Fix lowvram mode not working with unCLIP and Revision code. 2023-12-26 05:02:02 -05:00
comfyanonymous
af134f6c64 Fix SVD lowvram mode. 2023-12-24 07:13:18 -05:00
comfyanonymous
0baa3cc687 --disable-smart-memory now unloads everything like it did originally. 2023-12-23 04:25:06 -05:00
comfyanonymous
59e4fbf255 Greatly improve lowvram sampling speed by getting rid of accelerate.
Let me know if this breaks anything.
2023-12-22 14:38:45 -05:00
comfyanonymous
5d2e2630ef A few missing comfy ops in the VAE. 2023-12-22 04:05:42 -05:00
comfyanonymous
066f11873e Fix regression with inpaint model. 2023-12-19 02:32:59 -05:00
comfyanonymous
bf90151704 Fix SAG not working with cfg 1.0 2023-12-18 17:03:32 -05:00
comfyanonymous
183307e3de Fix SDXL area composition sometimes not using the right pooled output. 2023-12-18 12:54:23 -05:00
comfyanonymous
c39ed85f3d Support stable zero 123 model.
To use it use the ImageOnlyCheckpointLoader to load the checkpoint and
the new Stable_Zero123 node.
2023-12-18 03:48:04 -05:00
comfyanonymous
65ada00818 Add --deterministic option to make pytorch use deterministic algorithms. 2023-12-17 16:59:21 -05:00
comfyanonymous
2849cef630 Don't resize clip vision image when the size is already good. 2023-12-16 03:06:10 -05:00
comfyanonymous
50c5b816d3 Switch clip vision to manual cast.
Make it use the same dtype as the text encoder.
2023-12-16 02:47:26 -05:00
comfyanonymous
5b1e4dff6c Set clip vision model in eval mode so it works without inference mode. 2023-12-15 18:53:08 -05:00
Hari
72500f183b Implement Perp-Neg 2023-12-16 00:28:16 +05:30
comfyanonymous
99f61f753a Remove useless code. 2023-12-15 01:28:16 -05:00
comfyanonymous
743e80a273 Improve code legibility. 2023-12-14 11:41:49 -05:00
comfyanonymous
85cbdd661b Fix cfg being calculated more than once if sampler_cfg_function. 2023-12-13 20:28:04 -05:00
comfyanonymous
b83523b241 Refactor and improve the sag node.
Moved all the sag related code to comfy_extras/nodes_sag.py
2023-12-13 16:11:26 -05:00
Rafie Walker
58df1767b4 Implement Self-Attention Guidance (#2201)
* First SAG test

* need to put extra options on the model instead of patcher

* no errors and results seem not-broken

* Use @ashen-uncensored formula, which works better!!!

* Fix a crash when using weird resolutions. Remove an unnecessary UNet call

* Improve comments, optimize memory in blur routine

* SAG works with sampler_cfg_function
2023-12-13 15:52:11 -05:00
comfyanonymous
9e28104fb2 Support segmind vega model. 2023-12-12 19:09:53 -05:00
comfyanonymous
d8d085f2f9 Add dtype parameter to VAE object. 2023-12-12 12:03:29 -05:00