comfyanonymous
48a1a6ef98
Unify RMSNorm code.
2024-08-28 16:56:38 -04:00
comfyanonymous
f88fa3a5e2
Fix issue.
2024-08-14 02:51:47 -04:00
comfyanonymous
8e7aa23b6a
ONNX tracing fixes.
2024-08-04 15:45:43 -04:00
comfyanonymous
36b0b2b215
Use common function for casting weights to input.
2024-07-30 10:49:14 -04:00
comfyanonymous
d0cc951625
Remove unnecessary code.
2024-07-30 05:01:34 -04:00
comfyanonymous
7f112b9d5d
Improve artifacts on hydit, auraflow and SD3 on specific resolutions.
...
This breaks seeds for resolutions that are not a multiple of 16 in pixel
resolution by using circular padding instead of reflection padding but
should lower the amount of artifacts when doing img2img at those
resolutions.
2024-07-29 20:48:50 -04:00
comfyanonymous
ba8920ca60
Remove duplicate code.
2024-07-24 01:12:59 -04:00
comfyanonymous
0a433146b6
Basic SD3 controlnet implementation.
...
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
comfyanonymous
1eb91dbfbb
Initial support for the stable audio open model.
2024-06-15 12:14:56 -04:00
comfyanonymous
97af65d0dc
Small optimization.
2024-06-15 02:44:38 -04:00
comfyanonymous
b9aea52255
Fix lowvram issue.
2024-06-12 10:39:33 -04:00
Dango233
8c3b1af91f
Remove redundancy in mmdit.py ( #3685 )
2024-06-11 06:30:25 -04:00
comfyanonymous
cc2f32af2c
SD3 Support.
2024-06-10 14:06:23 -04:00
comfyanonymous
93094050bb
Remove some unused imports.
2024-05-27 19:08:27 -04:00
comfyanonymous
bdbaa4491c
Work around black image bug on Mac 14.5 by forcing attention upcasting.
2024-05-21 16:56:33 -04:00
comfyanonymous
e0c00cac39
Disable xformers when tracing model.
2024-05-21 13:55:49 -04:00
comfyanonymous
a8c173cc1b
Fix potential issue.
2024-05-20 08:19:54 -04:00
comfyanonymous
c19335f030
Cleanup.
2024-05-18 10:11:44 -04:00
comfyanonymous
fddf60ebb7
Remove unnecessary code.
2024-05-18 09:36:44 -04:00
comfyanonymous
e2d71cc7b6
Add debug options to force on and off attention upcasting.
2024-05-16 04:09:41 -04:00
comfyanonymous
e02598e417
Fix SAG.
2024-05-14 18:02:27 -04:00
comfyanonymous
d4db823cfe
Only enable attention upcasting on models that actually need it.
2024-05-14 17:00:50 -04:00
comfyanonymous
89e38bcd63
Refactor attention upcasting code part 1.
2024-05-14 12:47:31 -04:00
comfyanonymous
95e80c5df1
Workaround xformers bug.
2024-04-30 21:23:40 -04:00
comfyanonymous
9956e2b6e7
Switch some more prints to logging.
2024-03-11 16:34:58 -04:00
comfyanonymous
2e622719d7
Allow image_only_indicator to be None.
2024-02-29 13:11:30 -05:00
comfyanonymous
79e83f92e8
Koala 700M and 1B support.
...
Use the UNET Loader node to load the unet file to use them.
2024-02-28 12:10:11 -05:00
comfyanonymous
681300661a
Fix attention masks properly for multiple batches.
2024-02-17 16:15:18 -05:00
comfyanonymous
511e70ab62
Fix attention mask batch size in some attention functions.
2024-02-17 15:22:21 -05:00
comfyanonymous
4a9216bca3
Properly fix attention masks in CLIP with batches.
2024-02-17 12:13:13 -05:00
comfyanonymous
1cec78c95e
Don't use numpy for calculating sigmas.
2024-02-07 18:52:51 -05:00
comfyanonymous
50fb52bc5b
Remove some unused imports.
2024-01-25 23:42:37 -05:00
comfyanonymous
30b062a477
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
2024-01-14 17:28:31 -05:00
comfyanonymous
62a7bf2919
Use basic attention implementation for small inputs on old pytorch.
2024-01-09 13:46:52 -05:00
comfyanonymous
8cf0a2dfe7
Update optimized_attention_for_device function for new functions that
...
support masked attention.
2024-01-07 13:52:08 -05:00
comfyanonymous
f9f0822512
Add attention mask support to sub quad attention.
2024-01-07 04:13:58 -05:00
comfyanonymous
59259b0de3
Support attention mask in split attention.
2024-01-06 13:16:48 -05:00
comfyanonymous
1240b45932
Implement attention mask on xformers.
2024-01-06 04:33:03 -05:00
comfyanonymous
a36114ce30
Implement noise augmentation for SD 4X upscale model.
2024-01-03 14:27:11 -05:00
comfyanonymous
d41cf1e412
Remove useless code.
2024-01-02 01:50:29 -05:00
comfyanonymous
09dfd709f2
Fix lowvram mode not working with unCLIP and Revision code.
2023-12-26 05:02:02 -05:00
comfyanonymous
af134f6c64
Fix SVD lowvram mode.
2023-12-24 07:13:18 -05:00
comfyanonymous
5d2e2630ef
A few missing comfy ops in the VAE.
2023-12-22 04:05:42 -05:00
comfyanonymous
99f61f753a
Remove useless code.
2023-12-15 01:28:16 -05:00
comfyanonymous
98cc7883b7
Refactor comfy.ops
...
comfy.ops -> comfy.ops.disable_weight_init
This should make it more clear what they actually do.
Some unused code has also been removed.
2023-12-11 23:27:13 -05:00
comfyanonymous
782cf4f295
Cleaner CLIP text encoder implementation.
...
Use a simple CLIP model implementation instead of the one from
transformers.
This will allow some interesting things that would too hackish to implement
using the transformers implementation.
2023-12-06 23:50:03 -05:00
comfyanonymous
39bb52dc2c
Missed this one.
2023-12-05 12:48:41 -05:00
comfyanonymous
080f5f4e84
UNET weights can now be stored in fp8.
...
--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.
2023-12-04 11:10:00 -05:00
comfyanonymous
03e65605de
All the unet ops with weights are now handled by comfy.ops
2023-12-04 03:12:18 -05:00
comfyanonymous
60f4b792c8
Fix regression from last commit.
2023-11-26 03:43:02 -05:00
