comfyanonymous
013f30bae9
Update SD3 code.
2024-10-28 21:58:52 -04:00
comfyanonymous
9f8e7912ef
Basic Genmo Mochi video model support.
...
To use:
"Load CLIP" node with t5xxl + type mochi
"Load Diffusion Model" node with the mochi dit file.
"Load VAE" with the mochi vae file.
EmptyMochiLatentVideo node for the latent.
euler + linear_quadratic in the KSampler node.
2024-10-26 06:54:00 -04:00
contentis
e828617856
remove attention abstraction ( #5324 )
2024-10-22 14:02:38 -04:00
Jedrzej Kosinski
87ab41d767
Add emb_patch support to UNetModel forward ( #4779 )
2024-09-04 14:35:15 -04:00
comfyanonymous
48a1a6ef98
Unify RMSNorm code.
2024-08-28 16:56:38 -04:00
comfyanonymous
8e7aa23b6a
ONNX tracing fixes.
2024-08-04 15:45:43 -04:00
comfyanonymous
36b0b2b215
Use common function for casting weights to input.
2024-07-30 10:49:14 -04:00
comfyanonymous
d0cc951625
Remove unnecessary code.
2024-07-30 05:01:34 -04:00
comfyanonymous
7f112b9d5d
Improve artifacts on hydit, auraflow and SD3 on specific resolutions.
...
This breaks seeds for resolutions that are not a multiple of 16 in pixel
resolution by using circular padding instead of reflection padding but
should lower the amount of artifacts when doing img2img at those
resolutions.
2024-07-29 20:48:50 -04:00
comfyanonymous
ba8920ca60
Remove duplicate code.
2024-07-24 01:12:59 -04:00
comfyanonymous
0a433146b6
Basic SD3 controlnet implementation.
...
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
comfyanonymous
97af65d0dc
Small optimization.
2024-06-15 02:44:38 -04:00
comfyanonymous
b9aea52255
Fix lowvram issue.
2024-06-12 10:39:33 -04:00
Dango233
8c3b1af91f
Remove redundancy in mmdit.py ( #3685 )
2024-06-11 06:30:25 -04:00
comfyanonymous
cc2f32af2c
SD3 Support.
2024-06-10 14:06:23 -04:00
comfyanonymous
c19335f030
Cleanup.
2024-05-18 10:11:44 -04:00
comfyanonymous
fddf60ebb7
Remove unnecessary code.
2024-05-18 09:36:44 -04:00
comfyanonymous
d4db823cfe
Only enable attention upcasting on models that actually need it.
2024-05-14 17:00:50 -04:00
comfyanonymous
9956e2b6e7
Switch some more prints to logging.
2024-03-11 16:34:58 -04:00
comfyanonymous
2e622719d7
Allow image_only_indicator to be None.
2024-02-29 13:11:30 -05:00
comfyanonymous
79e83f92e8
Koala 700M and 1B support.
...
Use the UNET Loader node to load the unet file to use them.
2024-02-28 12:10:11 -05:00
comfyanonymous
1cec78c95e
Don't use numpy for calculating sigmas.
2024-02-07 18:52:51 -05:00
comfyanonymous
50fb52bc5b
Remove some unused imports.
2024-01-25 23:42:37 -05:00
comfyanonymous
a36114ce30
Implement noise augmentation for SD 4X upscale model.
2024-01-03 14:27:11 -05:00
comfyanonymous
d41cf1e412
Remove useless code.
2024-01-02 01:50:29 -05:00
comfyanonymous
09dfd709f2
Fix lowvram mode not working with unCLIP and Revision code.
2023-12-26 05:02:02 -05:00
comfyanonymous
af134f6c64
Fix SVD lowvram mode.
2023-12-24 07:13:18 -05:00
comfyanonymous
5d2e2630ef
A few missing comfy ops in the VAE.
2023-12-22 04:05:42 -05:00
comfyanonymous
98cc7883b7
Refactor comfy.ops
...
comfy.ops -> comfy.ops.disable_weight_init
This should make it more clear what they actually do.
Some unused code has also been removed.
2023-12-11 23:27:13 -05:00
comfyanonymous
080f5f4e84
UNET weights can now be stored in fp8.
...
--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.
2023-12-04 11:10:00 -05:00
comfyanonymous
03e65605de
All the unet ops with weights are now handled by comfy.ops
2023-12-04 03:12:18 -05:00
comfyanonymous
e4900be7f3
Clean up the extra_options dict for the transformer patches.
...
Now everything in transformer_options gets put in extra_options.
2023-11-26 03:13:56 -05:00
comfyanonymous
5e4d60a231
Support SVD img2vid model.
2023-11-23 19:41:33 -05:00
comfyanonymous
cd49281bf8
Remove useless code.
2023-11-21 17:27:28 -05:00
comfyanonymous
7676c8f41a
Make deep shrink behave like it should.
2023-11-16 15:26:28 -05:00
comfyanonymous
87d2cb7b0b
Print warning when controlnet can't be applied instead of crashing.
2023-11-16 12:57:12 -05:00
comfyanonymous
f6333be536
Add a way to add patches to the input block.
2023-11-14 00:08:12 -05:00
comfyanonymous
0d52957c1d
Fix typo.
2023-11-07 23:41:55 -05:00
comfyanonymous
cb22d11fc8
Code refactor.
2023-11-07 19:33:40 -05:00
comfyanonymous
397acd549a
Fix unet ops not entirely on GPU.
2023-11-07 04:30:37 -05:00
comfyanonymous
d4bc91d58f
Support SSD1B model and make it easier to support asymmetric unets.
2023-10-27 14:45:15 -04:00
comfyanonymous
459787f78f
Make VAE code closer to sgm.
2023-10-17 15:18:51 -04:00
comfyanonymous
28b98a96d3
Refactor the attention stuff in the VAE.
2023-10-17 03:19:29 -04:00
comfyanonymous
728139a5b9
Refactor code so model can be a dtype other than fp32 or fp16.
2023-10-13 14:41:17 -04:00
comfyanonymous
494ddf7717
pytorch_attention_enabled can now return True when xformers is enabled.
2023-10-11 21:30:57 -04:00
comfyanonymous
c60864b5e4
Refactor the attention functions.
...
There's no reason for the whole CrossAttention object to be repeated when
only the operation in the middle changes.
2023-10-11 20:38:48 -04:00
comfyanonymous
a990441ba0
Add a way to set output block patches to modify the h and hsp.
2023-09-22 20:26:47 -04:00
comfyanonymous
ef0c0892f6
Add a force argument to soft_empty_cache to force a cache empty.
2023-09-04 00:58:18 -04:00
comfyanonymous
2ab478346d
Remove optimization that caused border.
2023-08-29 11:21:36 -04:00
comfyanonymous
6932eda1fb
Fallback to slice attention if xformers doesn't support the operation.
2023-08-27 22:24:42 -04:00
