comfyanonymous
e4c40b647b
Let conditioning specify custom concat conds.
2024-03-02 11:44:06 -05:00
comfyanonymous
2e622719d7
Allow image_only_indicator to be None.
2024-02-29 13:11:30 -05:00
comfyanonymous
4a76090e6a
Auto detect playground v2.5 model.
2024-02-27 18:03:03 -05:00
comfyanonymous
ecdec096f3
Pass pooled CLIP to stage b.
2024-02-20 04:24:45 -05:00
comfyanonymous
e5a0f735be
Stable Cascade Stage B.
2024-02-16 13:02:03 -05:00
comfyanonymous
deebc95781
Stable Cascade Stage C.
2024-02-16 10:55:08 -05:00
comfyanonymous
f3cb1f0b39
Add a way to set different conditioning for the controlnet.
2024-02-09 14:13:31 -05:00
comfyanonymous
2f33a09886
Cleanup some unused imports.
2024-01-21 21:51:22 -05:00
comfyanonymous
8739736c6e
Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
...
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
2024-01-17 19:46:21 -05:00
comfyanonymous
30b062a477
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
2024-01-14 17:28:31 -05:00
comfyanonymous
006560b913
Add InpaintModelConditioning node.
...
This is an alternative to VAE Encode for inpaint that should work with
lower denoise.
This is a different take on #2501
2024-01-11 03:15:27 -05:00
comfyanonymous
a36114ce30
Implement noise augmentation for SD 4X upscale model.
2024-01-03 14:27:11 -05:00
comfyanonymous
7629685d08
Add support for the stable diffusion x4 upscaling model.
...
This is an old model.
Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
2024-01-03 03:37:56 -05:00
comfyanonymous
59e4fbf255
Greatly improve lowvram sampling speed by getting rid of accelerate.
...
Let me know if this breaks anything.
2023-12-22 14:38:45 -05:00
comfyanonymous
183307e3de
Fix SDXL area composition sometimes not using the right pooled output.
2023-12-18 12:54:23 -05:00
comfyanonymous
c39ed85f3d
Support stable zero 123 model.
...
To use it use the ImageOnlyCheckpointLoader to load the checkpoint and
the new Stable_Zero123 node.
2023-12-18 03:48:04 -05:00
comfyanonymous
fd9bfb01fc
Use inference dtype for unet memory usage estimation.
2023-12-11 23:50:38 -05:00
comfyanonymous
98cc7883b7
Refactor comfy.ops
...
comfy.ops -> comfy.ops.disable_weight_init
This should make it more clear what they actually do.
Some unused code has also been removed.
2023-12-11 23:27:13 -05:00
comfyanonymous
f64ac62540
Use faster manual cast for fp8 in unet.
2023-12-11 18:24:44 -05:00
comfyanonymous
080f5f4e84
UNET weights can now be stored in fp8.
...
--fp8_e4m3fn-unet and --fp8_e5m2-unet are the two different formats
supported by pytorch.
2023-12-04 11:10:00 -05:00
comfyanonymous
31feea98b0
A different way of handling multiple images passed to SVD.
...
Previously when a list of 3 images [0, 1, 2] was used for a 6 frame video
they were concated like this:
[0, 1, 2, 0, 1, 2]
now they are concated like this:
[0, 0, 1, 1, 2, 2]
2023-12-03 03:31:47 -05:00
comfyanonymous
dcd91ab458
Try to free memory for both cond+uncond before inference.
2023-11-27 14:55:40 -05:00
comfyanonymous
3253675a9c
Tweak memory inference calculations a bit.
2023-11-27 14:04:16 -05:00
comfyanonymous
5e4d60a231
Support SVD img2vid model.
2023-11-23 19:41:33 -05:00
comfyanonymous
613c21b071
Make it easy for models to process the unet state dict on load.
2023-11-20 23:17:53 -05:00
comfyanonymous
b416b4f00f
Make memory estimation aware of model dtype.
2023-11-12 04:28:26 -05:00
comfyanonymous
21ea9c3263
Allow different models to estimate memory usage differently.
2023-11-12 04:03:52 -05:00
comfyanonymous
248d1111de
Add a CONDConstant for passing non tensor conds to unet.
2023-11-08 01:59:09 -05:00
comfyanonymous
4aac40b213
Move model sampling code to comfy/model_sampling.py
2023-11-04 01:32:23 -04:00
comfyanonymous
050c96acdf
Allow ModelSamplingDiscrete to be instantiated without a model config.
2023-11-01 19:13:03 -04:00
comfyanonymous
be85c3408b
Fix some issues with sampling precision.
2023-10-31 23:49:29 -04:00
comfyanonymous
169b76657b
Clean up percent start/end and make controlnets work with sigmas.
2023-10-31 22:14:32 -04:00
comfyanonymous
ab0cfba6d1
Sampling code changes.
...
apply_model in model_base now returns the denoised output.
This means that sampling_function now computes things on the denoised
output instead of the model output. This should make things more consistent
across current and future models.
2023-10-31 17:33:43 -04:00
comfyanonymous
62a4b04e7f
Pass extra conds directly to unet.
2023-10-25 00:07:53 -04:00
comfyanonymous
141c4ffcba
Refactor to make it easier to add custom conds to models.
2023-10-24 23:31:12 -04:00
comfyanonymous
f18406d838
Make sure cond_concat is on the right device.
2023-10-19 01:14:25 -04:00
comfyanonymous
5cf44c22ad
Refactor cond_concat into model object.
2023-10-18 16:48:37 -04:00
comfyanonymous
02f4208e1f
Allow having a different pooled output for each image in a batch.
2023-09-21 01:14:42 -04:00
comfyanonymous
e68beb56e4
Support SDXL inpaint models.
2023-09-01 15:22:52 -04:00
comfyanonymous
61036397c8
It doesn't make sense for c_crossattn and c_concat to be lists.
2023-08-31 13:25:00 -04:00
comfyanonymous
21b72ff81b
Move beta_schedule to model_config and allow disabling unet creation.
2023-08-29 14:22:53 -04:00
comfyanonymous
90bfcef833
Fix lowvram model merging.
2023-08-26 11:52:07 -04:00
comfyanonymous
398390a76f
ReVision support: unclip nodes can now be used with SDXL.
2023-08-18 11:59:36 -04:00
comfyanonymous
601e4a9865
Refactor unclip code.
2023-08-14 23:48:47 -04:00
comfyanonymous
736e2e8f49
CLIPVisionEncode can now encode multiple images.
2023-08-14 16:54:05 -04:00
comfyanonymous
8a8d8c86d6
Initialize the unet directly on the target device.
2023-07-29 14:51:56 -04:00
comfyanonymous
cb47a5674c
Remove some prints.
2023-07-27 16:12:43 -04:00
comfyanonymous
cea5c2adfb
Add key to indicate checkpoint is v_prediction when saving.
2023-07-18 00:25:53 -04:00
comfyanonymous
debccdc6f9
Refactor of sampler code to deal more easily with different model types.
2023-07-17 01:22:12 -04:00
comfyanonymous
fa8010f038
Disable autocast in unet for increased speed.
2023-07-05 21:58:29 -04:00
