837 Commits

Author SHA1 Message Date
Dr.Lt.Data
ce165da821 support TAESD3 (#3738) 2024-06-16 02:03:53 -04:00
comfyanonymous
1eb91dbfbb Initial support for the stable audio open model. 2024-06-15 12:14:56 -04:00
comfyanonymous
97af65d0dc Small optimization. 2024-06-15 02:44:38 -04:00
comfyanonymous
5c5911a0c1 Optimize some unneeded if conditions in the sampling code. 2024-06-15 02:26:19 -04:00
comfyanonymous
12e44a5d50 Add a --force-channels-last to inference models in channel last mode. 2024-06-15 01:08:12 -04:00
comfyanonymous
8dbd876a23 Print key names for easier debugging. 2024-06-14 18:18:53 -04:00
Simon Lui
20052d83b5 Exempt IPEX from non_blocking previews fixing segmentation faults. (#3708) 2024-06-13 18:51:14 -04:00
comfyanonymous
77b1aa430f Support SD3 diffusers lora. 2024-06-13 18:26:10 -04:00
comfyanonymous
468f9b8d49 Support setting weight offsets in weight patcher. 2024-06-13 17:21:26 -04:00
comfyanonymous
b9aea52255 Fix lowvram issue. 2024-06-12 10:39:33 -04:00
comfyanonymous
4514807781 Don't auto convert clip and vae weights to fp16 when saving checkpoint. 2024-06-12 01:07:58 -04:00
comfyanonymous
4a6dfb619d SD3 better memory usage estimation. 2024-06-12 00:49:00 -04:00
comfyanonymous
9d4f62e30d Single and dual clip loader nodes support SD3.
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
2024-06-11 23:27:39 -04:00
comfyanonymous
917810a2c6 Load the SD3 T5xxl model in the same dtype stored in the checkpoint. 2024-06-11 17:03:26 -04:00
comfyanonymous
c7e715e64a Support multiple text encoder configurations on SD3. 2024-06-11 13:14:43 -04:00
comfyanonymous
0f719c05f1 Reuse code. 2024-06-11 07:20:26 -04:00
Dango233
8c3b1af91f Remove redundancy in mmdit.py (#3685) 2024-06-11 06:30:25 -04:00
comfyanonymous
71ed9026b0 Fix bug with cosxl edit model. 2024-06-10 16:00:03 -04:00
comfyanonymous
cc2f32af2c SD3 Support. 2024-06-10 14:06:23 -04:00
comfyanonymous
258e685fcc Support sampling non 2D latents. 2024-06-10 01:31:09 -04:00
comfyanonymous
a2a20c27f4 Support zeroing out text embeddings with the attention mask. 2024-06-09 16:51:58 -04:00
comfyanonymous
372b1130d1 Reshape the empty latent image to the right amount of channels if needed. 2024-06-08 02:35:08 -04:00
comfyanonymous
add86d4eb5 Use the end token for the text encoder attention mask. 2024-06-07 03:05:23 -04:00
comfyanonymous
b6a9851535 Add function to get the list of currently loaded models. 2024-06-05 23:25:16 -04:00
comfyanonymous
20f463902f pytorch xpu should be flash or mem efficient attention? 2024-06-04 17:44:14 -04:00
comfyanonymous
5eb529ced1 Remove useless code. 2024-06-02 19:23:37 -04:00
comfyanonymous
5f826c9921 Add an annoying print to a function I want to remove. 2024-06-01 12:47:31 -04:00
comfyanonymous
9cea5b91a0 Disable non_blocking when --deterministic or directml. 2024-05-30 11:07:38 -04:00
JettHu
0c313cb9ca Fix UnetParams annotation typo (#3589) 2024-05-27 19:30:35 -04:00
comfyanonymous
93094050bb Remove some unused imports. 2024-05-27 19:08:27 -04:00
comfyanonymous
358f3230d4 Fix DORA strength.
This is a different version of #3298 with more correct behavior.
2024-05-25 02:50:11 -04:00
comfyanonymous
8ece946997 Reduce memory usage when applying DORA: #3557 2024-05-24 23:36:48 -04:00
comfyanonymous
94a508adc2 Fix OSX latent2rgb previews. 2024-05-22 13:56:28 -04:00
Chenlei Hu
cc9c2a3144 Add type annotation UnetWrapperFunction (#3531)
* Add type annotation UnetWrapperFunction

* nit

* Add types.py
2024-05-22 02:07:27 -04:00
comfyanonymous
bdbaa4491c Work around black image bug on Mac 14.5 by forcing attention upcasting. 2024-05-21 16:56:33 -04:00
comfyanonymous
e0c00cac39 Disable xformers when tracing model. 2024-05-21 13:55:49 -04:00
comfyanonymous
a8c173cc1b Fix potential issue. 2024-05-20 08:19:54 -04:00
comfyanonymous
bcc5cd02c7 Log the pytorch version. 2024-05-20 06:22:29 -04:00
comfyanonymous
fc6cc5fafc Fix controlnet not upcasting on models that have it enabled. 2024-05-19 17:58:03 -04:00
comfyanonymous
c19335f030 Cleanup. 2024-05-18 10:11:44 -04:00
comfyanonymous
fddf60ebb7 Remove unnecessary code. 2024-05-18 09:36:44 -04:00
comfyanonymous
367f84be8d Don't automatically switch to lowvram mode on GPUs with low memory. 2024-05-17 00:31:32 -04:00
comfyanonymous
e2d71cc7b6 Add debug options to force on and off attention upcasting. 2024-05-16 04:09:41 -04:00
comfyanonymous
affe07f17d Fix lowvram dora issue. 2024-05-15 02:47:40 -04:00
comfyanonymous
e02598e417 Fix SAG. 2024-05-14 18:02:27 -04:00
comfyanonymous
d4db823cfe Only enable attention upcasting on models that actually need it. 2024-05-14 17:00:50 -04:00
comfyanonymous
89e38bcd63 Refactor attention upcasting code part 1. 2024-05-14 12:47:31 -04:00
Simon Lui
4cd1bc2cce Fix Intel GPU memory allocation accuracy and documentation update. (#3459)
* Change calculation of memory total to be more accurate, allocated is actually smaller than reserved.

* Update README.md install documentation for Intel GPUs.
2024-05-12 06:36:30 -04:00
comfyanonymous
43079b39cd Fix lowvram issue with saving checkpoints.
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
2024-05-12 06:13:45 -04:00
comfyanonymous
397b840846 No longer necessary. 2024-05-12 05:34:43 -04:00