comfyanonymous
d95ec784a4
Fix some potential issues with the previous commits.
2024-08-12 00:23:29 -04:00
comfyanonymous
32e625e0fd
Support loading directly to vram with CLIPLoader node.
2024-08-12 00:06:01 -04:00
comfyanonymous
3ac5bcd55b
Fix mistake in last commit.
2024-08-12 00:00:17 -04:00
comfyanonymous
089485a7c6
Load TE model straight to vram if certain conditions are met.
2024-08-11 23:52:43 -04:00
comfyanonymous
71eddf2d2f
Add a way to set model dtype and ops from load_checkpoint_guess_config.
2024-08-11 08:50:34 -04:00
comfyanonymous
4e7fcb5e95
Remove the ckpt_path from load_state_dict_guess_config.
2024-08-11 08:37:35 -04:00
ljleb
a5193f9c4c
alternative to load_checkpoint_guess_config that accepts a loaded state dict ( #4249 )
...
* make alternative fn
* add back ckpt path as 2nd argument?
2024-08-11 08:36:52 -04:00
comfyanonymous
001ff4d6a6
Fix OOMs happening in some cases.
...
A cloned model patcher sometimes reported a model was loaded on a device
when it wasn't.
2024-08-06 13:36:04 -04:00
comfyanonymous
f27f0f8a48
Fix some issues.
2024-08-03 15:06:40 -04:00
comfyanonymous
753d9640f9
Automatically use fp8 for diffusion model weights if:
...
Checkpoint contains weights in fp8.
There isn't enough memory to load the diffusion model in GPU vram.
2024-08-03 13:45:19 -04:00
comfyanonymous
5606d85b07
Add a way to load the diffusion model in fp8 with UNETLoader node.
2024-08-01 13:30:51 -04:00
comfyanonymous
d6d48306d8
Load flux t5 in fp8 if weights are in fp8.
2024-08-01 11:05:56 -04:00
comfyanonymous
fc6a27f36c
Basic Flux Schnell and Flux Dev model implementation.
2024-08-01 09:49:29 -04:00
comfyanonymous
79ea2d3d12
Refactor: Move sd2_clip.py to text_encoders folder.
2024-07-28 01:19:20 -04:00
comfyanonymous
06fb93c0d1
Basic hunyuan dit implementation. ( #4102 )
...
* Let tokenizers return weights to be stored in the saved checkpoint.
* Basic hunyuan dit implementation.
* Fix some resolutions not working.
* Support hydit checkpoint save.
* Init with right dtype.
* Switch to optimized attention in pooler.
* Fix black images on hunyuan dit.
2024-07-25 18:21:08 -04:00
comfyanonymous
15a95668ae
Let tokenizers return weights to be stored in the saved checkpoint.
2024-07-25 10:52:09 -04:00
comfyanonymous
33e584b3bc
Make it possible to load tokenizer data from checkpoints.
2024-07-24 16:43:53 -04:00
comfyanonymous
553fbe3407
Refactor: Move some code to the comfy/text_encoders folder.
2024-07-15 17:36:24 -04:00
comfyanonymous
29c17be75e
Support AuraFlow Lora and loading model weights in diffusers format.
...
You can load model weights in diffusers format using the UNETLoader node.
2024-07-13 13:51:40 -04:00
comfyanonymous
4c066c4bc4
AuraFlow model implementation.
2024-07-11 16:52:26 -04:00
comfyanonymous
68f579e0e8
Fix error message never being shown.
2024-07-11 11:46:51 -04:00
comfyanonymous
1e3385c222
Cleaner support for loading different diffusion model types.
2024-07-11 11:37:31 -04:00
comfyanonymous
ecf278e391
Remove useless code.
2024-07-10 20:33:12 -04:00
comfyanonymous
238efd021c
More flexibility with text encoder return values.
...
Text encoders can now return other values to the CONDITIONING than the cond
and pooled output.
2024-07-10 20:06:50 -04:00
comfyanonymous
f50599a9ae
Better T5xxl detection.
2024-07-06 00:53:33 -04:00
comfyanonymous
1695df9fbf
Support loading checkpoints with the UNETLoader node.
2024-07-03 11:34:32 -04:00
comfyanonymous
618c870dff
Don't update dict if contiguous.
2024-07-02 20:21:51 -04:00
Alex "mcmonkey" Goodwin
88f6f26ca1
fix non-contiguous tensor saving (from channels-last) ( #3932 )
2024-07-02 20:16:33 -04:00
comfyanonymous
a709cce447
Support saving stable audio checkpoint that can be loaded back.
2024-06-27 11:06:52 -04:00
comfyanonymous
d9ce4f734d
Multi dimension tiled scale function and tiled VAE audio encoding fallback.
2024-06-22 11:57:49 -04:00
comfyanonymous
15dc328f53
More proper tiled audio decoding.
2024-06-20 16:50:31 -04:00
comfyanonymous
eabd70d64d
Support loading diffusers SD3 model format with UNETLoader node.
2024-06-19 22:21:18 -04:00
comfyanonymous
f3754bf8f3
Basic tiled decoding for audio VAE.
2024-06-17 22:48:23 -04:00
comfyanonymous
160c550977
Use fp16 as the default vae dtype for the audio VAE.
2024-06-16 13:12:54 -04:00
comfyanonymous
cf352f2936
Better estimation for memory usage during audio VAE encoding/decoding.
2024-06-16 11:47:32 -04:00
comfyanonymous
04de2cea4e
Fix VAEEncode with taesd3.
2024-06-16 03:10:04 -04:00
comfyanonymous
59781392b3
Improvements to the TAESD3 implementation.
2024-06-16 02:04:24 -04:00
Dr.Lt.Data
ce165da821
support TAESD3 ( #3738 )
2024-06-16 02:03:53 -04:00
comfyanonymous
1eb91dbfbb
Initial support for the stable audio open model.
2024-06-15 12:14:56 -04:00
comfyanonymous
9d4f62e30d
Single and dual clip loader nodes support SD3.
...
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
2024-06-11 23:27:39 -04:00
comfyanonymous
917810a2c6
Load the SD3 T5xxl model in the same dtype stored in the checkpoint.
2024-06-11 17:03:26 -04:00
comfyanonymous
c7e715e64a
Support multiple text encoder configurations on SD3.
2024-06-11 13:14:43 -04:00
comfyanonymous
cc2f32af2c
SD3 Support.
2024-06-10 14:06:23 -04:00
comfyanonymous
93094050bb
Remove some unused imports.
2024-05-27 19:08:27 -04:00
comfyanonymous
ae31a1b885
Fix issue with lowvram mode breaking model saving.
2024-05-11 21:55:20 -04:00
comfyanonymous
c655ec59dc
Remove warnings that confuse people.
2024-05-09 05:29:42 -04:00
comfyanonymous
d90e593478
Make the load checkpoint with config function call the regular one.
...
I was going to completely remove this function because it is unmaintainable
but I think this is the best compromise.
The clip skip and v_prediction parts of the configs should still work but
not the fp16 vs fp32.
2024-05-06 20:04:39 -04:00
comfyanonymous
e7cd70ed48
Don't init a VAE model when there are no VAE weights.
2024-04-24 09:20:31 -04:00
comfyanonymous
918d7520c3
Support VAE without quant_conv.
2024-04-18 21:05:33 -04:00
comfyanonymous
ef332e5355
Support properly saving CosXL checkpoints.
2024-04-08 00:36:22 -04:00
