887 Commits

Author SHA1 Message Date
comfyanonymous
29c17be75e Support AuraFlow Lora and loading model weights in diffusers format.
You can load model weights in diffusers format using the UNETLoader node.
2024-07-13 13:51:40 -04:00
comfyanonymous
edce34f55e Better tokenizing code for AuraFlow. 2024-07-12 01:15:25 -04:00
comfyanonymous
1234807a19 Add a ModelSamplingAuraFlow node to change the shift value.
Set the default AuraFlow shift value to 1.73 (sqrt(3)).
2024-07-11 17:57:36 -04:00
comfyanonymous
4c066c4bc4 AuraFlow model implementation. 2024-07-11 16:52:26 -04:00
comfyanonymous
68f579e0e8 Fix error message never being shown. 2024-07-11 11:46:51 -04:00
comfyanonymous
1e3385c222 Cleaner support for loading different diffusion model types. 2024-07-11 11:37:31 -04:00
comfyanonymous
ecf278e391 Remove useless code. 2024-07-10 20:33:12 -04:00
comfyanonymous
238efd021c More flexibility with text encoder return values.
Text encoders can now return other values to the CONDITIONING than the cond
and pooled output.
2024-07-10 20:06:50 -04:00
comfyanonymous
27226fb151 Support returning text encoder attention masks. 2024-07-10 19:31:22 -04:00
Extraltodeus
e02530182b Add sampler_pre_cfg_function (#3979)
* Update samplers.py

* Update model_patcher.py
2024-07-09 16:20:49 -04:00
comfyanonymous
8f8587b1b8 Remove useless import. 2024-07-09 11:05:05 -04:00
comfyanonymous
44b0664b04 Controlnet union model basic implementation.
This is only the model code itself, it currently defaults to an empty
embedding [0] * 6 which seems to work better than treating it like a
regular controlnet.

TODO: Add nodes to select the image type.
2024-07-08 23:49:02 -04:00
comfyanonymous
002954b124 Rename clip_t5base to t5base for stable audio text encoder. 2024-07-08 08:53:55 -04:00
comfyanonymous
0fcc0a91e8 Add a way to set the timestep multiplier in the flow sampling. 2024-07-06 04:06:03 -04:00
comfyanonymous
d393dea6f3 Support other types of T5 models. 2024-07-06 02:42:53 -04:00
comfyanonymous
f50599a9ae Better T5xxl detection. 2024-07-06 00:53:33 -04:00
comfyanonymous
824eb84a50 Cleanup T5 code a bit. 2024-07-06 00:36:49 -04:00
comfyanonymous
b9b3986c45 Allow specifying the padding token for the tokenizer. 2024-07-06 00:06:49 -04:00
comfyanonymous
fc982c3e43 Allow zeroing out of embeds with unused attention mask. 2024-07-05 23:48:17 -04:00
comfyanonymous
04f1ba3645 Remove useless code. 2024-07-04 15:14:13 -04:00
comfyanonymous
1695df9fbf Support loading checkpoints with the UNETLoader node. 2024-07-03 11:34:32 -04:00
comfyanonymous
618c870dff Don't update dict if contiguous. 2024-07-02 20:21:51 -04:00
Alex "mcmonkey" Goodwin
88f6f26ca1 fix non-contiguous tensor saving (from channels-last) (#3932) 2024-07-02 20:16:33 -04:00
Chenlei Hu
161107fd8d Add --no-custom-node cmd flag (#3903)
* Add --no-custom-node cmd flag

* nit
2024-07-01 17:54:03 -04:00
comfyanonymous
a7050b3f3b Switch to the real cfg++ method in the samplers.
The old _pp ones will be updated automatically to the regular ones with 2x
the cfg.

My fault for not checking what the "_pp" samplers actually did.
2024-06-29 11:59:48 -04:00
comfyanonymous
5304c6d2b4 ControlNetApplySD3 node can now be used to use SD3 controlnets. 2024-06-27 18:43:11 -04:00
comfyanonymous
0a433146b6 Basic SD3 controlnet implementation.
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
comfyanonymous
b2a29fae8c Controlnet refactor. 2024-06-27 18:43:11 -04:00
comfyanonymous
a709cce447 Support saving stable audio checkpoint that can be loaded back. 2024-06-27 11:06:52 -04:00
comfyanonymous
ad1d7cb5c2 Remove print. 2024-06-27 02:54:15 -04:00
comfyanonymous
561a0d0c62 Add DEIS order 3 sampler.
Order 4 seems to give bad results.
2024-06-26 22:40:05 -04:00
comfyanonymous
8940c4800b Implement my alternative take on CFG++ as the euler_pp sampler.
Add euler_ancestral_pp which is the ancestral version of euler with the
same modification.
2024-06-25 07:41:52 -04:00
comfyanonymous
43694c43b2 Add SamplerEulerCFG++ node.
This node should match the DDIM implementation of CFG++ when "regular" is
selected.

"alternative" is a slightly different take on CFG++
2024-06-23 13:21:18 -04:00
comfyanonymous
26af0384a0 Support OneTrainer SD3 lora format. 2024-06-22 13:08:04 -04:00
comfyanonymous
d9ce4f734d Multi dimension tiled scale function and tiled VAE audio encoding fallback. 2024-06-22 11:57:49 -04:00
comfyanonymous
15dc328f53 More proper tiled audio decoding. 2024-06-20 16:50:31 -04:00
comfyanonymous
0bae9a67e5 Add ipndm_v sampler, works best with the exponential scheduler. 2024-06-20 08:51:49 -04:00
comfyanonymous
aeac10ce20 Fix issue with full diffusers SD3 loras. 2024-06-19 22:32:04 -04:00
comfyanonymous
eabd70d64d Support loading diffusers SD3 model format with UNETLoader node. 2024-06-19 22:21:18 -04:00
comfyanonymous
5d8206517c Remove empty line. 2024-06-19 20:20:35 -04:00
Mario Klingemann
c39be91219 Update sd1_clip.py (#3684)
Made token instance check more flexible so it also works with integers from numpy arrays or long tensors
2024-06-19 16:42:41 -04:00
comfyanonymous
9c26d62191 Add ipndm sampler. 2024-06-19 16:32:30 -04:00
comfyanonymous
ffc4037b46 Support full SD3 loras. 2024-06-19 10:13:33 -04:00
comfyanonymous
f3754bf8f3 Basic tiled decoding for audio VAE. 2024-06-17 22:48:23 -04:00
Janek Mann
95028b4402 Fix lora keys for SimpleTuner (#3759) 2024-06-17 07:55:06 -04:00
comfyanonymous
160c550977 Use fp16 as the default vae dtype for the audio VAE. 2024-06-16 13:12:54 -04:00
comfyanonymous
928c1989f6 Squash depreciation warning on new pytorch. 2024-06-16 13:06:23 -04:00
comfyanonymous
cf352f2936 Better estimation for memory usage during audio VAE encoding/decoding. 2024-06-16 11:47:32 -04:00
comfyanonymous
04de2cea4e Fix VAEEncode with taesd3. 2024-06-16 03:10:04 -04:00
comfyanonymous
59781392b3 Improvements to the TAESD3 implementation. 2024-06-16 02:04:24 -04:00