890 Commits

Author SHA1 Message Date
Chenlei Hu
cd3573c6a3 Add FrontendManager to manage non-default front-end impl (#3897)
* Add frontend manager

* Add tests

* nit

* Add unit test to github CI

* Fix path

* nit

* ignore

* Add logging

* Install test deps

* Remove 'stable' keyword support

* Update test

* Add web-root arg

* Rename web-root to front-end-root

* Add test on non-exist version number

* Use repo owner/name to replace hard coded provider list

* Inline cmd args

* nit

* Fix unit test
2024-07-16 11:26:11 -04:00
comfyanonymous
553fbe3407 Refactor: Move some code to the comfy/text_encoders folder. 2024-07-15 17:36:24 -04:00
comfyanonymous
7cd140ddb3 Quick fix for the promax controlnet. 2024-07-14 10:07:36 -04:00
comfyanonymous
29c17be75e Support AuraFlow Lora and loading model weights in diffusers format.
You can load model weights in diffusers format using the UNETLoader node.
2024-07-13 13:51:40 -04:00
comfyanonymous
edce34f55e Better tokenizing code for AuraFlow. 2024-07-12 01:15:25 -04:00
comfyanonymous
1234807a19 Add a ModelSamplingAuraFlow node to change the shift value.
Set the default AuraFlow shift value to 1.73 (sqrt(3)).
2024-07-11 17:57:36 -04:00
comfyanonymous
4c066c4bc4 AuraFlow model implementation. 2024-07-11 16:52:26 -04:00
comfyanonymous
68f579e0e8 Fix error message never being shown. 2024-07-11 11:46:51 -04:00
comfyanonymous
1e3385c222 Cleaner support for loading different diffusion model types. 2024-07-11 11:37:31 -04:00
comfyanonymous
ecf278e391 Remove useless code. 2024-07-10 20:33:12 -04:00
comfyanonymous
238efd021c More flexibility with text encoder return values.
Text encoders can now return other values to the CONDITIONING than the cond
and pooled output.
2024-07-10 20:06:50 -04:00
comfyanonymous
27226fb151 Support returning text encoder attention masks. 2024-07-10 19:31:22 -04:00
Extraltodeus
e02530182b Add sampler_pre_cfg_function (#3979)
* Update samplers.py

* Update model_patcher.py
2024-07-09 16:20:49 -04:00
comfyanonymous
8f8587b1b8 Remove useless import. 2024-07-09 11:05:05 -04:00
comfyanonymous
44b0664b04 Controlnet union model basic implementation.
This is only the model code itself, it currently defaults to an empty
embedding [0] * 6 which seems to work better than treating it like a
regular controlnet.

TODO: Add nodes to select the image type.
2024-07-08 23:49:02 -04:00
comfyanonymous
002954b124 Rename clip_t5base to t5base for stable audio text encoder. 2024-07-08 08:53:55 -04:00
comfyanonymous
0fcc0a91e8 Add a way to set the timestep multiplier in the flow sampling. 2024-07-06 04:06:03 -04:00
comfyanonymous
d393dea6f3 Support other types of T5 models. 2024-07-06 02:42:53 -04:00
comfyanonymous
f50599a9ae Better T5xxl detection. 2024-07-06 00:53:33 -04:00
comfyanonymous
824eb84a50 Cleanup T5 code a bit. 2024-07-06 00:36:49 -04:00
comfyanonymous
b9b3986c45 Allow specifying the padding token for the tokenizer. 2024-07-06 00:06:49 -04:00
comfyanonymous
fc982c3e43 Allow zeroing out of embeds with unused attention mask. 2024-07-05 23:48:17 -04:00
comfyanonymous
04f1ba3645 Remove useless code. 2024-07-04 15:14:13 -04:00
comfyanonymous
1695df9fbf Support loading checkpoints with the UNETLoader node. 2024-07-03 11:34:32 -04:00
comfyanonymous
618c870dff Don't update dict if contiguous. 2024-07-02 20:21:51 -04:00
Alex "mcmonkey" Goodwin
88f6f26ca1 fix non-contiguous tensor saving (from channels-last) (#3932) 2024-07-02 20:16:33 -04:00
Chenlei Hu
161107fd8d Add --no-custom-node cmd flag (#3903)
* Add --no-custom-node cmd flag

* nit
2024-07-01 17:54:03 -04:00
comfyanonymous
a7050b3f3b Switch to the real cfg++ method in the samplers.
The old _pp ones will be updated automatically to the regular ones with 2x
the cfg.

My fault for not checking what the "_pp" samplers actually did.
2024-06-29 11:59:48 -04:00
comfyanonymous
5304c6d2b4 ControlNetApplySD3 node can now be used to use SD3 controlnets. 2024-06-27 18:43:11 -04:00
comfyanonymous
0a433146b6 Basic SD3 controlnet implementation.
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
comfyanonymous
b2a29fae8c Controlnet refactor. 2024-06-27 18:43:11 -04:00
comfyanonymous
a709cce447 Support saving stable audio checkpoint that can be loaded back. 2024-06-27 11:06:52 -04:00
comfyanonymous
ad1d7cb5c2 Remove print. 2024-06-27 02:54:15 -04:00
comfyanonymous
561a0d0c62 Add DEIS order 3 sampler.
Order 4 seems to give bad results.
2024-06-26 22:40:05 -04:00
comfyanonymous
8940c4800b Implement my alternative take on CFG++ as the euler_pp sampler.
Add euler_ancestral_pp which is the ancestral version of euler with the
same modification.
2024-06-25 07:41:52 -04:00
comfyanonymous
43694c43b2 Add SamplerEulerCFG++ node.
This node should match the DDIM implementation of CFG++ when "regular" is
selected.

"alternative" is a slightly different take on CFG++
2024-06-23 13:21:18 -04:00
comfyanonymous
26af0384a0 Support OneTrainer SD3 lora format. 2024-06-22 13:08:04 -04:00
comfyanonymous
d9ce4f734d Multi dimension tiled scale function and tiled VAE audio encoding fallback. 2024-06-22 11:57:49 -04:00
comfyanonymous
15dc328f53 More proper tiled audio decoding. 2024-06-20 16:50:31 -04:00
comfyanonymous
0bae9a67e5 Add ipndm_v sampler, works best with the exponential scheduler. 2024-06-20 08:51:49 -04:00
comfyanonymous
aeac10ce20 Fix issue with full diffusers SD3 loras. 2024-06-19 22:32:04 -04:00
comfyanonymous
eabd70d64d Support loading diffusers SD3 model format with UNETLoader node. 2024-06-19 22:21:18 -04:00
comfyanonymous
5d8206517c Remove empty line. 2024-06-19 20:20:35 -04:00
Mario Klingemann
c39be91219 Update sd1_clip.py (#3684)
Made token instance check more flexible so it also works with integers from numpy arrays or long tensors
2024-06-19 16:42:41 -04:00
comfyanonymous
9c26d62191 Add ipndm sampler. 2024-06-19 16:32:30 -04:00
comfyanonymous
ffc4037b46 Support full SD3 loras. 2024-06-19 10:13:33 -04:00
comfyanonymous
f3754bf8f3 Basic tiled decoding for audio VAE. 2024-06-17 22:48:23 -04:00
Janek Mann
95028b4402 Fix lora keys for SimpleTuner (#3759) 2024-06-17 07:55:06 -04:00
comfyanonymous
160c550977 Use fp16 as the default vae dtype for the audio VAE. 2024-06-16 13:12:54 -04:00
comfyanonymous
928c1989f6 Squash depreciation warning on new pytorch. 2024-06-16 13:06:23 -04:00