1136 Commits

Author SHA1 Message Date
comfyanonymous
0f66e42b75 Clamp output when rounding weight to prevent Nan. 2024-10-19 19:07:10 -04:00
comfyanonymous
90105ed662 Use the lowvram cast_to function for everything. 2024-10-17 17:25:56 -04:00
comfyanonymous
1ee9bd22e9 Revert "Fix Transformers FutureWarning (#5140)"
This reverts commit 2d77c6fec951bb8077fca6b3894d1d2153cc300d.
2024-10-16 12:36:19 -04:00
comfyanonymous
3eeaf6f13f Cleanup some useless lines. 2024-10-14 21:02:39 -04:00
svdc
2d77c6fec9 Fix Transformers FutureWarning (#5140)
* Update sd1_clip.py

Fix Transformers FutureWarning

* Update sd1_clip.py

Fix comment
2024-10-14 20:12:20 -04:00
comfyanonymous
0343a551e4 Fix fp8 ops staying enabled. 2024-10-12 14:10:13 -04:00
comfyanonymous
36ffa50637 Remove useless argument. 2024-10-12 07:16:21 -04:00
comfyanonymous
e931ff67d3 model_options consistency between functions.
weight_dtype -> dtype
2024-10-11 20:51:19 -04:00
Kadir Nar
9871047313 🐛 Add device to variable c (#5210) 2024-10-11 20:37:50 -04:00
comfyanonymous
3e7430aaa6 Make clip loader nodes support loading sd3 t5xxl in lower precision.
Add attention mask support in the SD3 text encoder code.
2024-10-10 15:06:15 -04:00
Dr.Lt.Data
b0d10d28bd Hotfix for the div zero occurrence when memory_used_encode is 0 (#5121)
https://github.com/comfyanonymous/ComfyUI/issues/5069#issuecomment-2382656368
2024-10-09 23:34:34 -04:00
Jonathan Avila
f792d1ce70 Increase maximum macOS version to 15.0.1 when forcing upcast attention (#5191) 2024-10-09 22:21:41 -04:00
comfyanonymous
6b0d97384c Add a weight_dtype fp8_e4m3fn_fast to the Diffusion Model Loader node.
This is used to load weights in fp8 and use fp8 matrix multiplication.
2024-10-09 19:43:17 -04:00
comfyanonymous
c7238b2786 Fix flux doras with diffusers keys. 2024-10-08 19:03:40 -04:00
comfyanonymous
9d41f837e0 Make SD3 fast previews a little better. 2024-10-07 09:19:59 -04:00
comfyanonymous
ed58ad23a4 Make fast previews for SDXL a little better by adding a bias. 2024-10-06 19:27:04 -04:00
comfyanonymous
e954c07f56 Slightly improve the fast previews for flux by adding a bias. 2024-10-06 17:55:46 -04:00
comfyanonymous
d57d58c265 Some minor cleanups. 2024-10-05 13:22:39 -04:00
comfyanonymous
3da2c77971 Let --verbose have an argument for the log level. 2024-10-04 10:05:34 -04:00
comfyanonymous
d04f422dc6 Allow using SD3 type te output on flux model. 2024-10-03 09:44:54 -04:00
comfyanonymous
a610d8e4b8 Allow more permutations of clip/t5 in dual clip loader. 2024-10-03 09:26:11 -04:00
comfyanonymous
01b4d4de25 CLIP Loader node now supports clip_l and clip_g only for SD3. 2024-10-02 04:25:17 -04:00
comfyanonymous
2208794d01 Refactor some of the TE detection code. 2024-10-01 07:08:41 -04:00
comfyanonymous
b04064af86 Add simpletuner lycoris format for SD unet. 2024-09-30 06:03:27 -04:00
comfyanonymous
2f249dc06a Use torch.nn.functional.linear in RGB preview code.
Add an optional bias to the latent RGB preview code.
2024-09-29 11:27:49 -04:00
comfyanonymous
4358515768 Fix issue with loras, lowvram and --fast fp8. 2024-09-28 14:42:32 -04:00
City
40dcc5a39f Flux torch.compile fix (#5082) 2024-09-27 22:07:51 -04:00
comfyanonymous
a05692d331 Fix flux TE not loading t5 embeddings. 2024-09-24 22:57:22 -04:00
chaObserv
b3ca8146a0 Add dpmpp_2m_cfg_pp (#4992) 2024-09-24 02:42:56 -04:00
comfyanonymous
c02bf69b07 Make --listen listen on both ipv4 and ipv6 at the same time by default. 2024-09-23 04:38:19 -04:00
comfyanonymous
8f990c3fa4 Remove useless line. 2024-09-23 02:32:29 -04:00
comfyanonymous
fc89499f3e Add an optional VAE input to the ControlNetApplyAdvanced node.
Deprecate the other controlnet nodes.
2024-09-22 01:24:52 -04:00
comfyanonymous
5c7e72f3b1 Load controlnet in fp8 if weights are in fp8. 2024-09-21 04:50:12 -04:00
comfyanonymous
79a85a5253 Add load_controlnet_state_dict function. 2024-09-21 01:51:51 -04:00
comfyanonymous
bb9c7d4bbd Add an error message when a controlnet needs a VAE but none is given. 2024-09-21 01:33:18 -04:00
comfyanonymous
25ecfd9295 Fix model merging issue. 2024-09-20 02:31:44 -04:00
yoinked
65b99536ee add laplace scheduler [2407.03297] (#4990)
* add laplace scheduler [2407.03297]

* should be here instead lol

* better settings
2024-09-19 23:23:09 -04:00
comfyanonymous
6b6c490b4c Add model_options to load_controlnet function. 2024-09-19 08:23:35 -04:00
Simon Lui
c4affc7e35 Fix xpu Pytorch nightly build from calling optimize which doesn't exist. (#4978) 2024-09-19 05:11:42 -04:00
pharmapsychotic
2f9f603a4f Improve tiling calculations to reduce number of tiles that need to be processed. (#4944) 2024-09-17 03:51:10 -04:00
comfyanonymous
835d306666 Add some option to model_options for the text encoder.
load_device, offload_device and the initial_device can now be set.
2024-09-17 03:49:54 -04:00
comfyanonymous
29c18d1e69 get_key_patches now works without unloading the model. 2024-09-17 01:57:59 -04:00
comfyanonymous
28b12fb344 Long CLIP L support for SDXL, SD3 and Flux.
Use the *CLIPLoader nodes.
2024-09-15 07:59:38 -04:00
comfyanonymous
8058b19f35 Support AliMama SD3 and Flux inpaint controlnets.
Use the ControlNetInpaintingAliMamaApply node.
2024-09-14 09:05:16 -04:00
comfyanonymous
facf29d4f6 Support loading controlnets with different input. 2024-09-13 09:54:37 -04:00
Robin Huang
2db65988c5 Add cli arg to override user directory (#4856)
* Override user directory.

* Use overridden user directory.

* Remove prints.

* Remove references to global user_files.

* Remove unused replace_folder function.

* Remove newline.

* Remove global during get_user_directory.

* Add validation.
2024-09-12 08:10:27 -04:00
comfyanonymous
16568f960c types -> comfy_types to fix import issue. 2024-09-12 03:57:46 -04:00
comfyanonymous
2e36788c9c Doesn't really make sense for cfg_pp sampler to call regular one. 2024-09-11 02:51:36 -04:00
yoinked
f482299948 Add CFG++ to DPM++ 2S Ancestral (#3871)
* Update sampling.py

* Update samplers.py

* my bad

* "fix" the sampler

* Update samplers.py

* i named it wrong

* minor sampling improvements

mainly using a dynamic rho value (hey this sounds a lot like smea!!!)

* revert rho change

rho? r? its just 1/2
2024-09-11 02:49:44 -04:00
comfyanonymous
8690bb10f0 Fix lora issue. 2024-09-08 10:10:47 -04:00