2937 Commits

Author SHA1 Message Date
Jedrzej Kosinski
8b2c324cf6 Made patch_hook_weight_to_device respect set_func and convert_func 2024-11-24 13:48:30 -06:00
Jedrzej Kosinski
815c6f36e1 Merge branch 'master' into patch_hooks_improved_memory 2024-11-22 10:13:28 -06:00
comfyanonymous
94323a26a7 Remove prints. v0.3.2 2024-11-22 10:51:31 -05:00
comfyanonymous
5818f6cf51 Remove print. 2024-11-22 10:49:15 -05:00
Jedrzej Kosinski
0a432c1a73 Merge branch 'master' into patch_hooks_improved_memory 2024-11-22 09:33:13 -06:00
comfyanonymous
0b734de449 Add LTX-Video support to the Readme. 2024-11-22 09:24:20 -05:00
comfyanonymous
5e16f1d24b Support Lightricks LTX-Video model. 2024-11-22 08:46:39 -05:00
comfyanonymous
2fd9c1308a Fix mask issue in some attention functions. 2024-11-22 02:10:09 -05:00
Jedrzej Kosinski
76b9ed1f2d Merge branch 'master' into patch_hooks_improved_memory 2024-11-21 17:46:25 -06:00
Jedrzej Kosinski
c044c3ba58 Revert change, does not work 2024-11-21 16:12:39 -06:00
Jedrzej Kosinski
9a69ccf944 Allow both FLOATS and FLOAT for floats_strength input 2024-11-21 16:11:49 -06:00
Jedrzej Kosinski
1c86976f8e On Cond/Cond Pair nodes, removed opt_ prefix from optional inputs 2024-11-21 15:50:10 -06:00
comfyanonymous
8f0009aad0 Support new flux model variants. v0.3.1 2024-11-21 08:38:23 -05:00
comfyanonymous
41444b5236 Add some new weight patching functionality.
Add a way to reshape lora weights.

Allow weight patches to all weight not just .weight and .bias

Add a way for a lora to set a weight to a specific value.
2024-11-21 07:19:17 -05:00
comfyanonymous
772e620e32 Update readme. 2024-11-20 20:42:51 -05:00
Jedrzej Kosinski
d38c535771 Turn off hook patch caching when only 1 hook present in sampling, replace some current_hook = None with calls to self.patch_hooks(None) instead to avoid a potential edge case 2024-11-20 18:57:18 -06:00
comfyanonymous
07f6eeaa13 Fix mask issue with attention_xformers. 2024-11-20 17:07:46 -05:00
comfyanonymous
22535d0589 Skip layer guidance now works on stable audio model. v0.3.0 2024-11-20 07:33:06 -05:00
Jedrzej Kosinski
35016983fb Small cleanup of comments 2024-11-19 17:49:57 -06:00
Jedrzej Kosinski
59891b0f96 Made encode_from_tokens_scheduled work when no hooks are set on patcher 2024-11-19 17:17:01 -06:00
comfyanonymous
898615122f Rename add_noise_mask -> noise_mask. 2024-11-19 15:31:09 -05:00
comfyanonymous
156a28786b Add boolean to InpaintModelConditioning to disable the noise mask. 2024-11-19 07:31:29 -05:00
Yoland Yan
f498d855ba
Add terminal size fallback (#5623) 2024-11-19 03:34:20 -05:00
comfyanonymous
b699a15062 Refactor inpaint/ip2p code. 2024-11-19 03:25:25 -05:00
Jedrzej Kosinski
9b2b1303b7 Removed a .to call on results of calculate_weight in patch_hook_weight_to_device that was screwing up the intermediate results for fp8 prior to being passed into stochastic_rounding call 2024-11-18 20:42:51 -06:00
Chenlei Hu
9cc90ee3eb
Update UI screenshot in README (#5666)
* Update UI ScreenShot in README

* Remove legacy UI screenshot file

* nit

* nit
2024-11-18 16:50:34 -05:00
Jedrzej Kosinski
9fe3db4c3a For encode_from_tokens_scheduled, allow start_percent and end_percent in add_dict to limit which scheduled conds get encoded for optimization purposes 2024-11-18 12:25:17 -06:00
Jedrzej Kosinski
365170af95 Merge branch 'master' into patch_hooks_improved_memory 2024-11-18 08:43:19 -06:00
Jedrzej Kosinski
de6013ccc4 Increased MemoryCounter minimum memory to leave free by *2 until a better way to get inference memory estimate of currently loaded models exists 2024-11-18 08:08:00 -06:00
Jedrzej Kosinski
0850ae5c04 Remove unnecessary torch.no_grad calls for hook patches 2024-11-18 07:38:11 -06:00
Jedrzej Kosinski
e844695292 Fixed issue with setting weights from hooks instead of copying them, added additional memory_counter check when caching hook patches 2024-11-18 07:25:53 -06:00
comfyanonymous
9a0a5d32ee Add a skip layer guidance node that can also skip single layers.
This one should work for skipping the single layers of models like Flux
and Auraflow.

If you want to see how these models work and how many double/single layers
they have see the "ModelMerge*" nodes for the specific model.
2024-11-18 02:20:43 -05:00
Jedrzej Kosinski
f465004a58 Fix cached_hook_patches not respecting target_device/memory_counter results 2024-11-17 12:52:40 -06:00
comfyanonymous
d9f90965c8 Support block replace patches in auraflow. 2024-11-17 08:19:59 -05:00
comfyanonymous
41886af138 Add transformer options blocks replace patch to mochi. 2024-11-16 20:48:14 -05:00
Chenlei Hu
22a1d7ce78
Fix 3.8 compatibility in user_manager.py (#5645) 2024-11-16 20:42:21 -05:00
Jedrzej Kosinski
a20be20ac7 Added apply_to_conds to Set CLIP Hooks, modified relevant code to allow text encoding to automatically apply hooks to output conds when apply_to_conds is set to True 2024-11-16 17:37:57 -06:00
Jedrzej Kosinski
e177149ae4 Made opt_hooks append by default instead of replace, renamed comfy.hooks set functions to be more accurate 2024-11-16 16:40:45 -06:00
Chenlei Hu
4ac401af2b
Update web content to release v1.3.44 (#5620)
* Update web content to release v1.3.44

* nit
2024-11-15 20:17:15 -05:00
comfyanonymous
5fb59c8475 Add a node to block merge auraflow models. 2024-11-15 12:47:55 -05:00
Jedrzej Kosinski
bcc6a22178 Made WrapperHook functional, added another wrapper/callback getter, added ON_DETACH callback to ModelPatcher 2024-11-14 08:06:02 -06:00
comfyanonymous
122c9ca1ce Add advanced model merging node for mochi. 2024-11-14 07:51:20 -05:00
comfyanonymous
3b9a6cf2b1 Fix issue with 3d masks. 2024-11-13 07:18:30 -05:00
comfyanonymous
3748e7ef7a Fix regression. 2024-11-13 04:24:48 -05:00
Jedrzej Kosinski
96b2080971 Merge branch 'master' into patch_hooks_improved_memory 2024-11-12 16:43:30 -06:00
Jedrzej Kosinski
1470719db6 Added clip scheduling support to all other native ComfyUI text encoding nodes (sdxl, flux, hunyuan, sd3) 2024-11-12 10:55:19 -06:00
Jedrzej Kosinski
5909b06b2e Removed Register/Direct hook nodes since they were present only for testing, removed diff-related weight hook calculation as improved_memory removes unload_model_clones and using sample time registered hooks is less hacky 2024-11-12 09:05:19 -06:00
Jedrzej Kosinski
1766d903ad Fixed existing weight hook_patches (pre-registered) not working properly for CLIP 2024-11-12 08:12:12 -06:00
comfyanonymous
8ebf2d8831 Add block replace transformer_options to flux. 2024-11-12 08:00:39 -05:00
Bratzmeister
a72d152b0c
fix --cuda-device arg for AMD/HIP devices (#5586)
* fix --cuda-device arg for AMD/HIP devices

CUDA_VISIBLE_DEVICES is ignored for HIP devices/backend. Instead it uses HIP_VISIBLE_DEVICES. Setting this environment variable has no side effect for CUDA/NVIDIA so it can safely be set in any case and vice versa.

* deleted accidental if
2024-11-12 06:53:36 -05:00