1240 Commits

Author SHA1 Message Date
Jedrzej Kosinski
f465004a58 Fix cached_hook_patches not respecting target_device/memory_counter results 2024-11-17 12:52:40 -06:00
Jedrzej Kosinski
a20be20ac7 Added apply_to_conds to Set CLIP Hooks, modified relevant code to allow text encoding to automatically apply hooks to output conds when apply_to_conds is set to True 2024-11-16 17:37:57 -06:00
Jedrzej Kosinski
e177149ae4 Made opt_hooks append by default instead of replace, renamed comfy.hooks set functions to be more accurate 2024-11-16 16:40:45 -06:00
Jedrzej Kosinski
bcc6a22178 Made WrapperHook functional, added another wrapper/callback getter, added ON_DETACH callback to ModelPatcher 2024-11-14 08:06:02 -06:00
Jedrzej Kosinski
96b2080971 Merge branch 'master' into patch_hooks_improved_memory 2024-11-12 16:43:30 -06:00
Jedrzej Kosinski
5909b06b2e Removed Register/Direct hook nodes since they were present only for testing, removed diff-related weight hook calculation as improved_memory removes unload_model_clones and using sample time registered hooks is less hacky 2024-11-12 09:05:19 -06:00
Jedrzej Kosinski
1766d903ad Fixed existing weight hook_patches (pre-registered) not working properly for CLIP 2024-11-12 08:12:12 -06:00
comfyanonymous
8ebf2d8831 Add block replace transformer_options to flux. 2024-11-12 08:00:39 -05:00
comfyanonymous
eb476e6ea9 Allow 1D masks for 1D latents. 2024-11-11 14:44:52 -05:00
Jedrzej Kosinski
9330745f27 Merge branch 'improved_memory' into patch_hooks_improved_memory 2024-11-11 11:26:36 -06:00
Jedrzej Kosinski
4195dfb032 Merge branch 'master' into patch_hooks_improved_memory 2024-11-11 11:26:27 -06:00
Jedrzej Kosinski
66b3386ee7 Updated different hook types to reflect actual progress of implementation, initial scaffolding for working WrapperHook functionality 2024-11-11 10:13:02 -06:00
Jedrzej Kosinski
b12cc83c5b Modified callbacks and wrappers so that unregistered types can be used, allowing custom_nodes to have their own unique callbacks/wrappers if desired 2024-11-11 09:05:07 -06:00
Jedrzej Kosinski
638c4086a3 Fixed inconsistency of results when schedule_clip is set to False, small renaming/typo fixing, added initial support for ControlNet extra_hooks to work in tandem with normal cond hooks, initial work on calc_cond_batch merging all subdicts in returned transformer_options 2024-11-11 08:41:08 -06:00
comfyanonymous
8b275ce5be Support auto detecting some zsnr anime checkpoints. 2024-11-11 05:34:11 -05:00
comfyanonymous
2a18e98ccf Refactor so that zsnr can be set in the sampling_settings. 2024-11-11 04:55:56 -05:00
comfyanonymous
bdeb1c171c Fast previews for mochi. 2024-11-10 03:39:35 -05:00
comfyanonymous
8b90e50979 Properly handle and reshape masks when used on 3d latents. 2024-11-09 15:30:19 -05:00
comfyanonymous
2865f913f7 Free memory before doing tiled decode. 2024-11-07 04:01:24 -05:00
comfyanonymous
b49616f951 Make VAEDecodeTiled node work with video VAEs. 2024-11-07 03:47:12 -05:00
comfyanonymous
5e29e7a488 Remove scaled_fp8 key after reading it to silence warning. 2024-11-06 04:56:42 -05:00
comfyanonymous
8afb97cd3f Fix unknown VAE being detected as the mochi VAE. 2024-11-05 03:43:27 -05:00
contentis
69694f40b3
fix dynamic shape export (#5490) 2024-11-04 14:59:28 -05:00
Jedrzej Kosinski
9dde713347 Refactored hooks in calc_cond_batch to be part of get_area_and_mult tuple, added extra_hooks to ControlBase to allow custom controlnets w/ hooks, small cleanup and renaming 2024-11-04 05:46:27 -06:00
comfyanonymous
95972bab86 Fix issue. 2024-11-04 05:07:07 -05:00
Jedrzej Kosinski
0fbefb8428 Refactored code to store wrappers and callbacks in transformer_options, added apply_model and diffusion_model.forward wrappers 2024-11-03 06:22:48 -06:00
comfyanonymous
6c9dbde7de Fix mochi all in one checkpoint t5xxl key names. 2024-11-03 01:40:42 -05:00
Jedrzej Kosinski
51e8d5554c Moved WrappersMP/CallbacksMP/WrapperExecutor to patcher_extension.py 2024-11-02 22:21:16 -05:00
comfyanonymous
fabf449feb Mochi VAE encoder. 2024-11-01 17:33:09 -04:00
Jedrzej Kosinski
e3c3722ec2 Merge branch 'improved_memory' into patch_hooks_improved_memory 2024-11-01 06:02:46 -05:00
comfyanonymous
bd5d8f150f Prevent and detect some types of memory leaks. 2024-11-01 06:55:42 -04:00
Jedrzej Kosinski
89934a465a Merge branch 'improved_memory' into patch_hooks_improved_memory 2024-11-01 03:59:43 -05:00
Jedrzej Kosinski
45f16c2dad Merge branch 'improved_memory' into patch_hooks_improved_memory 2024-11-01 03:58:17 -05:00
comfyanonymous
975927cc79 Remove useless function. 2024-11-01 04:40:33 -04:00
comfyanonymous
1735d4fb01 Fix issue. 2024-11-01 04:25:27 -04:00
Jedrzej Kosinski
16735c98e0 Make encode_from_tokens_scheduled call cleaner, rollback change in model_patcher.py for hook_patches_backup dict 2024-11-01 02:01:45 -05:00
comfyanonymous
d8bd2a9baa Less fragile memory management. 2024-11-01 02:41:51 -04:00
Jedrzej Kosinski
489846905e Optimized CLIP hook scheduling to treat same strength as same keyframe 2024-10-31 19:28:16 -05:00
Jedrzej Kosinski
3bcbcce88d Merge branch 'master' into patch_hooks 2024-10-31 18:34:05 -05:00
Aarni Koskela
1c8286a44b
Avoid SyntaxWarning in UniPC docstring (#5442) 2024-10-31 15:17:26 -04:00
comfyanonymous
1af4a47fd1 Bump up mac version for attention upcast bug workaround. 2024-10-31 15:15:31 -04:00
comfyanonymous
daa1565b93 Fix diffusers flux controlnet regression. 2024-10-30 13:11:34 -04:00
Jedrzej Kosinski
7a4d2fe523 Fix range check in get_hooks_for_clip_schedule so that proper keyframes get assigned to corresponding ranges 2024-10-30 05:37:30 -05:00
Jedrzej Kosinski
d5169df808 Added initial support within CLIP Text Encode (Prompt) node for scheduling weight hook CLIP strength via clip_start_percent/clip_end_percent on conds, added schedule_clip toggle to Set CLIP Hooks node, small cleanup/fixes 2024-10-30 04:56:09 -05:00
comfyanonymous
09fdb2b269 Support SD3.5 medium diffusers format weights and loras. 2024-10-30 04:24:00 -04:00
comfyanonymous
30c0c81351 Add a way to patch blocks in SD3. 2024-10-29 00:48:32 -04:00
comfyanonymous
13b0ff8a6f Update SD3 code. 2024-10-28 21:58:52 -04:00
comfyanonymous
c320801187 Remove useless line. 2024-10-28 17:41:12 -04:00
comfyanonymous
669d9e4c67 Set default shift on mochi to 6.0 2024-10-27 22:21:04 -04:00
comfyanonymous
9ee0a6553a float16 inference is a bit broken on mochi. 2024-10-27 04:56:40 -04:00