1148 Commits

Author SHA1 Message Date
PsychoLogicAu
567116a166 support SimpleTuner lycoris lora for SD3 (#5340) 2024-10-24 01:18:32 -04:00
comfyanonymous
de6f50a9d5 Fix ControlLora issue with last commit. 2024-10-23 17:02:40 -04:00
comfyanonymous
30d7a3db4f Clean up some controlnet code.
Remove self.device which was useless.
2024-10-23 14:19:05 -04:00
comfyanonymous
0474115c2a Fix lowvram edge case. 2024-10-22 16:34:50 -04:00
contentis
e828617856 remove attention abstraction (#5324) 2024-10-22 14:02:38 -04:00
comfyanonymous
46dbfc6b5c Optimizations to --fast and scaled fp8. 2024-10-22 02:12:28 -04:00
comfyanonymous
e74b599f75 Fix duplicate sigmas on beta scheduler. 2024-10-21 20:19:45 -04:00
comfyanonymous
215cf1d843 Mixed precision diffusion models with scaled fp8.
This change allows supports for diffusion models where all the linears are
scaled fp8 while the other weights are the original precision.
2024-10-21 18:12:51 -04:00
comfyanonymous
567711396b Support scaled fp8 t5xxl model. 2024-10-20 22:27:00 -04:00
comfyanonymous
ec9b115f28 Fixed model merging issue with scaled fp8. 2024-10-20 06:24:31 -04:00
comfyanonymous
adfa061b98 fp8 casting is fast on GPUs that support fp8 compute. 2024-10-20 00:54:47 -04:00
comfyanonymous
077a32ca01 Support diffusion models with scaled fp8 weights. 2024-10-19 23:47:42 -04:00
comfyanonymous
0f66e42b75 Clamp output when rounding weight to prevent Nan. 2024-10-19 19:07:10 -04:00
comfyanonymous
90105ed662 Use the lowvram cast_to function for everything. 2024-10-17 17:25:56 -04:00
comfyanonymous
1ee9bd22e9 Revert "Fix Transformers FutureWarning (#5140)"
This reverts commit 2d77c6fec951bb8077fca6b3894d1d2153cc300d.
2024-10-16 12:36:19 -04:00
comfyanonymous
3eeaf6f13f Cleanup some useless lines. 2024-10-14 21:02:39 -04:00
svdc
2d77c6fec9 Fix Transformers FutureWarning (#5140)
* Update sd1_clip.py

Fix Transformers FutureWarning

* Update sd1_clip.py

Fix comment
2024-10-14 20:12:20 -04:00
comfyanonymous
0343a551e4 Fix fp8 ops staying enabled. 2024-10-12 14:10:13 -04:00
comfyanonymous
36ffa50637 Remove useless argument. 2024-10-12 07:16:21 -04:00
comfyanonymous
e931ff67d3 model_options consistency between functions.
weight_dtype -> dtype
2024-10-11 20:51:19 -04:00
Kadir Nar
9871047313 🐛 Add device to variable c (#5210) 2024-10-11 20:37:50 -04:00
comfyanonymous
3e7430aaa6 Make clip loader nodes support loading sd3 t5xxl in lower precision.
Add attention mask support in the SD3 text encoder code.
2024-10-10 15:06:15 -04:00
Dr.Lt.Data
b0d10d28bd Hotfix for the div zero occurrence when memory_used_encode is 0 (#5121)
https://github.com/comfyanonymous/ComfyUI/issues/5069#issuecomment-2382656368
2024-10-09 23:34:34 -04:00
Jonathan Avila
f792d1ce70 Increase maximum macOS version to 15.0.1 when forcing upcast attention (#5191) 2024-10-09 22:21:41 -04:00
comfyanonymous
6b0d97384c Add a weight_dtype fp8_e4m3fn_fast to the Diffusion Model Loader node.
This is used to load weights in fp8 and use fp8 matrix multiplication.
2024-10-09 19:43:17 -04:00
comfyanonymous
c7238b2786 Fix flux doras with diffusers keys. 2024-10-08 19:03:40 -04:00
comfyanonymous
9d41f837e0 Make SD3 fast previews a little better. 2024-10-07 09:19:59 -04:00
comfyanonymous
ed58ad23a4 Make fast previews for SDXL a little better by adding a bias. 2024-10-06 19:27:04 -04:00
comfyanonymous
e954c07f56 Slightly improve the fast previews for flux by adding a bias. 2024-10-06 17:55:46 -04:00
comfyanonymous
d57d58c265 Some minor cleanups. 2024-10-05 13:22:39 -04:00
comfyanonymous
3da2c77971 Let --verbose have an argument for the log level. 2024-10-04 10:05:34 -04:00
comfyanonymous
d04f422dc6 Allow using SD3 type te output on flux model. 2024-10-03 09:44:54 -04:00
comfyanonymous
a610d8e4b8 Allow more permutations of clip/t5 in dual clip loader. 2024-10-03 09:26:11 -04:00
comfyanonymous
01b4d4de25 CLIP Loader node now supports clip_l and clip_g only for SD3. 2024-10-02 04:25:17 -04:00
comfyanonymous
2208794d01 Refactor some of the TE detection code. 2024-10-01 07:08:41 -04:00
comfyanonymous
b04064af86 Add simpletuner lycoris format for SD unet. 2024-09-30 06:03:27 -04:00
comfyanonymous
2f249dc06a Use torch.nn.functional.linear in RGB preview code.
Add an optional bias to the latent RGB preview code.
2024-09-29 11:27:49 -04:00
comfyanonymous
4358515768 Fix issue with loras, lowvram and --fast fp8. 2024-09-28 14:42:32 -04:00
City
40dcc5a39f Flux torch.compile fix (#5082) 2024-09-27 22:07:51 -04:00
comfyanonymous
a05692d331 Fix flux TE not loading t5 embeddings. 2024-09-24 22:57:22 -04:00
chaObserv
b3ca8146a0 Add dpmpp_2m_cfg_pp (#4992) 2024-09-24 02:42:56 -04:00
comfyanonymous
c02bf69b07 Make --listen listen on both ipv4 and ipv6 at the same time by default. 2024-09-23 04:38:19 -04:00
comfyanonymous
8f990c3fa4 Remove useless line. 2024-09-23 02:32:29 -04:00
comfyanonymous
fc89499f3e Add an optional VAE input to the ControlNetApplyAdvanced node.
Deprecate the other controlnet nodes.
2024-09-22 01:24:52 -04:00
comfyanonymous
5c7e72f3b1 Load controlnet in fp8 if weights are in fp8. 2024-09-21 04:50:12 -04:00
comfyanonymous
79a85a5253 Add load_controlnet_state_dict function. 2024-09-21 01:51:51 -04:00
comfyanonymous
bb9c7d4bbd Add an error message when a controlnet needs a VAE but none is given. 2024-09-21 01:33:18 -04:00
comfyanonymous
25ecfd9295 Fix model merging issue. 2024-09-20 02:31:44 -04:00
yoinked
65b99536ee add laplace scheduler [2407.03297] (#4990)
* add laplace scheduler [2407.03297]

* should be here instead lol

* better settings
2024-09-19 23:23:09 -04:00
comfyanonymous
6b6c490b4c Add model_options to load_controlnet function. 2024-09-19 08:23:35 -04:00