211 Commits

Author SHA1 Message Date
City
40dcc5a39f Flux torch.compile fix (#5082) 2024-09-27 22:07:51 -04:00
comfyanonymous
facf29d4f6 Support loading controlnets with different input. 2024-09-13 09:54:37 -04:00
comfyanonymous
46fb0fe3f5 Fix onnx export not working on flux. 2024-09-06 03:21:52 -04:00
comfyanonymous
f55860e83b Mistoline flux controlnet support. 2024-09-05 00:05:17 -04:00
Jedrzej Kosinski
87ab41d767 Add emb_patch support to UNetModel forward (#4779) 2024-09-04 14:35:15 -04:00
comfyanonymous
573d09ea33 Fix potential issue with hydit controlnets. 2024-08-30 04:58:41 -04:00
comfyanonymous
c3503e62bc Implement model part of flux union controlnet. 2024-08-29 18:41:22 -04:00
comfyanonymous
ee3374957b InstantX depth flux controlnet. 2024-08-29 02:14:19 -04:00
comfyanonymous
739d31c73a InstantX canny controlnet. 2024-08-28 19:02:50 -04:00
comfyanonymous
48a1a6ef98 Unify RMSNorm code. 2024-08-28 16:56:38 -04:00
comfyanonymous
23922a2fbd Do RMSNorm in native type. 2024-08-27 02:41:56 -04:00
comfyanonymous
9c847187cb Try a different type of flux fp16 fix. 2024-08-21 16:17:15 -04:00
comfyanonymous
635eeda81f Indentation. 2024-08-17 23:00:44 -04:00
Xrvk
5811b93d32 Add Flux model support for InstantX style controlnet residuals (#4444)
* Add Flux model support for InstantX style controlnet residuals

* Refactor Flux controlnet residual step to a separate method

* Rollback minor change

* New format for applying controlnet residuals: input->double_blocks, output->single_blocks

* Adjust XLabs Flux controlnet to fit new syntax of applying Flux controlnet residuals

* Remove unnecessary import and minor style change
2024-08-17 22:58:23 -04:00
comfyanonymous
f88fa3a5e2 Fix issue. 2024-08-14 02:51:47 -04:00
comfyanonymous
00545103df Revert "Not sure if this actually changes anything but it can't hurt."
This reverts commit f252a56d6ffbff643c86de4c7c5b0cf150535134.
2024-08-14 01:05:17 -04:00
comfyanonymous
f252a56d6f Not sure if this actually changes anything but it can't hurt. 2024-08-13 13:29:16 -04:00
comfyanonymous
f77eada464 Order of operations matters. 2024-08-12 21:56:18 -04:00
comfyanonymous
e1e5903bec xlabs Flux controlnet implementation. (#4260)
* xlabs Flux controlnet.

* Fix not working on old python.

* Remove comment.
2024-08-12 21:22:22 -04:00
comfyanonymous
845f52cabc Speed up hunyuan dit inference a bit. 2024-08-10 07:36:27 -04:00
comfyanonymous
24d1c00725 Cleanup HunyuanDit controlnets.
Use the: ControlNetApply SD3 and HunyuanDiT node.
2024-08-09 02:59:34 -04:00
来新璐
298a7149d3 feat: add support for HunYuanDit ControlNet (#4245)
* add support for HunYuanDit ControlNet

* fix hunyuandit controlnet

* fix typo in hunyuandit controlnet

* fix typo in hunyuandit controlnet

* fix code format style

* add control_weight support for HunyuanDit Controlnet

* use control_weights in HunyuanDit Controlnet

* fix typo
2024-08-09 02:59:24 -04:00
comfyanonymous
ef493ebbf8 Raw torch is faster than einops? 2024-08-08 22:09:29 -04:00
comfyanonymous
8e1189dae5 Cleaner code. 2024-08-08 20:07:09 -04:00
comfyanonymous
6f69d4e0ec Add Flux fp16 support hack. 2024-08-07 15:08:39 -04:00
a-One-Fan
2e56b50183 Fix Flux FP64 math on XPU (#4210) 2024-08-05 01:26:20 -04:00
comfyanonymous
8e7aa23b6a ONNX tracing fixes. 2024-08-04 15:45:43 -04:00
comfyanonymous
a06d0ff763 Hack to make all resolutions work on Flux models. 2024-08-01 21:39:18 -04:00
comfyanonymous
bd6f023ff6 Try to fix mac issue. 2024-08-01 13:41:27 -04:00
comfyanonymous
30a15dd5e1 Better Mac support on flux model. 2024-08-01 13:10:50 -04:00
comfyanonymous
96dbbd23d8 Fix old python versions no longer working. 2024-08-01 09:57:20 -04:00
comfyanonymous
fc6a27f36c Basic Flux Schnell and Flux Dev model implementation. 2024-08-01 09:49:29 -04:00
comfyanonymous
7f0000bc5a Lower T5 memory usage by a few hundred MB. 2024-07-31 00:52:34 -04:00
comfyanonymous
36b0b2b215 Use common function for casting weights to input. 2024-07-30 10:49:14 -04:00
comfyanonymous
d0cc951625 Remove unnecessary code. 2024-07-30 05:01:34 -04:00
comfyanonymous
7f112b9d5d Improve artifacts on hydit, auraflow and SD3 on specific resolutions.
This breaks seeds for resolutions that are not a multiple of 16 in pixel
resolution by using circular padding instead of reflection padding but
should lower the amount of artifacts when doing img2img at those
resolutions.
2024-07-29 20:48:50 -04:00
comfyanonymous
a787d2dfc0 Let hunyuan dit work with all prompt lengths. 2024-07-26 12:11:32 -04:00
comfyanonymous
1824ded587 Hunyuan dit can now accept longer prompts. 2024-07-26 11:52:58 -04:00
comfyanonymous
06fb93c0d1 Basic hunyuan dit implementation. (#4102)
* Let tokenizers return weights to be stored in the saved checkpoint.

* Basic hunyuan dit implementation.

* Fix some resolutions not working.

* Support hydit checkpoint save.

* Init with right dtype.

* Switch to optimized attention in pooler.

* Fix black images on hunyuan dit.
2024-07-25 18:21:08 -04:00
comfyanonymous
ba8920ca60 Remove duplicate code. 2024-07-24 01:12:59 -04:00
comfyanonymous
4c066c4bc4 AuraFlow model implementation. 2024-07-11 16:52:26 -04:00
comfyanonymous
0a433146b6 Basic SD3 controlnet implementation.
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
comfyanonymous
b2a29fae8c Controlnet refactor. 2024-06-27 18:43:11 -04:00
comfyanonymous
928c1989f6 Squash depreciation warning on new pytorch. 2024-06-16 13:06:23 -04:00
comfyanonymous
1eb91dbfbb Initial support for the stable audio open model. 2024-06-15 12:14:56 -04:00
comfyanonymous
97af65d0dc Small optimization. 2024-06-15 02:44:38 -04:00
comfyanonymous
b9aea52255 Fix lowvram issue. 2024-06-12 10:39:33 -04:00
Dango233
8c3b1af91f Remove redundancy in mmdit.py (#3685) 2024-06-11 06:30:25 -04:00
comfyanonymous
cc2f32af2c SD3 Support. 2024-06-10 14:06:23 -04:00
comfyanonymous
93094050bb Remove some unused imports. 2024-05-27 19:08:27 -04:00