82 Commits

Author SHA1 Message Date
comfyanonymous
77b03b6251 Set WAN default compute dtype to fp16. 2025-03-07 04:52:36 -05:00
comfyanonymous
8e2c6489fe Support HunyuanVideo image to video model. 2025-03-06 03:07:15 -05:00
comfyanonymous
d7df07239f Adjust ltxv memory factor. 2025-03-05 05:16:05 -05:00
comfyanonymous
cd2c3f4935 Refactor skyreels i2v code. 2025-03-04 00:15:45 -05:00
comfyanonymous
69c61c5063 Better wan memory estimation. 2025-02-26 07:51:22 -05:00
comfyanonymous
94053d2ab3 WIP support for Wan I2V model. 2025-02-26 01:49:43 -05:00
comfyanonymous
6a7c4079a4 Wan seems to work with fp16. 2025-02-25 21:37:12 -05:00
comfyanonymous
3c67f6155a WIP support for Wan t2v model. 2025-02-25 17:20:35 -05:00
comfyanonymous
50a778e1ce Set the shift for Lumina back to 6. 2025-02-05 14:49:52 -05:00
comfyanonymous
0467641f12 Lower the default shift of lumina to reduce artifacts. 2025-02-04 06:50:37 -05:00
comfyanonymous
e03a640306 Support Lumina 2 model. 2025-02-04 04:16:30 -05:00
comfyanonymous
9ea569d2b0 Tweak hunyuan memory usage factor. 2025-01-16 06:31:03 -05:00
comfyanonymous
ad3ed4154c More accurate memory estimation for cosmos and hunyuan video. 2025-01-16 03:48:40 -05:00
comfyanonymous
f19e3ec763 Implement Cosmos Image/Video to World (Video) diffusion models.
Use CosmosImageToVideoLatent to set the input image/video.
2025-01-14 05:14:10 -05:00
comfyanonymous
6d9f172aeb WIP support for Nvidia Cosmos 7B and 14B text to world (video) models. 2025-01-10 09:14:16 -05:00
comfyanonymous
5c972e539e Closer memory estimation for hunyuan dit model. 2024-12-27 07:37:00 -05:00
comfyanonymous
b3fae54419 Closer memory estimation for pixart models. 2024-12-27 07:30:09 -05:00
City
a3a893abeb Add PixArt model support (#6055)
* PixArt initial version

* PixArt Diffusers convert logic

* pos_emb and interpolation logic

* Reduce  duplicate code

* Formatting

* Use optimized attention

* Edit empty token logic

* Basic PixArt LoRA support

* Fix aspect ratio logic

* PixArtAlpha text encode with conds

* Use same detection key logic for PixArt diffusers
2024-12-20 15:25:00 -05:00
comfyanonymous
aa5005ff35 Support llama hunyuan video text encoder in scaled fp8 format. 2024-12-17 04:19:22 -05:00
comfyanonymous
f642cc115b Adjust used dtypes for hunyuan video VAE and diffusion model. 2024-12-16 23:31:10 -05:00
comfyanonymous
2b49852ca2 Basic Hunyuan Video model support. 2024-12-16 19:35:40 -05:00
Chenlei Hu
efca88cfb3 Lint all unused variables (#5989)
* Enable F841

* Autofix

* Remove all unused variable assignment
2024-12-12 17:59:16 -05:00
comfyanonymous
fd97a4f060 Flux inpaint model does not work in fp16. 2024-11-26 01:33:01 -05:00
comfyanonymous
8f3fabbfe5 Support Lightricks LTX-Video model. 2024-11-22 08:46:39 -05:00
comfyanonymous
6042e06634 Support auto detecting some zsnr anime checkpoints. 2024-11-11 05:34:11 -05:00
comfyanonymous
4a8865c14d Set default shift on mochi to 6.0 2024-10-27 22:21:04 -04:00
comfyanonymous
1a27859ed1 float16 inference is a bit broken on mochi. 2024-10-27 04:56:40 -04:00
comfyanonymous
9f8e7912ef Basic Genmo Mochi video model support.
To use:
"Load CLIP" node with t5xxl + type mochi
"Load Diffusion Model" node with the mochi dit file.
"Load VAE" with the mochi vae file.

EmptyMochiLatentVideo node for the latent.
euler + linear_quadratic in the KSampler node.
2024-10-26 06:54:00 -04:00
comfyanonymous
567711396b Support scaled fp8 t5xxl model. 2024-10-20 22:27:00 -04:00
comfyanonymous
2e13ae7d8c Fix issue. 2024-08-22 10:38:24 -04:00
comfyanonymous
570da34f09 Try to fix SDXL OOM issue on some configurations. 2024-08-14 23:08:54 -04:00
comfyanonymous
6f69d4e0ec Add Flux fp16 support hack. 2024-08-07 15:08:39 -04:00
comfyanonymous
bcb4848096 Flux tweak memory usage. 2024-08-05 21:58:28 -04:00
comfyanonymous
2181bb7a57 Load T5 in fp8 if it's in fp8 in the Flux checkpoint. 2024-08-03 12:39:33 -04:00
comfyanonymous
b0eaa09c6a Better per model memory usage estimations. 2024-08-02 18:09:24 -04:00
comfyanonymous
fc6a27f36c Basic Flux Schnell and Flux Dev model implementation. 2024-08-01 09:49:29 -04:00
comfyanonymous
79ea2d3d12 Refactor: Move sd2_clip.py to text_encoders folder. 2024-07-28 01:19:20 -04:00
comfyanonymous
06fb93c0d1 Basic hunyuan dit implementation. (#4102)
* Let tokenizers return weights to be stored in the saved checkpoint.

* Basic hunyuan dit implementation.

* Fix some resolutions not working.

* Support hydit checkpoint save.

* Init with right dtype.

* Switch to optimized attention in pooler.

* Fix black images on hunyuan dit.
2024-07-25 18:21:08 -04:00
comfyanonymous
553fbe3407 Refactor: Move some code to the comfy/text_encoders folder. 2024-07-15 17:36:24 -04:00
comfyanonymous
1234807a19 Add a ModelSamplingAuraFlow node to change the shift value.
Set the default AuraFlow shift value to 1.73 (sqrt(3)).
2024-07-11 17:57:36 -04:00
comfyanonymous
4c066c4bc4 AuraFlow model implementation. 2024-07-11 16:52:26 -04:00
comfyanonymous
a709cce447 Support saving stable audio checkpoint that can be loaded back. 2024-06-27 11:06:52 -04:00
comfyanonymous
1eb91dbfbb Initial support for the stable audio open model. 2024-06-15 12:14:56 -04:00
comfyanonymous
9d4f62e30d Single and dual clip loader nodes support SD3.
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
2024-06-11 23:27:39 -04:00
comfyanonymous
917810a2c6 Load the SD3 T5xxl model in the same dtype stored in the checkpoint. 2024-06-11 17:03:26 -04:00
comfyanonymous
c7e715e64a Support multiple text encoder configurations on SD3. 2024-06-11 13:14:43 -04:00
comfyanonymous
cc2f32af2c SD3 Support. 2024-06-10 14:06:23 -04:00
comfyanonymous
d4db823cfe Only enable attention upcasting on models that actually need it. 2024-05-14 17:00:50 -04:00
comfyanonymous
bc8bef3daa Support for CosXL models. 2024-04-05 10:53:41 -04:00
comfyanonymous
284361ba73 IP2P model loading support.
This is the code to load the model and inference it with only a text
prompt. This commit does not contain the nodes to properly use it with an
image input.

This supports both the original SD1 instructpix2pix model and the
diffusers SDXL one.
2024-03-31 03:10:28 -04:00