comfyanonymous
9ea569d2b0
Tweak hunyuan memory usage factor.
2025-01-16 06:31:03 -05:00
comfyanonymous
ad3ed4154c
More accurate memory estimation for cosmos and hunyuan video.
2025-01-16 03:48:40 -05:00
comfyanonymous
f19e3ec763
Implement Cosmos Image/Video to World (Video) diffusion models.
...
Use CosmosImageToVideoLatent to set the input image/video.
2025-01-14 05:14:10 -05:00
comfyanonymous
6d9f172aeb
WIP support for Nvidia Cosmos 7B and 14B text to world (video) models.
2025-01-10 09:14:16 -05:00
comfyanonymous
5c972e539e
Closer memory estimation for hunyuan dit model.
2024-12-27 07:37:00 -05:00
comfyanonymous
b3fae54419
Closer memory estimation for pixart models.
2024-12-27 07:30:09 -05:00
City
a3a893abeb
Add PixArt model support ( #6055 )
...
* PixArt initial version
* PixArt Diffusers convert logic
* pos_emb and interpolation logic
* Reduce duplicate code
* Formatting
* Use optimized attention
* Edit empty token logic
* Basic PixArt LoRA support
* Fix aspect ratio logic
* PixArtAlpha text encode with conds
* Use same detection key logic for PixArt diffusers
2024-12-20 15:25:00 -05:00
comfyanonymous
aa5005ff35
Support llama hunyuan video text encoder in scaled fp8 format.
2024-12-17 04:19:22 -05:00
comfyanonymous
f642cc115b
Adjust used dtypes for hunyuan video VAE and diffusion model.
2024-12-16 23:31:10 -05:00
comfyanonymous
2b49852ca2
Basic Hunyuan Video model support.
2024-12-16 19:35:40 -05:00
Chenlei Hu
efca88cfb3
Lint all unused variables ( #5989 )
...
* Enable F841
* Autofix
* Remove all unused variable assignment
2024-12-12 17:59:16 -05:00
comfyanonymous
fd97a4f060
Flux inpaint model does not work in fp16.
2024-11-26 01:33:01 -05:00
comfyanonymous
8f3fabbfe5
Support Lightricks LTX-Video model.
2024-11-22 08:46:39 -05:00
comfyanonymous
6042e06634
Support auto detecting some zsnr anime checkpoints.
2024-11-11 05:34:11 -05:00
comfyanonymous
4a8865c14d
Set default shift on mochi to 6.0
2024-10-27 22:21:04 -04:00
comfyanonymous
1a27859ed1
float16 inference is a bit broken on mochi.
2024-10-27 04:56:40 -04:00
comfyanonymous
9f8e7912ef
Basic Genmo Mochi video model support.
...
To use:
"Load CLIP" node with t5xxl + type mochi
"Load Diffusion Model" node with the mochi dit file.
"Load VAE" with the mochi vae file.
EmptyMochiLatentVideo node for the latent.
euler + linear_quadratic in the KSampler node.
2024-10-26 06:54:00 -04:00
comfyanonymous
567711396b
Support scaled fp8 t5xxl model.
2024-10-20 22:27:00 -04:00
comfyanonymous
2e13ae7d8c
Fix issue.
2024-08-22 10:38:24 -04:00
comfyanonymous
570da34f09
Try to fix SDXL OOM issue on some configurations.
2024-08-14 23:08:54 -04:00
comfyanonymous
6f69d4e0ec
Add Flux fp16 support hack.
2024-08-07 15:08:39 -04:00
comfyanonymous
bcb4848096
Flux tweak memory usage.
2024-08-05 21:58:28 -04:00
comfyanonymous
2181bb7a57
Load T5 in fp8 if it's in fp8 in the Flux checkpoint.
2024-08-03 12:39:33 -04:00
comfyanonymous
b0eaa09c6a
Better per model memory usage estimations.
2024-08-02 18:09:24 -04:00
comfyanonymous
fc6a27f36c
Basic Flux Schnell and Flux Dev model implementation.
2024-08-01 09:49:29 -04:00
comfyanonymous
79ea2d3d12
Refactor: Move sd2_clip.py to text_encoders folder.
2024-07-28 01:19:20 -04:00
comfyanonymous
06fb93c0d1
Basic hunyuan dit implementation. ( #4102 )
...
* Let tokenizers return weights to be stored in the saved checkpoint.
* Basic hunyuan dit implementation.
* Fix some resolutions not working.
* Support hydit checkpoint save.
* Init with right dtype.
* Switch to optimized attention in pooler.
* Fix black images on hunyuan dit.
2024-07-25 18:21:08 -04:00
comfyanonymous
553fbe3407
Refactor: Move some code to the comfy/text_encoders folder.
2024-07-15 17:36:24 -04:00
comfyanonymous
1234807a19
Add a ModelSamplingAuraFlow node to change the shift value.
...
Set the default AuraFlow shift value to 1.73 (sqrt(3)).
2024-07-11 17:57:36 -04:00
comfyanonymous
4c066c4bc4
AuraFlow model implementation.
2024-07-11 16:52:26 -04:00
comfyanonymous
a709cce447
Support saving stable audio checkpoint that can be loaded back.
2024-06-27 11:06:52 -04:00
comfyanonymous
1eb91dbfbb
Initial support for the stable audio open model.
2024-06-15 12:14:56 -04:00
comfyanonymous
9d4f62e30d
Single and dual clip loader nodes support SD3.
...
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
2024-06-11 23:27:39 -04:00
comfyanonymous
917810a2c6
Load the SD3 T5xxl model in the same dtype stored in the checkpoint.
2024-06-11 17:03:26 -04:00
comfyanonymous
c7e715e64a
Support multiple text encoder configurations on SD3.
2024-06-11 13:14:43 -04:00
comfyanonymous
cc2f32af2c
SD3 Support.
2024-06-10 14:06:23 -04:00
comfyanonymous
d4db823cfe
Only enable attention upcasting on models that actually need it.
2024-05-14 17:00:50 -04:00
comfyanonymous
bc8bef3daa
Support for CosXL models.
2024-04-05 10:53:41 -04:00
comfyanonymous
284361ba73
IP2P model loading support.
...
This is the code to load the model and inference it with only a text
prompt. This commit does not contain the nodes to properly use it with an
image input.
This supports both the original SD1 instructpix2pix model and the
diffusers SDXL one.
2024-03-31 03:10:28 -04:00
comfyanonymous
494bd7579e
Support SDXS 0.9
2024-03-27 23:58:58 -04:00
comfyanonymous
b5fc494ded
SV3D support.
2024-03-18 16:54:13 -04:00
comfyanonymous
3ed779e575
Make saved SD1 checkpoints match more closely the official one.
2024-03-18 00:26:23 -04:00
comfyanonymous
79e83f92e8
Koala 700M and 1B support.
...
Use the UNET Loader node to load the unet file to use them.
2024-02-28 12:10:11 -05:00
comfyanonymous
4a76090e6a
Auto detect playground v2.5 model.
2024-02-27 18:03:03 -05:00
comfyanonymous
87ba3045a4
Make XL checkpoints save in a more standard format.
2024-02-27 02:07:40 -05:00
comfyanonymous
9e5c5a0ad3
Move text projection into the CLIP model code.
...
Fix issue with not loading the SSD1B clip correctly.
2024-02-25 01:41:08 -05:00
comfyanonymous
f940826501
Support Stable Cascade in checkpoint format.
2024-02-19 11:20:48 -05:00
comfyanonymous
4575a1c500
Some cleanups to how the text encoders are loaded.
2024-02-19 10:46:30 -05:00
comfyanonymous
8d4def2e89
Implement shift schedule for cascade stage C.
2024-02-17 11:38:47 -05:00
comfyanonymous
b102d65c41
StableCascade CLIP model support.
2024-02-16 13:29:04 -05:00
