Chris Chance
035a370fa1
disable autocast if MPS is available
...
AMP Autocast not available on current pytorch, will be added in 2.5+ version and nightlies but those are buggy, for now just disable AMP if we're on MPS.
2024-10-15 14:53:54 -04:00
kijai
09ed641575
fix LoRA for I2V model when using fp8
2024-10-14 01:05:35 +03:00
kijai
0f5d67a9a9
Update nodes.py
2024-10-13 23:05:50 +03:00
kijai
42c46b76e1
Error on too long prompts.
2024-10-13 15:38:06 +03:00
kijai
a995247624
possibly fix LoRA scaling
2024-10-12 22:23:54 +03:00
kijai
276b3b86d9
possible fix for NaNs when using LoRA and fp8
2024-10-12 02:24:53 +03:00
kijai
bf0f6888c2
fix fp8 with controlnet
2024-10-08 18:05:28 +03:00
kijai
d76229c49b
controlnet support
...
https://huggingface.co/TheDenk/cogvideox-2b-controlnet-hed-v1
https://huggingface.co/TheDenk/cogvideox-2b-controlnet-canny-v1
2024-10-08 16:22:07 +03:00
kijai
d83f64aa3e
don't break MZ loader for no reason
2024-10-08 14:53:19 +03:00
kijai
e1a784d92b
error out if trying to use I2V model with other frame counts than 49
2024-10-07 22:15:06 +03:00
Jukka Seppänen
f657e0d56e
allow tiny resolutions (it actually works with fun models)
2024-10-07 01:06:22 +03:00
Jukka Seppänen
49451c4a22
support sageattn
...
https://github.com/thu-ml/SageAttention
2024-10-06 20:26:03 +03:00
kijai
502ebab83f
support extra_model_paths
2024-10-06 12:39:57 +03:00
kijai
af2a568c8e
Update nodes.py
2024-10-06 11:54:47 +03:00
kijai
fc7e7d7c62
peft
2024-10-06 11:53:38 +03:00
kijai
d8a9f31de9
lora loading
2024-10-06 02:48:39 +03:00
kijai
5fde34468e
update workflows
2024-10-06 02:22:35 +03:00
kijai
00d38f9a22
context schedule and all samplers for the non-Fun sampler as well
2024-10-06 01:28:20 +03:00
kijai
1801c65e97
FreeNoise noise shuffling for context windows
2024-10-05 19:29:09 +03:00
kijai
6e82eb1618
Update nodes.py
2024-10-05 16:16:44 +03:00
kijai
453ee1606e
Add context schedules for the control pipeline
2024-10-05 16:15:34 +03:00
kijai
033ec61d86
Update nodes.py
2024-10-04 13:19:13 +03:00
kijai
7af6666c67
latent input for the control sampler, allows vid2vid along with pose input
2024-10-04 13:14:54 +03:00
kijai
3c8183ac65
Support lora loading with fp8, noise augment for control input
2024-10-04 12:48:32 +03:00
kijai
3efe90ba35
Support CogVideoX-Fun lora loading
2024-10-04 01:53:40 +03:00
kijai
f9f06d595e
temporal tiling for the control pipe
2024-10-02 20:14:45 +03:00
kijai
bb6ea6b3a4
Update nodes.py
2024-10-02 18:39:15 +03:00
kijai
627af9341c
separate control image encoder and add tiled encode support for it
...
tiled encoding code thanks to MinusZoneML:
https://github.com/MinusZoneAI/ComfyUI-CogVideoX-MZ/blob/main/mz_enable_vae_encode_tiling.py
2024-10-02 18:08:11 +03:00
kijai
3de0113927
Separate CogVideoX-Fun vid2vid and control samplers, add automatic tile size for decode
2024-10-01 17:09:44 +03:00
kijai
03f237f925
fun pose GGUF
2024-10-01 00:07:32 +03:00
Jukka Seppänen
f3a1ff933e
Add control strenght, start and end percent adjustments
2024-09-30 17:50:48 +03:00
Jukka Seppänen
dbeea9bfb8
Update nodes.py
2024-09-30 16:12:15 +03:00
kijai
55325f97a7
initial CogVideoX-Fun 1.1 support
...
every possible model/workflow combination not tested yet
2024-09-30 13:57:37 +03:00
kijai
81adb0220b
remove prints
2024-09-23 14:40:41 +03:00
kijai
d0d7308da5
Experimenting with block removal
2024-09-23 14:17:34 +03:00
kijai
d4958e4c36
check for diffusers version
2024-09-23 11:19:17 +03:00
kijai
fad6b4521f
fix the case of PAB + GGUF + I2V
2024-09-23 11:11:44 +03:00
Jukka Seppänen
7f3a768d95
cleanup
2024-09-23 03:10:45 +03:00
Jukka Seppänen
49e42c5dc6
Update nodes.py
2024-09-23 02:20:24 +03:00
Jukka Seppänen
01a9f8ca51
Update nodes.py
2024-09-23 01:58:07 +03:00
kijai
299cea851f
PAB for Fun
2024-09-23 01:11:58 +03:00
kijai
d9abc00d3b
PAB for GGUF too
2024-09-23 00:08:37 +03:00
kijai
2e22d4fa0c
Update nodes.py
2024-09-22 21:34:17 +03:00
kijai
81c5447ca3
update
2024-09-22 21:14:03 +03:00
kijai
93edf24631
initial experimental PAB support (only normal text2vid for now)
2024-09-22 20:47:32 +03:00
kijai
3c8e939f8e
Add more schedulers for "fun" model
2024-09-22 18:12:50 +03:00
kijai
d3d7f043cd
Allow sequential_cpu_offload for GGUF too
2024-09-22 17:03:28 +03:00
kijai
2a71aba1aa
remove print
2024-09-22 16:09:00 +03:00
kijai
21675b296b
Add 5b I2V GGUF
...
https://huggingface.co/Kijai/CogVideoX_GGUF/blob/main/CogVideoX_5b_I2V_GGUF_Q4_0.safetensors
2024-09-22 16:07:32 +03:00
kijai
006507a9fe
Don't overwrite sequential cpu offloading in the fun sampler
2024-09-21 16:46:59 +03:00