comfyanonymous
5228fbf0ad
Unload models and load them back in lowvram mode no free vram.
2024-08-06 03:22:39 -04:00
Robin Huang
006782db44
Clone taesd with depth of 1 to reduce download size. ( #4232 )
2024-08-06 01:46:09 -04:00
Silver
a4c5e04e27
Add format metadata to CLIP save to make compatible with diffusers safetensors loading ( #4233 )
2024-08-06 01:45:24 -04:00
Chenlei Hu
e4558e56aa
Change browser test CI python to 3.8 ( #4234 )
2024-08-06 01:27:28 -04:00
comfyanonymous
bcb4848096
Flux tweak memory usage.
2024-08-05 21:58:28 -04:00
Robin Huang
96a3497015
Stable release uses cached dependencies ( #4231 )
...
* Release stable based on existing tag.
* Update default cuda to 12.1.
2024-08-05 20:07:16 -04:00
comfyanonymous
f7183e2c73
Improve performance on some lowend GPUs.
2024-08-05 16:24:04 -04:00
comfyanonymous
5c0c9b8503
This probably doesn't work anymore.
2024-08-05 12:31:42 -04:00
bymyself
34d26e8fb6
Don't cache index.html ( #4211 )
2024-08-05 12:25:28 -04:00
a-One-Fan
2e56b50183
Fix Flux FP64 math on XPU ( #4210 )
2024-08-05 01:26:20 -04:00
comfyanonymous
261c6ba855
Support simple diffusers Flux loras.
2024-08-04 22:05:48 -04:00
Silver
b87a10e5f1
Correct spelling 'token_weight_pars_t5' to 'token_weight_pairs_t5' ( #4200 )
2024-08-04 17:10:02 -04:00
comfyanonymous
2ba49bbd82
Set the step in EmptySD3LatentImage to 16.
...
These models work better when the res is a multiple of 16.
2024-08-04 15:59:02 -04:00
comfyanonymous
8e7aa23b6a
ONNX tracing fixes.
2024-08-04 15:45:43 -04:00
comfyanonymous
85fadea55c
Fix issue with some custom nodes.
2024-08-04 10:03:33 -04:00
comfyanonymous
55c9c01bec
ModelSamplingFlux now takes a resolution and adjusts the shift with it.
...
If you want to sample Flux dev exactly how the reference code does use
the same resolution as your image in this node.
2024-08-04 04:06:00 -04:00
comfyanonymous
10ad73d520
Fix crash.
2024-08-03 16:55:38 -04:00
comfyanonymous
e7287d2fc2
Tweak lowvram memory formula.
2024-08-03 16:44:50 -04:00
comfyanonymous
d4ca060482
Lower lowvram memory to 1/3 of free memory.
2024-08-03 15:14:07 -04:00
comfyanonymous
f27f0f8a48
Fix some issues.
2024-08-03 15:06:40 -04:00
comfyanonymous
e83d97d649
Cap lowvram to half of free memory.
2024-08-03 14:50:20 -04:00
comfyanonymous
753d9640f9
Automatically use fp8 for diffusion model weights if:
...
Checkpoint contains weights in fp8.
There isn't enough memory to load the diffusion model in GPU vram.
2024-08-03 13:45:19 -04:00
comfyanonymous
2181bb7a57
Load T5 in fp8 if it's in fp8 in the Flux checkpoint.
2024-08-03 12:39:33 -04:00
comfyanonymous
2878ffd75a
More aggressive batch splitting.
2024-08-03 11:53:30 -04:00
comfyanonymous
ad4292b964
Add ModelSamplingFlux to experiment with the shift value.
...
Default shift on Flux Schnell is 0.0
2024-08-03 03:54:38 -04:00
comfyanonymous
16ac61d4d0
Add advanced model merge node for Flux model.
2024-08-02 23:20:53 -04:00
comfyanonymous
b0eaa09c6a
Better per model memory usage estimations.
2024-08-02 18:09:24 -04:00
comfyanonymous
e2284e5609
Tweak regular SD memory formula.
2024-08-02 17:34:30 -04:00
comfyanonymous
ebc7233402
Better Flux vram estimation.
2024-08-02 17:02:35 -04:00
comfyanonymous
cd49c56d20
Fix bug loading flac workflow when it contains = character.
2024-08-02 13:14:28 -04:00
fgdfgfthgr-fox
fccdd04ee7
Lower SAG scale step for finer control ( #4158 )
...
* Lower SAG step for finer control
Since the introduction of cfg++ which uses very low cfg value, a step of 0.1 in SAG might be too high for finer control. Even SAG of 0.1 can be too high when cfg is only 0.6, so I change the step to 0.01.
* Lower PAG step as well.
* Update nodes_sag.py
2024-08-02 10:29:03 -04:00
comfyanonymous
851720f59f
Add FluxGuidance node.
...
This lets you adjust the guidance on the dev model which is a parameter
that is passed to the diffusion model.
2024-08-02 10:25:49 -04:00
Jairo Correa
794358e877
Add missing import ( #4174 )
2024-08-02 09:34:12 -04:00
comfyanonymous
33912774fb
Fix no longer working on old pytorch.
2024-08-01 22:20:24 -04:00
Alexander Brown
90267ffb3a
Fix clip_g/clip_l mixup ( #4168 )
2024-08-01 21:40:56 -04:00
comfyanonymous
a06d0ff763
Hack to make all resolutions work on Flux models.
2024-08-01 21:39:18 -04:00
comfyanonymous
2c3ecacc4d
Add CLIPTextEncodeFlux.
2024-08-01 18:53:25 -04:00
comfyanonymous
49c0c333d3
Tweak the memory usage formulas for Flux and SD.
2024-08-01 17:53:45 -04:00
comfyanonymous
f176649e08
Make ComfyUI split batches a higher priority than weight offload.
2024-08-01 16:39:59 -04:00
comfyanonymous
516d71d227
Fast preview support for Flux.
2024-08-01 16:28:11 -04:00
comfyanonymous
f5b2fc6e6b
Fix bfloat16 potentially not being enabled on mps.
2024-08-01 16:18:44 -04:00
comfyanonymous
bd6f023ff6
Try to fix mac issue.
2024-08-01 13:41:27 -04:00
comfyanonymous
085eed028e
Rename UNETLoader node to "Load Diffusion Model".
2024-08-01 13:33:30 -04:00
comfyanonymous
5606d85b07
Add a way to load the diffusion model in fp8 with UNETLoader node.
2024-08-01 13:30:51 -04:00
comfyanonymous
30a15dd5e1
Better Mac support on flux model.
2024-08-01 13:10:50 -04:00
comfyanonymous
faad5f1cdb
Make lowvram more aggressive on low memory machines.
2024-08-01 12:11:57 -04:00
comfyanonymous
c0797230e2
Add link to Flux examples to readme.
2024-08-01 11:48:19 -04:00
comfyanonymous
5d5b9dcf89
Fix .sft file loading (they are safetensors files).
2024-08-01 11:32:58 -04:00
comfyanonymous
d6d48306d8
Load flux t5 in fp8 if weights are in fp8.
2024-08-01 11:05:56 -04:00
comfyanonymous
96dbbd23d8
Fix old python versions no longer working.
2024-08-01 09:57:20 -04:00
