comfyanonymous
4e7fcb5e95
Remove the ckpt_path from load_state_dict_guess_config.
2024-08-11 08:37:35 -04:00
ljleb
a5193f9c4c
alternative to load_checkpoint_guess_config that accepts a loaded state dict ( #4249 )
...
* make alternative fn
* add back ckpt path as 2nd argument?
2024-08-11 08:36:52 -04:00
comfyanonymous
2f4624cf42
Fix issues with #4302 and support loading diffusers format flux.
2024-08-10 21:28:24 -04:00
Jaret Burkett
fd5b77aba9
FLUX: Added full diffusers mapping for FLUX.1 schnell and dev. Adds full LoRA support from diffusers LoRAs. ( #4302 )
2024-08-10 21:26:41 -04:00
comfyanonymous
cbb1bde521
Fix some issues with inference slowing down.
2024-08-10 16:21:25 -04:00
comfyanonymous
845f52cabc
Speed up hunyuan dit inference a bit.
2024-08-10 07:36:27 -04:00
comfyanonymous
4e986745a1
Fix regression.
2024-08-09 21:45:21 -04:00
comfyanonymous
075b187132
Fix regression.
2024-08-09 14:02:38 -04:00
TTPlanetPig
3a0da5cff6
Update controlnet.py to fix the default controlnet weight as constant ( #4285 )
2024-08-09 13:40:05 -04:00
comfyanonymous
4d842f2344
Better fix for lowvram issue.
2024-08-09 12:16:25 -04:00
comfyanonymous
4f5ec9bbc2
Fix controlnet regression.
2024-08-09 12:08:58 -04:00
comfyanonymous
502ace54a4
Fix issue with some lowvram weights.
2024-08-09 03:58:28 -04:00
comfyanonymous
1280396253
Fix regression.
2024-08-09 03:36:40 -04:00
comfyanonymous
90c65ed934
Implement text encoder part of HunyuanDiT loras.
2024-08-09 03:21:10 -04:00
comfyanonymous
24d1c00725
Cleanup HunyuanDit controlnets.
...
Use the: ControlNetApply SD3 and HunyuanDiT node.
2024-08-09 02:59:34 -04:00
来新璐
298a7149d3
feat: add support for HunYuanDit ControlNet ( #4245 )
...
* add support for HunYuanDit ControlNet
* fix hunyuandit controlnet
* fix typo in hunyuandit controlnet
* fix typo in hunyuandit controlnet
* fix code format style
* add control_weight support for HunyuanDit Controlnet
* use control_weights in HunyuanDit Controlnet
* fix typo
2024-08-09 02:59:24 -04:00
comfyanonymous
ef493ebbf8
Raw torch is faster than einops?
2024-08-08 22:09:29 -04:00
comfyanonymous
8e1189dae5
Cleaner code.
2024-08-08 20:07:09 -04:00
comfyanonymous
114af84d12
Try to improve inference speed on some machines.
2024-08-08 17:29:27 -04:00
comfyanonymous
37d704b5d6
Better prints.
2024-08-08 17:29:27 -04:00
comfyanonymous
4f196c19a3
Fix.
2024-08-08 15:16:51 -04:00
comfyanonymous
6e0e401ebe
Support diffusers text attention flux loras.
2024-08-08 14:45:52 -04:00
comfyanonymous
ede5622146
Partial model shift support.
2024-08-08 14:45:06 -04:00
comfyanonymous
6f69d4e0ec
Add Flux fp16 support hack.
2024-08-07 15:08:39 -04:00
comfyanonymous
5a25225024
Make supported_dtypes a priority list.
2024-08-07 15:00:06 -04:00
comfyanonymous
57697eb7cf
Workaround for lora OOM on lowvram mode.
2024-08-07 14:30:54 -04:00
comfyanonymous
25bcb846a8
Fix "Comfy" lora keys.
...
They are in this format now:
diffusion_model.full.model.key.name.lora_up.weight
2024-08-07 13:49:31 -04:00
comfyanonymous
7c94219393
Fix bundled embed.
2024-08-07 13:30:45 -04:00
comfyanonymous
a6d6c2d378
Support for "Comfy" lora format.
...
The keys are just: model.full.model.key.name.lora_up.weight
It is supported by all comfyui supported models.
Now people can just convert loras to this format instead of having to ask
for me to implement them.
2024-08-07 13:18:32 -04:00
comfyanonymous
3e01ab3a66
Controlnet code refactor.
2024-08-07 12:59:28 -04:00
comfyanonymous
04f70b853e
Support format for embeddings bundled in loras.
2024-08-07 03:45:25 -04:00
comfyanonymous
001ff4d6a6
Fix OOMs happening in some cases.
...
A cloned model patcher sometimes reported a model was loaded on a device
when it wasn't.
2024-08-06 13:36:04 -04:00
comfyanonymous
5228fbf0ad
Unload models and load them back in lowvram mode no free vram.
2024-08-06 03:22:39 -04:00
comfyanonymous
bcb4848096
Flux tweak memory usage.
2024-08-05 21:58:28 -04:00
comfyanonymous
f7183e2c73
Improve performance on some lowend GPUs.
2024-08-05 16:24:04 -04:00
a-One-Fan
2e56b50183
Fix Flux FP64 math on XPU ( #4210 )
2024-08-05 01:26:20 -04:00
comfyanonymous
261c6ba855
Support simple diffusers Flux loras.
2024-08-04 22:05:48 -04:00
Silver
b87a10e5f1
Correct spelling 'token_weight_pars_t5' to 'token_weight_pairs_t5' ( #4200 )
2024-08-04 17:10:02 -04:00
comfyanonymous
8e7aa23b6a
ONNX tracing fixes.
2024-08-04 15:45:43 -04:00
comfyanonymous
85fadea55c
Fix issue with some custom nodes.
2024-08-04 10:03:33 -04:00
comfyanonymous
10ad73d520
Fix crash.
2024-08-03 16:55:38 -04:00
comfyanonymous
e7287d2fc2
Tweak lowvram memory formula.
2024-08-03 16:44:50 -04:00
comfyanonymous
d4ca060482
Lower lowvram memory to 1/3 of free memory.
2024-08-03 15:14:07 -04:00
comfyanonymous
f27f0f8a48
Fix some issues.
2024-08-03 15:06:40 -04:00
comfyanonymous
e83d97d649
Cap lowvram to half of free memory.
2024-08-03 14:50:20 -04:00
comfyanonymous
753d9640f9
Automatically use fp8 for diffusion model weights if:
...
Checkpoint contains weights in fp8.
There isn't enough memory to load the diffusion model in GPU vram.
2024-08-03 13:45:19 -04:00
comfyanonymous
2181bb7a57
Load T5 in fp8 if it's in fp8 in the Flux checkpoint.
2024-08-03 12:39:33 -04:00
comfyanonymous
2878ffd75a
More aggressive batch splitting.
2024-08-03 11:53:30 -04:00
comfyanonymous
b0eaa09c6a
Better per model memory usage estimations.
2024-08-02 18:09:24 -04:00
comfyanonymous
e2284e5609
Tweak regular SD memory formula.
2024-08-02 17:34:30 -04:00
