697 Commits

Author SHA1 Message Date
comfyanonymous
809b7f0b78 fp8 weight support for Stable Cascade. 2024-02-17 15:27:31 -05:00
comfyanonymous
511e70ab62 Fix attention mask batch size in some attention functions. 2024-02-17 15:22:21 -05:00
comfyanonymous
4a9216bca3 Properly fix attention masks in CLIP with batches. 2024-02-17 12:13:13 -05:00
comfyanonymous
8d4def2e89 Implement shift schedule for cascade stage C. 2024-02-17 11:38:47 -05:00
comfyanonymous
cabdbc2529 Manual cast for bf16 on older GPUs. 2024-02-17 09:01:17 -05:00
comfyanonymous
b527789f52 Fix clip attention mask issues on some hardware. 2024-02-17 07:53:52 -05:00
comfyanonymous
73407209f5 Make Stable Cascade work on old pytorch 2.0 2024-02-17 00:42:30 -05:00
comfyanonymous
56db0bef1e Support Stable Cascade Stage B lite. 2024-02-16 23:41:23 -05:00
comfyanonymous
b3c820556b Make --force-fp32 disable loading models in bf16. 2024-02-16 23:01:54 -05:00
comfyanonymous
b102d65c41 StableCascade CLIP model support. 2024-02-16 13:29:04 -05:00
comfyanonymous
e5a0f735be Stable Cascade Stage B. 2024-02-16 13:02:03 -05:00
comfyanonymous
deebc95781 Stable Cascade Stage C. 2024-02-16 10:55:08 -05:00
comfyanonymous
ce56ca3f9d Stable Cascade Stage A. 2024-02-16 06:30:39 -05:00
comfyanonymous
a3ada6af3b Small refactor of is_device_* functions. 2024-02-15 21:10:10 -05:00
comfyanonymous
0fc2468c50 Don't init the CLIP model when the checkpoint has no CLIP weights. 2024-02-13 00:01:08 -05:00
comfyanonymous
92f7466c12 Merge branch 'feature_expose_discard_penultimate_sigma' of https://github.com/blepping/ComfyUI 2024-02-11 12:23:30 -05:00
Jedrzej Kosinski
3172bb042e Fix infinite while loop being possible in ddim_scheduler 2024-02-09 17:11:34 -06:00
comfyanonymous
f3cb1f0b39 Add a way to set different conditioning for the controlnet. 2024-02-09 14:13:31 -05:00
blepping
5b3c8f3506 Allow custom samplers to request discard penultimate sigma 2024-02-08 02:24:23 -07:00
comfyanonymous
1cec78c95e Don't use numpy for calculating sigmas. 2024-02-07 18:52:51 -05:00
comfyanonymous
67ed9f9fb5 Make minimum tile size the size of the overlap. 2024-02-05 01:29:26 -05:00
comfyanonymous
1bbaf69344 Don't use is_bf16_supported to check for fp16 support. 2024-02-04 20:53:35 -05:00
comfyanonymous
5efb046482 Speed up SDXL on 16xx series with fp16 weights and manual cast. 2024-02-04 13:23:43 -05:00
comfyanonymous
32be22279f Always use fp16 for the text encoders. 2024-02-02 10:02:49 -05:00
comfyanonymous
6444e0a073 Put VAE key name in model config. 2024-01-30 02:24:38 -05:00
comfyanonymous
50fb52bc5b Remove some unused imports. 2024-01-25 23:42:37 -05:00
Dr.Lt.Data
f91644b5e9 typo fix - calculate_sigmas_scheduler (#2619)
self.scheduler -> scheduler_name

Co-authored-by: Lt.Dr.Data <lt.dr.data@gmail.com>
2024-01-23 03:47:01 -05:00
comfyanonymous
2f33a09886 Cleanup some unused imports. 2024-01-21 21:51:22 -05:00
comfyanonymous
3d6af7145d Remove useless import. 2024-01-19 15:38:05 -05:00
comfyanonymous
8739736c6e Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
2024-01-17 19:46:21 -05:00
comfyanonymous
96232a0a45 Only auto enable bf16 VAE on nvidia GPUs that actually support it. 2024-01-15 03:10:22 -05:00
comfyanonymous
30b062a477 Make unclip more deterministic.
Pass a seed argument note that this might make old unclip images different.
2024-01-14 17:28:31 -05:00
comfyanonymous
75966467dc Make server storage the default.
Remove --server-storage argument.
2024-01-11 17:21:40 -05:00
comfyanonymous
50b460c768 Don't round noise mask. 2024-01-11 03:29:58 -05:00
comfyanonymous
006560b913 Add InpaintModelConditioning node.
This is an alternative to VAE Encode for inpaint that should work with
lower denoise.

This is a different take on #2501
2024-01-11 03:15:27 -05:00
comfyanonymous
e0235effa4 Fix issue when using multiple t2i adapters with batched images. 2024-01-10 04:00:49 -05:00
comfyanonymous
62a7bf2919 Use basic attention implementation for small inputs on old pytorch. 2024-01-09 13:46:52 -05:00
pythongosssss
9f2a191a0e Store user settings/data on the server and multi user support (#2160)
* wip per user data

* Rename, hide menu

* better error
rework default user

* store pretty

* Add userdata endpoints
Change nodetemplates to userdata

* add multi user message

* make normal arg

* Fix tests

* Ignore user dir

* user tests

* Changed to default to browser storage and add server-storage arg

* fix crash on empty templates

* fix settings added before load

* ignore parse errors
2024-01-08 17:06:44 -05:00
comfyanonymous
8cf0a2dfe7 Update optimized_attention_for_device function for new functions that
support masked attention.
2024-01-07 13:52:08 -05:00
comfyanonymous
f9f0822512 Add attention mask support to sub quad attention. 2024-01-07 04:13:58 -05:00
comfyanonymous
59259b0de3 Support attention mask in split attention. 2024-01-06 13:16:48 -05:00
comfyanonymous
1240b45932 Implement attention mask on xformers. 2024-01-06 04:33:03 -05:00
comfyanonymous
a36114ce30 Implement noise augmentation for SD 4X upscale model. 2024-01-03 14:27:11 -05:00
comfyanonymous
004cf09984 Fix model patches not working in custom sampling scheduler nodes. 2024-01-03 12:16:30 -05:00
comfyanonymous
7629685d08 Add support for the stable diffusion x4 upscaling model.
This is an old model.

Load the checkpoint like a regular one and use the new
SD_4XUpscale_Conditioning node.
2024-01-03 03:37:56 -05:00
comfyanonymous
16da9f6446 Fix regression. 2024-01-02 14:41:33 -05:00
comfyanonymous
5e3372d45c Refactor VAE code.
Replace constants with downscale_ratio and latent_channels.
2024-01-02 13:24:34 -05:00
comfyanonymous
4fd8339694 Auto detect out_channels from model. 2024-01-02 01:50:57 -05:00
comfyanonymous
d41cf1e412 Remove useless code. 2024-01-02 01:50:29 -05:00
comfyanonymous
25ec26ff9c Add argument to run the VAE on the CPU. 2023-12-30 05:49:07 -05:00