707 Commits

Author SHA1 Message Date
comfyanonymous
084f3a1561 Align simple scheduling closer to official stable cascade scheduler. 2024-02-20 04:24:39 -05:00
comfyanonymous
f4e74ae786 Enable fp16 by default on mps. 2024-02-19 12:00:48 -05:00
comfyanonymous
7ea7ac1414 Remove print. 2024-02-19 11:47:26 -05:00
comfyanonymous
f940826501 Support Stable Cascade in checkpoint format. 2024-02-19 11:20:48 -05:00
comfyanonymous
4575a1c500 Some cleanups to how the text encoders are loaded. 2024-02-19 10:46:30 -05:00
comfyanonymous
1067555cae Forgot to commit this. 2024-02-19 04:25:46 -05:00
comfyanonymous
217e660839 Support loading the Stable Cascade effnet and previewer as a VAE.
The effnet can be used to encode images for img2img with Stage C.
2024-02-19 04:10:01 -05:00
comfyanonymous
ad760b32de Fix gligen lowvram mode. 2024-02-18 02:20:23 -05:00
comfyanonymous
3518d94368 Add ModelSamplingStableCascade to control the shift sampling parameter.
shift is 2.0 by default on Stage C and 1.0 by default on Stage B.
2024-02-18 00:55:23 -05:00
comfyanonymous
681300661a Fix attention masks properly for multiple batches. 2024-02-17 16:15:18 -05:00
comfyanonymous
809b7f0b78 fp8 weight support for Stable Cascade. 2024-02-17 15:27:31 -05:00
comfyanonymous
511e70ab62 Fix attention mask batch size in some attention functions. 2024-02-17 15:22:21 -05:00
comfyanonymous
4a9216bca3 Properly fix attention masks in CLIP with batches. 2024-02-17 12:13:13 -05:00
comfyanonymous
8d4def2e89 Implement shift schedule for cascade stage C. 2024-02-17 11:38:47 -05:00
comfyanonymous
cabdbc2529 Manual cast for bf16 on older GPUs. 2024-02-17 09:01:17 -05:00
comfyanonymous
b527789f52 Fix clip attention mask issues on some hardware. 2024-02-17 07:53:52 -05:00
comfyanonymous
73407209f5 Make Stable Cascade work on old pytorch 2.0 2024-02-17 00:42:30 -05:00
comfyanonymous
56db0bef1e Support Stable Cascade Stage B lite. 2024-02-16 23:41:23 -05:00
comfyanonymous
b3c820556b Make --force-fp32 disable loading models in bf16. 2024-02-16 23:01:54 -05:00
comfyanonymous
b102d65c41 StableCascade CLIP model support. 2024-02-16 13:29:04 -05:00
comfyanonymous
e5a0f735be Stable Cascade Stage B. 2024-02-16 13:02:03 -05:00
comfyanonymous
deebc95781 Stable Cascade Stage C. 2024-02-16 10:55:08 -05:00
comfyanonymous
ce56ca3f9d Stable Cascade Stage A. 2024-02-16 06:30:39 -05:00
comfyanonymous
a3ada6af3b Small refactor of is_device_* functions. 2024-02-15 21:10:10 -05:00
comfyanonymous
0fc2468c50 Don't init the CLIP model when the checkpoint has no CLIP weights. 2024-02-13 00:01:08 -05:00
comfyanonymous
92f7466c12 Merge branch 'feature_expose_discard_penultimate_sigma' of https://github.com/blepping/ComfyUI 2024-02-11 12:23:30 -05:00
Jedrzej Kosinski
3172bb042e Fix infinite while loop being possible in ddim_scheduler 2024-02-09 17:11:34 -06:00
comfyanonymous
f3cb1f0b39 Add a way to set different conditioning for the controlnet. 2024-02-09 14:13:31 -05:00
blepping
5b3c8f3506 Allow custom samplers to request discard penultimate sigma 2024-02-08 02:24:23 -07:00
comfyanonymous
1cec78c95e Don't use numpy for calculating sigmas. 2024-02-07 18:52:51 -05:00
comfyanonymous
67ed9f9fb5 Make minimum tile size the size of the overlap. 2024-02-05 01:29:26 -05:00
comfyanonymous
1bbaf69344 Don't use is_bf16_supported to check for fp16 support. 2024-02-04 20:53:35 -05:00
comfyanonymous
5efb046482 Speed up SDXL on 16xx series with fp16 weights and manual cast. 2024-02-04 13:23:43 -05:00
comfyanonymous
32be22279f Always use fp16 for the text encoders. 2024-02-02 10:02:49 -05:00
comfyanonymous
6444e0a073 Put VAE key name in model config. 2024-01-30 02:24:38 -05:00
comfyanonymous
50fb52bc5b Remove some unused imports. 2024-01-25 23:42:37 -05:00
Dr.Lt.Data
f91644b5e9 typo fix - calculate_sigmas_scheduler (#2619)
self.scheduler -> scheduler_name

Co-authored-by: Lt.Dr.Data <lt.dr.data@gmail.com>
2024-01-23 03:47:01 -05:00
comfyanonymous
2f33a09886 Cleanup some unused imports. 2024-01-21 21:51:22 -05:00
comfyanonymous
3d6af7145d Remove useless import. 2024-01-19 15:38:05 -05:00
comfyanonymous
8739736c6e Add unfinished ImageOnlyCheckpointSave node to save a SVD checkpoint.
This node is unfinished, SVD checkpoints saved with this node will
work with ComfyUI but not with anything else.
2024-01-17 19:46:21 -05:00
comfyanonymous
96232a0a45 Only auto enable bf16 VAE on nvidia GPUs that actually support it. 2024-01-15 03:10:22 -05:00
comfyanonymous
30b062a477 Make unclip more deterministic.
Pass a seed argument note that this might make old unclip images different.
2024-01-14 17:28:31 -05:00
comfyanonymous
75966467dc Make server storage the default.
Remove --server-storage argument.
2024-01-11 17:21:40 -05:00
comfyanonymous
50b460c768 Don't round noise mask. 2024-01-11 03:29:58 -05:00
comfyanonymous
006560b913 Add InpaintModelConditioning node.
This is an alternative to VAE Encode for inpaint that should work with
lower denoise.

This is a different take on #2501
2024-01-11 03:15:27 -05:00
comfyanonymous
e0235effa4 Fix issue when using multiple t2i adapters with batched images. 2024-01-10 04:00:49 -05:00
comfyanonymous
62a7bf2919 Use basic attention implementation for small inputs on old pytorch. 2024-01-09 13:46:52 -05:00
pythongosssss
9f2a191a0e Store user settings/data on the server and multi user support (#2160)
* wip per user data

* Rename, hide menu

* better error
rework default user

* store pretty

* Add userdata endpoints
Change nodetemplates to userdata

* add multi user message

* make normal arg

* Fix tests

* Ignore user dir

* user tests

* Changed to default to browser storage and add server-storage arg

* fix crash on empty templates

* fix settings added before load

* ignore parse errors
2024-01-08 17:06:44 -05:00
comfyanonymous
8cf0a2dfe7 Update optimized_attention_for_device function for new functions that
support masked attention.
2024-01-07 13:52:08 -05:00
comfyanonymous
f9f0822512 Add attention mask support to sub quad attention. 2024-01-07 04:13:58 -05:00