3871 Commits

Author SHA1 Message Date
Jedrzej Kosinski
46fdd636de
Merge pull request #9545 from bigcat88/asset-management
[Assets] Initial implementation
2025-09-18 14:07:18 -07:00
bigcat88
283cd27bdc
final adjustments 2025-09-18 10:05:32 +03:00
bigcat88
1a37d1476d
refactor(6): fully batched initial scan 2025-09-17 20:29:29 +03:00
bigcat88
f9602457d6
optimization: initial scan speed(batching metadata[filename]) 2025-09-17 16:47:27 +03:00
bigcat88
85ef08449d
optimization: initial scan speed(batching tags) 2025-09-17 14:08:57 +03:00
bigcat88
5b6810a2c6
fixed hash calculation during model loading in ComfyUI 2025-09-17 13:25:56 +03:00
bigcat88
621faaa195
refactor(5): use less DB queries to create seed asset 2025-09-17 10:46:21 +03:00
bigcat88
d0aa64d57b
refactor(4): use one query to init DB with all tags for assets 2025-09-16 21:18:18 +03:00
bigcat88
677a0e2508
refactor(3): unite logic for Asset fast check 2025-09-16 20:29:50 +03:00
bigcat88
31ec744317
refactor(2)/fix: skip double checking the existing files during fast check 2025-09-16 19:50:21 +03:00
bigcat88
a336c7c165
refactor(1): use general fast_asset_file_check helper for fast check 2025-09-16 19:19:18 +03:00
bigcat88
77332d3054
optimization: fast scan: commit to the DB in chunks 2025-09-16 14:21:40 +03:00
bigcat88
24a95f5ca4
removed default scanning of "input" and "output" folders; added separate endpoint for test suite. 2025-09-16 11:28:29 +03:00
bigcat88
0be513b213
fix: escape "_" symbol in all other places 2025-09-15 20:26:48 +03:00
bigcat88
f1fb7432a0
fix+test: escape "_" symbol in assets filtering 2025-09-15 19:19:47 +03:00
bigcat88
f3cf99d10c
fix+test: escape "_" symbol in tags filtering 2025-09-15 17:29:27 +03:00
bigcat88
5f187fe6fb
optimization: make list_unhashed_candidates_under_prefixes single-query instead of N+1 2025-09-15 12:46:35 +03:00
bigcat88
025fc49b4e
optimization: DB Queries (Tags) 2025-09-15 10:26:13 +03:00
bigcat88
7becb84341
fixed tests on SQLite file 2025-09-14 23:01:17 +03:00
bigcat88
dda31de690
rework: AssetInfo.name is only a display name 2025-09-14 21:53:44 +03:00
bigcat88
1d970382f0
added final tests 2025-09-14 20:02:28 +03:00
bigcat88
a2fc2bbae4
corrected formatting 2025-09-14 18:12:00 +03:00
bigcat88
a7f2546558
fix: use ".rowcount" instead of ".returning" on SQLite 2025-09-14 17:55:02 +03:00
bigcat88
6cfa94ec58
fixed metadata[filename] feature + new tests for this 2025-09-14 16:28:14 +03:00
bigcat88
a2ec1f7637
simplify code 2025-09-14 15:31:42 +03:00
bigcat88
0b795dc7a7
removed non-needed code 2025-09-14 15:14:24 +03:00
bigcat88
47f7c7ee8c
rework + add test for concurrent AssetInfo delete 2025-09-14 15:08:29 +03:00
bigcat88
cdd8d16075
+2 tests for checking Asset downloading logic 2025-09-14 14:57:24 +03:00
bigcat88
37b81e6658
fixed new PgSQL bug 2025-09-14 14:30:38 +03:00
bigcat88
975650060f
concurrency upload test + fixed 2 related bugs 2025-09-14 09:39:23 +03:00
bigcat88
4a713654cd
added more tests for the Assets logic 2025-09-14 09:10:59 +03:00
bigcat88
9b8e88ba6e
added more tests for the Assets logic 2025-09-13 20:09:45 +03:00
bigcat88
bb9ed04758
global refactoring; add support for Assets without the computed hash 2025-09-13 16:39:08 +03:00
Alexander Piskun
934377ac1e removed currently unnecessary "asset_locations" functionality 2025-09-12 14:46:22 +03:00
Alexander Piskun
3c9bf39c20
Merge pull request #1 from bigcat88/asset-management-ci
fix bugs + GH CI tests
2025-09-10 16:31:11 +03:00
bigcat88
0df1ccac6f
GitHub CI test for Assets 2025-09-10 16:22:22 +03:00
bigcat88
72548a8ac4
added additional tests; sorted tests 2025-09-10 10:39:55 +03:00
bigcat88
6eaed072c7
add some logic tests 2025-09-10 09:51:06 +03:00
bigcat88
a9096f6c97
removed non-needed code, fix tests, +1 new test 2025-09-09 20:54:11 +03:00
bigcat88
964de8a8ad
add more list_assets tests + fix one found bug 2025-09-09 20:35:18 +03:00
bigcat88
1886f10e19
add download tests 2025-09-09 19:30:58 +03:00
bigcat88
357193f7b5
fixed metadata filtering + tests 2025-09-09 19:12:11 +03:00
bigcat88
0ef73e95fd
fixed validation error + more tests 2025-09-09 16:02:39 +03:00
bigcat88
faa1e4de17
fixed another test 2025-09-09 15:17:03 +03:00
bigcat88
dfb5703d40
feat: remove Asset when there is no references left + bugfixes + more tests 2025-09-09 15:10:07 +03:00
bigcat88
0e9de2b7c9
feat: add first test 2025-09-08 20:43:45 +03:00
bigcat88
e3311c9229
feat: support for in-memory SQLite databases 2025-09-08 18:15:09 +03:00
bigcat88
3fa0fc496c
fix: use UPSERT to eliminate rare race condition during ingesting many small files in parallel 2025-09-08 18:13:32 +03:00
bigcat88
6282d495ca
corrected detection of missing files for assets 2025-09-07 22:08:38 +03:00
bigcat88
b8ef9bb92c
add detection of the missing files for existing assets 2025-09-07 16:49:39 +03:00