19 Commits

Author	SHA1	Message	Date
Kohaku-Blueleaf	9c0cf36cd7	weight adapter fixes for training node	2025-06-01 17:07:41 +08:00
Kohaku-Blueleaf	3d3d14d284	Merge branch 'master' into weight-adapter-train	2025-05-31 22:43:23 +08:00
Kohaku-Blueleaf	2ab9618732	Fix the bugs in OFT/BOFT moule (#7909) ... * Correct calculate_weight and load for OFT * Correct calculate_weight and loading for BOFT	2025-05-02 13:12:37 -04:00
Kohaku-Blueleaf	a8f63c0d5b	Support dora_scale on both axis (#7727)	2025-04-22 05:01:27 -04:00
Kohaku-Blueleaf	966c43ce26	Add OFT/BOFT algorithm in weight adapter (#7725)	2025-04-22 04:59:47 -04:00
Kohaku-Blueleaf	c8bd95a393	linting	2025-04-22 15:14:26 +08:00
Kohaku-Blueleaf	5098e9408d	Utilize weight adapter scheme in basic training node	2025-04-22 14:54:20 +08:00
Kohaku-Blueleaf	1f3fba2af5	Unified Weight Adapter system for better maintainability and future feature of Lora system (#7540)	2025-04-21 20:15:32 -04:00
Kohaku-Blueleaf	68c9e79bc8	linting	2025-04-14 23:59:10 +08:00
Kohaku-Blueleaf	bffbed8940	Basic train base impl of lora	2025-04-14 23:49:35 +08:00
Kohaku-Blueleaf	14c20852c5	Add scheme of TrainBase class	2025-04-14 23:47:21 +08:00
Kohaku-Blueleaf	e8f3bc5ab7	Finalize the modularized weight adapter impl ... * LoRA/LoHa/LoKr/GLoRA working well * Removed TONS of code in lora.py	2025-04-09 09:16:52 +08:00
Kohaku-Blueleaf	889f94773a	Remove unused import	2025-04-08 22:01:43 +08:00
Kohaku-Blueleaf	ff050275ab	Use correct v list	2025-04-08 18:48:58 +08:00
Kohaku-Blueleaf	a220e5ca80	Fix typing syntax error	2025-04-08 18:46:53 +08:00
Kohaku-Blueleaf	726fdfcaa0	Fix import error	2025-04-08 18:46:43 +08:00
Kohaku-Blueleaf	84317474fd	lint	2025-04-02 09:31:24 +08:00
Kohaku-Blueleaf	4774c3244e	Initial impl ... LoRA load/calculate_weight LoHa/LoKr/GLoRA load	2025-04-02 09:21:39 +08:00
Kohaku-Blueleaf	6fb4cc0179	Weight Adapter Scheme	2025-04-02 09:21:17 +08:00