12 Commits

Author SHA1 Message Date
Kohaku-Blueleaf
5098e9408d Utilize weight adapter scheme in basic training node 2025-04-22 14:54:20 +08:00
Kohaku-Blueleaf
68c9e79bc8 linting 2025-04-14 23:59:10 +08:00
Kohaku-Blueleaf
bffbed8940 Basic train base impl of lora 2025-04-14 23:49:35 +08:00
Kohaku-Blueleaf
14c20852c5 Add scheme of TrainBase class 2025-04-14 23:47:21 +08:00
Kohaku-Blueleaf
e8f3bc5ab7 Finalize the modularized weight adapter impl
* LoRA/LoHa/LoKr/GLoRA working well
* Removed TONS of code in lora.py
2025-04-09 09:16:52 +08:00
Kohaku-Blueleaf
889f94773a Remove unused import 2025-04-08 22:01:43 +08:00
Kohaku-Blueleaf
ff050275ab Use correct v list 2025-04-08 18:48:58 +08:00
Kohaku-Blueleaf
a220e5ca80 Fix typing syntax error 2025-04-08 18:46:53 +08:00
Kohaku-Blueleaf
726fdfcaa0 Fix import error 2025-04-08 18:46:43 +08:00
Kohaku-Blueleaf
84317474fd lint 2025-04-02 09:31:24 +08:00
Kohaku-Blueleaf
4774c3244e Initial impl
LoRA load/calculate_weight
LoHa/LoKr/GLoRA load
2025-04-02 09:21:39 +08:00
Kohaku-Blueleaf
6fb4cc0179 Weight Adapter Scheme 2025-04-02 09:21:17 +08:00