Rattus 74fe85e0a8 mp: order the module list by offload expense
Calculate an approximate offloading temporary VRAM cost to offload a
weight and primary order the module load list by that. In the simple
case this is just the same as the module weight, but with Loras, a
weight with a lora consumes considerably more VRAM to do the Lora
application on-the-fly.

This will slightly prioritize lora weights, but is really for
proper VRAM offload accounting.
2025-11-27 15:39:50 +10:00
..
2025-11-26 20:28:44 -08:00
2024-06-27 18:43:11 -04:00
2025-11-25 18:41:45 -05:00
2025-09-02 15:36:22 -04:00
2025-01-24 06:15:54 -05:00
2025-07-06 07:07:39 -04:00
2025-09-15 18:10:55 -04:00
2025-11-25 18:41:45 -05:00
2025-11-27 15:39:50 +10:00
2025-10-25 23:07:29 -04:00
2025-11-25 18:41:45 -05:00