Rattus 39eb74cabe wan: Optimize qkv intermediates on attention
As commented. The former logic computed independent pieces of QKV in
parallel which help more inference intermediates in VRAM spiking
VRAM usage. Fully roping Q and garbage collecting the intermediates
before touching K reduces the peak inference VRAM usage.
2025-09-16 22:54:01 +10:00
..
2025-08-01 05:25:38 -04:00
2025-08-01 05:25:38 -04:00