lum3on 0b0753e708 Fix VAE SageAttention integration tensor shape mismatch ...

- Add proper tensor reshaping in vae_sage_attention() wrapper
- Convert VAE format (B, C, H, W) to SageAttention format (B, seq_len, dim)
- Add fallback mechanism to pytorch attention if SageAttention fails
- Enable SageAttention selection in vae_attention() function
- Fixes ValueError: too many values to unpack (expected 3) error
- Maintains compatibility with existing VAE attention functions

This resolves the tensor shape incompatibility between VAE spatial attention
and SageAttention sequence attention, allowing VAE operations to benefit from
SageAttention optimization when --use-sage-attention flag is enabled.

2025-09-16 00:58:48 +02:00

..

diffusionmodules

Fix VAE SageAttention integration tensor shape mismatch

2025-09-16 00:58:48 +02:00

distributions

Small optimizations.

2024-12-18 18:23:28 -05:00

encoders

Make unclip more deterministic.

2024-01-14 17:28:31 -05:00

attention.py

Make ModuleNotFoundError ImportError instead (#9850)

2025-09-13 21:34:21 -04:00

ema.py

Initial commit.

2023-01-16 22:37:14 -05:00

sub_quadratic_attention.py

Fix pytorch warning. (#8593)

2025-06-19 11:04:52 -04:00

temporal_ae.py

Basic Hunyuan Video model support.

2024-12-16 19:35:40 -05:00