Separate sage 1.x/2.x and sage 3.x on different functions and flags 3.

This commit is contained in:
Panchovix 2025-07-26 14:22:22 -04:00 committed by GitHub
parent 5e1865c1c7
commit 3c3009c020
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -1044,6 +1044,9 @@ def cast_to_device(tensor, device, dtype, copy=False):
def sage_attention_enabled():
return args.use_sage_attention
def sage_attention3_enabled():
return args.use_sage_attention3
def flash_attention_enabled():
return args.use_flash_attention