Jukka Seppänen a1b1f86aa3 works without flash_attn (thanks @juxtapoz!) ...

at least on Linux, also sage_attn

2024-10-24 02:19:00 +03:00

..

__pycache__

cleanup

2024-10-23 15:45:20 +03:00

__init__.py

initial commit

2024-10-23 15:34:22 +03:00

asymm_models_joint.py

works without flash_attn (thanks @juxtapoz!)

2024-10-24 02:19:00 +03:00

context_parallel.py

initial commit

2024-10-23 15:34:22 +03:00

layers.py

initial commit

2024-10-23 15:34:22 +03:00

mod_rmsnorm.py

initial commit

2024-10-23 15:34:22 +03:00

residual_tanh_gated_rmsnorm.py

initial commit

2024-10-23 15:34:22 +03:00

rope_mixed.py

initial commit

2024-10-23 15:34:22 +03:00

temporal_rope.py

initial commit

2024-10-23 15:34:22 +03:00

utils.py

initial commit

2024-10-23 15:34:22 +03:00