kijai 56b5dbbf82 Add different RMSNorm functions for testing ...

Initial testing for me shows that the RMSNorm from flash_attn.ops.triton.layer_norm is ~8-10% faster, apex is untested as I don't currently have it installed.

2024-11-04 14:11:58 +02:00

..

joint_model

Add different RMSNorm functions for testing

2024-11-04 14:11:58 +02:00