TeaCache/videosys/models/modules/activations.py
2024-12-06 21:02:09 +08:00

4 lines
73 B
Python

import torch.nn as nn
approx_gelu = lambda: nn.GELU(approximate="tanh")