Function burn::tensor::activation::mish
pub fn mish<const D: usize, B>(tensor: Tensor<B, D>) -> Tensor<B, D>where
B: Backend,
Expand description
Applies the Mish function as described in the paper in Mish: A Self Regularized Non-Monotonic Neural Activation Function.
mish(x_i) = x_i \times tanh(softplus(x_i))