Function mish
pub fn mish<const D: usize>(tensor: Tensor<D>) -> Tensor<D>Expand description
Applies the Mish function as described in the paper in Mish: A Self Regularized Non-Monotonic Neural Activation Function.
mish(x) = x * tanh(softplus(x)) = tanh(log(1 + exp(x)))