Function burn::tensor::activation::mish

pub fn mish<const D: usize, B>(tensor: Tensor<B, D>) -> Tensor<B, D>
where B: Backend,
Expand description

Applies the Mish function as described in the paper in Mish: A Self Regularized Non-Monotonic Neural Activation Function.

mish(x_i) = x_i \times tanh(softplus(x_i))