Enum ActivationConfig

#[non_exhaustive]
pub enum ActivationConfig {
    Gelu,
    PRelu(PReluConfig),
    Relu,
    LeakyRelu(LeakyReluConfig),
    SwiGlu(SwiGluConfig),
    Sigmoid,
    Tanh,
    HardSigmoid(HardSigmoidConfig),
}

Activation Configuration.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Gelu

Gelu activation layer.

PRelu(PReluConfig)

PRelu activation layer.

Relu

Relu activation layer.

LeakyRelu(LeakyReluConfig)

LeakyRelu activation layer.

SwiGlu(SwiGluConfig)

SwiGlu activation layer.

Sigmoid

Sigmoid activation layer.

Tanh

Tanh activation layer.

HardSigmoid(HardSigmoidConfig)

HardSigmoid activation layer.

Implementations

impl ActivationConfig

pub fn init<B>(&self, device: &<B as Backend>::Device) -> Activation<B>

where B: Backend,

Initialize a wrapped activation layer.

Trait Implementations

impl Clone for ActivationConfig

fn clone(&self) -> ActivationConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for ActivationConfig

fn save<P>(&self, file: P) -> Result<(), Error>

where P: AsRef<Path>,

Saves the configuration to a file.

fn load<P>(file: P) -> Result<Self, ConfigError>

where P: AsRef<Path>,

Loads the configuration from a file.

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for ActivationConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ActivationConfig

fn deserialize<D>( deserializer: D, ) -> Result<ActivationConfig, <D as Deserializer<'de>>::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for ActivationConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl From<HardSigmoidConfig> for ActivationConfig

fn from(config: HardSigmoidConfig) -> ActivationConfig

Converts to this type from the input type.

impl From<LeakyReluConfig> for ActivationConfig

fn from(config: LeakyReluConfig) -> ActivationConfig

Converts to this type from the input type.

impl From<PReluConfig> for ActivationConfig

fn from(config: PReluConfig) -> ActivationConfig

Converts to this type from the input type.

impl From<SwiGluConfig> for ActivationConfig

fn from(config: SwiGluConfig) -> ActivationConfig

Converts to this type from the input type.

impl Serialize for ActivationConfig

fn serialize<S>( &self, serializer: S, ) -> Result<<S as Serializer>::Ok, <S as Serializer>::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.