Struct LayerNormConfig 

pub struct LayerNormConfig {
    pub d_model: usize,
    pub epsilon: f64,
    pub bias: bool,
}

Configuration to create a LayerNorm layer using the init function.

Fields

d_model: usize

The size of the input features.

epsilon: f64

A value required for numerical stability. Default: 1e-5

bias: bool

If a bias (beta) should be applied during the normalization. Default: true

Implementations

impl LayerNormConfig

pub fn new(d_model: usize) -> LayerNormConfig

Create a new instance of the config.

Arguments

Required Arguments

d_model

The size of the input features.

Default Arguments

epsilon

A value required for numerical stability. Default: 1e-5

• Defaults to 1e-5

bias

If a bias (beta) should be applied during the normalization. Default: true

• Defaults to true

impl LayerNormConfig

pub fn with_epsilon(self, epsilon: f64) -> LayerNormConfig

Sets the value for the field epsilon.

A value required for numerical stability. Default: 1e-5

• Defaults to 1e-5

pub fn with_bias(self, bias: bool) -> LayerNormConfig

Sets the value for the field bias.

If a bias (beta) should be applied during the normalization. Default: true

• Defaults to true

impl LayerNormConfig

pub fn init(&self, device: &Device) -> LayerNorm

Initialize a new layer norm module.

Trait Implementations

impl Clone for LayerNormConfig

fn clone(&self) -> LayerNormConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for LayerNormConfig

fn save<P>(&self, file: P) -> Result<(), Error>

where P: AsRef<Path>,

Saves the configuration to a file.

fn load<P>(file: P) -> Result<Self, ConfigError>

where P: AsRef<Path>,

Loads the configuration from a file.

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for LayerNormConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for LayerNormConfig

fn deserialize<D>( deserializer: D, ) -> Result<LayerNormConfig, <D as Deserializer<'de>>::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for LayerNormConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl From<LayerNormConfig> for NormalizationConfig

fn from(config: LayerNormConfig) -> NormalizationConfig

Converts to this type from the input type.

impl Serialize for LayerNormConfig

fn serialize<S>( &self, serializer: S, ) -> Result<<S as Serializer>::Ok, <S as Serializer>::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.