Enum QuantParam

pub enum QuantParam {
    F32,
    F16,
    BF16,
    UE8M0,
    UE4M3,
}

Quantization floating-point precision.

This is used to represent the floating-point precision of quantization parameters like the scale(s) or the accumulation precision used during operations like matrix multiplication.

Variants

F32

Full precision.

F16

Half precision.

BF16

bfloat16 precision.

UE8M0

unsigned floating point, e8m0 format.

UE4M3

unsigned floating point, e4m3 format.

Trait Implementations

impl Clone for QuantParam

fn clone(&self) -> QuantParam

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantParam

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for QuantParam

fn deserialize<__D>( __deserializer: __D, ) -> Result<QuantParam, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Hash for QuantParam

fn hash<__H>(&self, state: &mut __H)

where __H: Hasher,

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Ord for QuantParam

fn cmp(&self, other: &QuantParam) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for QuantParam

fn eq(&self, other: &QuantParam) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for QuantParam

fn partial_cmp(&self, other: &QuantParam) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl Serialize for QuantParam

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for QuantParam

impl Eq for QuantParam

impl StructuralPartialEq for QuantParam