Struct Adam
pub struct Adam { /* private fields */ }
Expand description
Adam optimizer as described in the paper Adam: A Method for Stochastic Optimization.
Trait Implementations§
§impl<B> SimpleOptimizer<B> for Adamwhere
B: Backend,
impl<B> SimpleOptimizer<B> for Adamwhere
B: Backend,
§type State<const D: usize> = AdamState<B, D>
type State<const D: usize> = AdamState<B, D>
The state of the optimizer. It also implements record, so that it can be saved.
§fn step<const D: usize>(
&self,
lr: f64,
tensor: Tensor<B, D>,
grad: Tensor<B, D>,
state: Option<<Adam as SimpleOptimizer<B>>::State<D>>,
) -> (Tensor<B, D>, Option<<Adam as SimpleOptimizer<B>>::State<D>>)
fn step<const D: usize>( &self, lr: f64, tensor: Tensor<B, D>, grad: Tensor<B, D>, state: Option<<Adam as SimpleOptimizer<B>>::State<D>>, ) -> (Tensor<B, D>, Option<<Adam as SimpleOptimizer<B>>::State<D>>)
The optimizer step is performed for one tensor at a time with its gradient and state. Read more
Auto Trait Implementations§
impl Freeze for Adam
impl RefUnwindSafe for Adam
impl Send for Adam
impl Sync for Adam
impl Unpin for Adam
impl UnwindSafe for Adam
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more