Struct RmsProp
pub struct RmsProp { /* private fields */ }
Expand description
Optimizer that implements stochastic gradient descent with momentum. The optimizer can be configured with RmsPropConfig.
Trait Implementations§
§impl<B> SimpleOptimizer<B> for RmsPropwhere
B: Backend,
impl<B> SimpleOptimizer<B> for RmsPropwhere
B: Backend,
§type State<const D: usize> = RmsPropState<B, D>
type State<const D: usize> = RmsPropState<B, D>
The state of the optimizer. It also implements record, so that it can be saved.
§fn step<const D: usize>(
&self,
lr: f64,
tensor: Tensor<B, D>,
grad: Tensor<B, D>,
state: Option<<RmsProp as SimpleOptimizer<B>>::State<D>>,
) -> (Tensor<B, D>, Option<<RmsProp as SimpleOptimizer<B>>::State<D>>)
fn step<const D: usize>( &self, lr: f64, tensor: Tensor<B, D>, grad: Tensor<B, D>, state: Option<<RmsProp as SimpleOptimizer<B>>::State<D>>, ) -> (Tensor<B, D>, Option<<RmsProp as SimpleOptimizer<B>>::State<D>>)
The optimizer step is performed for one tensor at a time with its gradient and state. Read more
Auto Trait Implementations§
impl Freeze for RmsProp
impl RefUnwindSafe for RmsProp
impl Send for RmsProp
impl Sync for RmsProp
impl Unpin for RmsProp
impl UnwindSafe for RmsProp
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more