pub struct RmsProp<B>where
B: Backend,{ /* private fields */ }
Expand description
Optimizer that implements stochastic gradient descent with momentum. The optimizer can be configured with RmsPropConfig.
Trait Implementations§
§impl<B> SimpleOptimizer<B> for RmsProp<B>where
B: Backend,
impl<B> SimpleOptimizer<B> for RmsProp<B>where
B: Backend,
§type State<const D: usize> = RmsPropState<B, D>
type State<const D: usize> = RmsPropState<B, D>
The state of the optimizer. It also implements record, so that it can be saved.
§fn step<const D: usize>(
&self,
lr: f64,
tensor: Tensor<B, D>,
grad: Tensor<B, D>,
state: Option<<RmsProp<B> as SimpleOptimizer<B>>::State<D>>,
) -> (Tensor<B, D>, Option<<RmsProp<B> as SimpleOptimizer<B>>::State<D>>)
fn step<const D: usize>( &self, lr: f64, tensor: Tensor<B, D>, grad: Tensor<B, D>, state: Option<<RmsProp<B> as SimpleOptimizer<B>>::State<D>>, ) -> (Tensor<B, D>, Option<<RmsProp<B> as SimpleOptimizer<B>>::State<D>>)
The optimizer step is performed for one tensor at a time with its gradient and state. Read more
Auto Trait Implementations§
impl<B> Freeze for RmsProp<B>
impl<B> RefUnwindSafe for RmsProp<B>
impl<B> Send for RmsProp<B>
impl<B> Sync for RmsProp<B>
impl<B> Unpin for RmsProp<B>
impl<B> UnwindSafe for RmsProp<B>
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
source§unsafe fn clone_to_uninit(&self, dst: *mut T)
unsafe fn clone_to_uninit(&self, dst: *mut T)
🔬This is a nightly-only experimental API. (
clone_to_uninit
)§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> IntoEither for T
impl<T> IntoEither for T
source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moresource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more