Enum DistributedOperationIr
pub enum DistributedOperationIr {
AllReduce(AllReduceOpIr),
SyncCollective,
}Expand description
Operations that can be done on distributed tensors.
Variants§
AllReduce(AllReduceOpIr)
Operation corresponding to: all_reduce.
SyncCollective
Resolve the pending collective operations on the executing device. Corresponds to sync_collective.
Fire-and-forget and payload-free: it syncs whichever device the interpreter is bound to.
Modeled as an operation (not a side-channel call) so it travels the normal op stream
alongside AllReduce and is ordered against it.
Trait Implementations§
§impl Clone for DistributedOperationIr
impl Clone for DistributedOperationIr
§fn clone(&self) -> DistributedOperationIr
fn clone(&self) -> DistributedOperationIr
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read more§impl Debug for DistributedOperationIr
impl Debug for DistributedOperationIr
§impl<'de> Deserialize<'de> for DistributedOperationIr
impl<'de> Deserialize<'de> for DistributedOperationIr
§fn deserialize<__D>(
__deserializer: __D,
) -> Result<DistributedOperationIr, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<DistributedOperationIr, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
§impl Hash for DistributedOperationIr
impl Hash for DistributedOperationIr
§impl PartialEq for DistributedOperationIr
impl PartialEq for DistributedOperationIr
§fn eq(&self, other: &DistributedOperationIr) -> bool
fn eq(&self, other: &DistributedOperationIr) -> bool
Tests for
self and other values to be equal, and is used by ==.§impl Serialize for DistributedOperationIr
impl Serialize for DistributedOperationIr
§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for DistributedOperationIr
Auto Trait Implementations§
impl Freeze for DistributedOperationIr
impl RefUnwindSafe for DistributedOperationIr
impl Send for DistributedOperationIr
impl Sync for DistributedOperationIr
impl Unpin for DistributedOperationIr
impl UnsafeUnpin for DistributedOperationIr
impl UnwindSafe for DistributedOperationIr
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<K, Q> Comparable<Q> for K
impl<K, Q> Comparable<Q> for K
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
§impl<K, Q> Equivalent<Q> for K
impl<K, Q> Equivalent<Q> for K
§fn equivalent(&self, key: &Q) -> bool
fn equivalent(&self, key: &Q) -> bool
Compare self to
key and return true if they are equal.impl<T> ErasedDestructor for Twhere
T: 'static,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more