Struct TransitionBuffer 

pub struct TransitionBuffer<SB, AB>
where
    SB: SliceAccess,
    AB: SliceAccess,
{ /* private fields */ }

A tensor-backed circular buffer for transitions.

Uses SliceAccess to store state and action batches in contiguous tensor storage, enabling efficient random sampling via select. The buffer lazily initializes its storage on the first push call.

Implementations

impl<SB, AB> TransitionBuffer<SB, AB>

where SB: SliceAccess, AB: SliceAccess,

pub fn new(capacity: usize, device: &Device) -> TransitionBuffer<SB, AB>

Creates a new buffer. Storage is lazily allocated on the first push.

pub fn push( &mut self, state: SB, next_state: SB, action: AB, reward: f32, done: bool, )

Add a transition, overwriting the oldest if full.

pub fn sample(&self, batch_size: usize) -> TransitionBatch<SB, AB>

Sample a random batch of transitions.

pub fn len(&self) -> usize

Current number of stored transitions.

pub fn is_empty(&self) -> bool

Whether the buffer is empty.

pub fn capacity(&self) -> usize

Buffer capacity.