Skip to main content

generate_autoregressive_mask

Function generate_autoregressive_mask 

pub fn generate_autoregressive_mask(
    batch_size: usize,
    seq_length: usize,
    device: &Device,
) -> Tensor<3, Bool>
Expand description

Generate an autoregressive attention mask.

The mask can be used in Transformer modules to train models to generate tensors sequentially.