Function generate_padding_mask
pub fn generate_padding_mask<B>(
pad_token: usize,
tokens_list: Vec<Vec<usize>>,
seq_length: impl Into<SeqLengthOption>,
device: &<B as Backend>::Device,
) -> GeneratePaddingMask<B>where
B: Backend,Expand description
Generates a padding attention mask for a batch of token sequences.
§Arguments
pad_token- The token ID used for paddingtokens_list- Vector of token sequences (each sequence is a vector of token IDs)seq_length- Sequence length option (NoMax, Max, or Fixed)device- The device for tensor operations
§Returns
A GeneratePaddingMask containing the padded tensor and corresponding mask