Function generate_padding_mask
pub fn generate_padding_mask(
pad_token: usize,
tokens_list: Vec<Vec<usize>>,
seq_length: impl Into<SeqLengthOption>,
device: &Device,
) -> GeneratePaddingMaskExpand description
Generates a padding attention mask for a batch of token sequences.
§Arguments
pad_token- The token ID used for paddingtokens_list- Vector of token sequences (each sequence is a vector of token IDs)seq_length- Sequence length option (NoMax, Max, or Fixed)device- The device for tensor operations
§Returns
A GeneratePaddingMask containing the padded tensor and corresponding mask