Relative positional encoding
AIRelative positional encoding: A method that encodes the distance between tokens rather than their absolute positions, helping models generalise across sequence lengths.
Relative positional encoding: A method that encodes the distance between tokens rather than their absolute positions, helping models generalise across sequence lengths.