Positional encoding

Positional encoding: Information added to token representations that tells a model the order of a sequence, since attention alone is order-agnostic.

Browse the full glossary →