Self-attention
AISelf-attention: An attention operation where each element of a sequence attends to every other element of the same sequence to build context-aware representations.
Self-attention: An attention operation where each element of a sequence attends to every other element of the same sequence to build context-aware representations.