Attention mechanism

Attention mechanism: A method that lets a model weigh the relevance of different input elements when producing each output, focusing on the most useful parts.

Browse the full glossary →