YFarmX

Transformer block

AI

Transformer block: A repeatable unit combining an attention sub-layer and a feedforward sub-layer, each wrapped with normalisation and a residual connection.

Related terms

Browse the full glossary →