Induction head
AIInduction head: An attention circuit that spots a repeated pattern earlier in the context and continues it, an ingredient of in-context learning.
Induction head: An attention circuit that spots a repeated pattern earlier in the context and continues it, an ingredient of in-context learning.