Attention mask
AIAttention mask: A pattern that blocks certain positions from attention, used to hide padding tokens or enforce causal, left-to-right generation.
Attention mask: A pattern that blocks certain positions from attention, used to hide padding tokens or enforce causal, left-to-right generation.