Causal masking
AICausal masking: A mask that prevents a token from attending to later positions, so predictions depend only on earlier tokens during generation.
Causal masking: A mask that prevents a token from attending to later positions, so predictions depend only on earlier tokens during generation.