Decode phase
AIDecode phase: The stage after prefill where the model generates output one token at a time, each step reusing the cache and appending the new token.
Decode phase: The stage after prefill where the model generates output one token at a time, each step reusing the cache and appending the new token.