Draft model
AIDraft model: A smaller, faster model that guesses upcoming tokens for a larger model to check, used in speculative decoding to cut generation time.
Draft model: A smaller, faster model that guesses upcoming tokens for a larger model to check, used in speculative decoding to cut generation time.