Top-k sampling

Top-k sampling: A decoding method that restricts each choice to the k most likely tokens, sampling from those and ignoring the long tail of unlikely options.

Browse the full glossary →