Nucleus sampling (top-p)
AINucleus sampling (top-p): A decoding method that keeps only the smallest set of top tokens whose probabilities add up to a chosen threshold, then samples from that set.
Nucleus sampling (top-p): A decoding method that keeps only the smallest set of top tokens whose probabilities add up to a chosen threshold, then samples from that set.