Vocabulary size

Vocabulary size: The number of distinct tokens in a model's vocabulary, commonly tens of thousands; larger vocabularies shorten sequences but enlarge the embedding and output layers.

Browse the full glossary →