Vocabulary
AIVocabulary: The fixed set of tokens a model recognises; every input and output is expressed as a sequence drawn from this vocabulary.
Vocabulary: The fixed set of tokens a model recognises; every input and output is expressed as a sequence drawn from this vocabulary.