Special tokens

Special tokens: Reserved tokens that carry structural meaning rather than ordinary text, marking things like the start of a sequence, padding, or the end of a turn.

Browse the full glossary →