Detokenisation

Detokenisation: Converting a sequence of tokens back into readable text, reversing tokenisation and correctly rejoining subword fragments and spacing.

Browse the full glossary →