Tokenizer signature tk_5348f9f6

An exact tokenizer signature: every model listed below returned the same marginal prompt-token count on all 50 test strings. Sharing a signature is strong evidence of a shared vocabulary. This signature sits in the Llama2 group.

Members

1

First observed

21 August 2026

Last observed

21 August 2026

Group

Llama2

These signatures differ from this one by a uniform one-token shift on the affected strings: the same vocabulary behind a different chat template.

tk_03ecdf53 · 1 model