AI Desk · Model Identity · Evidence object
Tokenizer signature tk_c018f9f2
An exact tokenizer signature: every model listed below returned the same marginal prompt-token count on all 50 test strings. Sharing a signature is strong evidence of a shared vocabulary.
- Members
- 1
- First observed
- 3 September 2026
- Last observed
- 3 September 2026
Models with this signature
Template variants of the same tokenizer
These signatures differ from this one by a uniform one-token shift on the affected strings: the same vocabulary behind a different chat template.
The measured vector
Marginal prompt-token cost per string, as measured on AionLabs: Aion-3.0All 50 rows
English and whitespace
en-prose13
en-long15
spaces-203
spaces-603
tabs-203
newlines-204
mixed-ws5
Digits
digits-95
digits-127
digits-3010
digits-sep9
float-long14
CJK
zh-common9
zh-long10
zh-rare18
ja-kana10
ja-kanji14
ko17
Other scripts
ru13
ar13
he24
hi27
th24
el14
Emoji
emoji-basic5
emoji-skin10
emoji-zwj-family7
emoji-zwj-x321
emoji-flags24
emoji-prof15
Rare Unicode
math27
boxdraw28
combining10
cjk-ext-b13
surrogates40
zalgo22
rtl-mix8
Code
py-code24
py-indent15
json20
html15
regex44
camel5
snake6
Repetition and encodings
rare-word-x530
repeat-tok21
base6434
hex14
url17
uuid28
Method: tokenizer fingerprinting, v1-50.