AI Desk · Model Identity · Evidence object
Tokenizer signature tk_920d45ce
An exact tokenizer signature: every model listed below returned the same marginal prompt-token count on all 50 test strings. Sharing a signature is strong evidence of a shared vocabulary. This signature sits in the Qwen · group A group.
- Members
- 1
- First observed
- 3 September 2026
- Last observed
- 3 September 2026
- Group
- Qwen · group A
Models with this signature
Template variants of the same tokenizer
These signatures differ from this one by a uniform one-token shift on the affected strings: the same vocabulary behind a different chat template.
The measured vector
Marginal prompt-token cost per string, as measured on Writer: Palmyra X5All 50 rows
English and whitespace
en-prose14
en-long16
spaces-203
spaces-603
tabs-203
newlines-204
mixed-ws5
Digits
digits-99
digits-1212
digits-3030
digits-sep12
float-long22
CJK
zh-common10
zh-long12
zh-rare17
ja-kana8
ja-kanji13
ko17
Other scripts
ru16
ar8
he9
hi29
th12
el28
Emoji
emoji-basic5
emoji-skin10
emoji-zwj-family10
emoji-zwj-x330
emoji-flags8
emoji-prof14
Rare Unicode
math26
boxdraw17
combining5
cjk-ext-b12
surrogates22
zalgo36
rtl-mix7
Code
py-code25
py-indent15
json25
html16
regex44
camel5
snake6
Repetition and encodings
rare-word-x530
repeat-tok21
base6436
hex17
url19
uuid36
Method: tokenizer fingerprinting, v1-50.