AI Desk · Model Identity · Evidence object

Tokenizer signature tk_985608d3

An exact tokenizer signature: every model listed below returned the same marginal prompt-token count on all 50 test strings. Sharing a signature is strong evidence of a shared vocabulary. This signature sits in the Meta group.

Members
1
First observed
21 August 2026
Last observed
21 August 2026
Group
Meta

Models with this signature

The measured vector

Marginal prompt-token cost per string, as measured on Meta: Llama Guard 4 12B
All 50 rows

English and whitespace

en-prose14
en-long16
spaces-203
spaces-603
tabs-203
newlines-204
mixed-ws6

Digits

digits-94
digits-125
digits-3011
digits-sep8
float-long10

CJK

zh-common11
zh-long14
zh-rare19
ja-kana9
ja-kanji11
ko9

Other scripts

ru10
ar11
he10
hi12
th8
el14

Emoji

emoji-basic11
emoji-skin20
emoji-zwj-family12
emoji-zwj-x334
emoji-flags17
emoji-prof20

Rare Unicode

math24
boxdraw22
combining10
cjk-ext-b17
surrogates37
zalgo31
rtl-mix6

Code

py-code25
py-indent15
json20
html17
regex43
camel6
snake6

Repetition and encodings

rare-word-x530
repeat-tok40
base6435
hex11
url17
uuid28

Method: tokenizer fingerprinting, v1-50. Raw data: fingerprints.json · index.json · test-strings.json.