AI Desk · Model Identity · Evidence object
Tokenizer signature tk_59ca250f
An exact tokenizer signature: every model listed below returned the same marginal prompt-token count on all 50 test strings. Sharing a signature is strong evidence of a shared vocabulary. This signature sits in the Gemini group.
- Members
- 7
- First observed
- 21 August 2026
- Last observed
- 21 August 2026
- Group
- Gemini
Models with this signature
Google: Gemini 2.5 Flash Litegoogle/gemini-2.5-flash-liteGoogleGoogle: Gemini 3.1 Flash Litegoogle/gemini-3.1-flash-liteGoogleGoogle: Gemini 3.1 Flash Lite Previewgoogle/gemini-3.1-flash-lite-previewGoogleGoogle: Gemini 3.5 Flash Litegoogle/gemini-3.5-flash-liteGoogleGoogle: Gemini 3.7 Flashgoogle/gemini-3.7-flashGoogleGoogle: Gemma 3 12Bgoogle/gemma-3-12b-itGoogleGoogle: Gemma 3 27Bgoogle/gemma-3-27b-itGoogle
Template variants of the same tokenizer
These signatures differ from this one by a uniform one-token shift on the affected strings: the same vocabulary behind a different chat template.
The measured vector
Marginal prompt-token cost per string, as measured on Google: Gemini 2.5 Flash LiteAll 50 rows
English and whitespace
en-prose14
en-long16
spaces-203
spaces-604
tabs-203
newlines-203
mixed-ws9
Digits
digits-99
digits-1212
digits-3030
digits-sep12
float-long22
CJK
zh-common10
zh-long12
zh-rare25
ja-kana7
ja-kanji9
ko11
Other scripts
ru12
ar10
he13
hi8
th10
el13
Emoji
emoji-basic5
emoji-skin10
emoji-zwj-family7
emoji-zwj-x321
emoji-flags8
emoji-prof11
Rare Unicode
math26
boxdraw17
combining10
cjk-ext-b16
surrogates27
zalgo22
rtl-mix5
Code
py-code28
py-indent18
json28
html14
regex44
camel6
snake11
Repetition and encodings
rare-word-x525
repeat-tok21
base6434
hex16
url23
uuid36
Method: tokenizer fingerprinting, v1-50. Raw data: fingerprints.json · index.json · test-strings.json.