What is STRR and how does it complement fertility as a tokenizer fairness metric? · Zenaique

Attempt it

STRR = fraction of a language's vocabulary that maps to single tokens. High STRR means the language is well-represented in the learned vocabulary: most words have dedicated single-token entries.

Fertility (tokens/word average) captures typical cost on common text but can be misleadingly low if a few very common words are single tokens while most vocabulary fragments. STRR captures depth of linguistic coverage across the full word space. Both metrics together give a fuller picture of tokenizer fairness: fertility = average cost; STRR = vocabulary breadth.

Your answer

Quick reference

TL;DR

STRR is the fraction of a language's vocabulary that maps to single tokens; it measures coverage breadth across the word space, catching the rare-word fragmentation that a frequency-weighted fertility average hides.

Memory aid

Sign in for the mnemonic that makes this stick. See Pro pricing.

Easy to grasp

Imagine grading a grocery store on how easy it is to grab what you need in one reach. Fertility is like timing an average shopper, who mostly buys the same ten popular items kept right at the front, so the store looks fast. STRR instead walks every aisle and counts how many of all the products are within easy reach. A store can look fast for the regulars while burying everything else on high shelves. STRR is the full-aisle audit; fertility is the regular-shopper stopwatch. You want both to know who the store really serves.

Key concepts

Detailed answer & concept explanation

~4 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.

Sign in for 5 free unlocks/day or go Pro for unlimited. See Pro pricing.

Quick scan · 2–4 min

Everything important, quickly.

2-3 min: STRR is single-token coverage rate + fertility is frequency-weighted mean + weighted vs unweighted + head hides the tail + tail carries meaning + report both per language.

Real-world examples

Real products, models, and research that use this idea.

Tokenizer fairness audits of OpenAI's o200k_base report fertility and retention together per language to show whether multilingual gains reach the rare-word tail, not just common words.
The BLOOM and Aya multilingual projects evaluated coverage breadth alongside average fertility when designing balanced tokenizers for low-resource languages.
Cohere's enterprise localization work pairs an average-cost number with a coverage number when choosing or extending a tokenizer for a target market.

Interviewer follow-ups

What an interviewer would ask next. Try answering before peeking at the approach.

QHow would you compute STRR in practice for a language whose word list you do not cleanly have?

Sign in or go Pro to see the approach for this follow-up.

QTwo tokenizers have identical fertility on your corpus but very different STRR. Which do you pick and why?

Sign in or go Pro to see the approach for this follow-up.

QCan STRR be misleading on its own, the way fertility can?

Sign in or go Pro to see the approach for this follow-up.

Don't say this

Red flags and common mistakes that signal junior thinking. Click to expand.

Most common mistake

Treating STRR as just another name for low fertility, when one is a frequency-weighted average cost and the other is unweighted coverage breadth across the whole vocabulary.

Sign in or go Pro to see all red flags and common mistakes. See Pro pricing.

60-second cheat sheet

The night-before-the-interview bullets. Scan these on the way to the call.

Sign in for 5 unlocks/day or go Pro for unlimited revision sheets. See Pro pricing.

References

Primary sources. Skim if you want the original framing.