A planted canary is recoverable verbatim—what does that indicate?
Same topic, related formats. Practice these next.
Same topic, related formats. Practice these next.
A pretraining team injects unique canary strings into a small corpus slice. After training, targeted prompts recover several canaries verbatim with high confidence. What conclusion should be reported?
Recoverable canary strings indicate extractable memorization risk and require immediate data-pipeline and release-gate mitigation.
Imagine hiding a fake sentence in a giant pile of books to test if a student copies exact lines. If later the student repeats that exact hidden sentence on demand, it means they memorized specific text, not just general ideas. Canary tests do that for models. Verbatim recovery is a warning sign for leakage and privacy risk.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.
Everything important, quickly.
6 min: mechanism framing + boundary condition + telemetry gates + production failure modes + one concrete numeric scenario.
Real products, models, and research that use this idea.
What an interviewer would ask next. Try answering before peeking at the approach.
Red flags and common mistakes that signal junior thinking. Click to expand.
The wrong conclusion is calling canary recovery harmless creativity instead of memorization evidence.
The night-before-the-interview bullets. Scan these on the way to the call.
Primary sources. Skim if you want the original framing.