Jailbreak
Also known as: Jailbreaking, Safety bypass
Adversarial prompt that bypasses an LLM's safety training to elicit normally-refused content.
An adversarial prompting technique that bypasses an LLM's safety training to elicit normally-refused content. Methods range from roleplay framings (DAN) to encoded payloads, multi-turn manipulation, and gradient-based attacks (GCG).
In practice
Constant cat-and-mouse for any consumer-facing app. Senior safety interviews probe defense-in-depth and the limits of RLHF safety.
How it compares
Jailbreak targets the model's safety policy; prompt injection targets the system prompt and tool integrity.
Related topics
Related terms
Hallucination
When a model confidently makes up something that isn't true.
LLM Evaluation
Measuring whether an LLM does what you want, beyond "looks fine to me".
Perplexity
Exp(average cross-entropy) on held-out text; lower means the model is less surprised by real data.
Reasoning Model
An LLM trained to reason at length internally before answering. Slower and more expensive, but much better on hard problems.
Guardrails
Pre- and post-processing layers that block bad inputs/outputs and enforce policy on top of an LLM.
MMLU (Massive Multitask Language Understanding)
Multiple-choice benchmark across 57 academic subjects; the standard "raw knowledge" headline number.