Zenaique

What is 'Constitutional AI' as a prompting pattern and how does it differ from a standard system prompt with refusal rules?

MCQ·Medium·4.0 · 0·~1 min·Asked atAnthropicEyOpenAI
Attempt it
TL;DR

Constitutional AI turns safety rules into a structured generate, critique, revise loop, so principle compliance becomes an inspectable step instead of a hope.

Memory aid
Sign in to see the mnemonic that makes this stick.
Easy to grasp

Imagine writing an essay. One approach is to read a list of rules first and then write, hoping you followed them. Another approach is to write a draft, then re-read the rules and mark every place your draft broke one, then rewrite. The second approach catches problems the first never sees, because checking is a separate step you actually do. Constitutional AI is the second approach for an LLM. Instead of just listing rules in the system prompt, you ask the model to draft an answer, critique it against named principles, and revise. That extra step turns a vague instruction into an inspectable workflow.

Concept explanation~2 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Constitutional AI tends to confuse interviewees because it lives in two worlds at once. It is the name of a 2022 Anthropic training method, and it is also the name of a prompting pattern that ships in production guardrail stacks today. The two share the same core idea, but they live at very different layers of the stack.

This deep dive separates the two, then focuses on the prompting pattern because that is what most LLM engineers actually deploy. The interviewer wants to hear that you know the training story exists, that you can articulate the inference-time loop, and that you can name where it earns its cost in production and where it does not.

The sections walk through the structural argument, the three steps in detail, the production reality, and the failure modes a senior engineer is expected to call out.

The training story vs the prompting story

The 2022 paper introduced a training pipeline where the model uses a written set of principles plus self-generated critiques to bootstrap an RL signal. The technique is called RLAIF, reinforcement learning from AI feedback, and it produced one of the model lineages that became Claude.

The prompting story is different. It uses the same loop structure (generate, critique, revise) but runs it at inference time, on any model, with no weight changes. The loop is just a particular prompt scaffold plus an orchestration layer that calls the model two or three times per turn.

The confusion in interviews comes from conflating these. A candidate who says Constitutional AI requires fine-tuning is wrong about the prompting pattern. A candidate who says the prompting pattern explains how Claude got safer is wrong about the training story. Hold them apart, and the rest of the question becomes clean.

What the three-step loop actually looks like
Why a discrete critique step beats a flat rule list
Production reality, cost and latency
Failure modes a senior engineer should call out
Sign in to unlock the full deep dive.

Situations where this technique stops working.

Sign in to see when this approach fails.

2–4 min · Everything important, quickly.

Sign in to see the quick scan of the deep dive.

Real products, models, and research that use this idea.

  • Anthropic publishes a constitutional-style prompting recipe in the Claude Opus 4.7 docs that teams adapt for guardrails on top of any model.
  • NVIDIA NeMo Guardrails ships rails that wrap a generate, critique, revise loop around base model calls for compliance-heavy domains.
Sign in to see more production examples.

What an interviewer would ask next. Try answering before peeking at the approach.

QHow would you write the principles list for a customer-support assistant?
A

Frame as 3 to 7 named, testable principles tied to support policy; each one phrased as something the critique step can answer yes or no on.

2 more follow-ups an interviewer would ask next. Sign in to reveal them.

Red flags & common mistakes

The phrases that signal junior thinking. Click to expand.

Most common mistake

Confusing the Constitutional AI training method (used for Claude) with the prompting pattern; the inference-time pattern is just generate, critique, revise against named principles, and any model can run it.

Sign in to see all red flags and common mistakes.

60 second bullets to scan on the way to the call.

  • Training method vs prompting pattern

  • The three steps of the loop

Sign in to unlock the revision sheet.

Primary sources. Browse if you want the original framing.

Similar questions

Same topic, related formats. Practice these next.

4 curated
Next question
Flashcard: what is a stop sequence in an LLM API call and what is it used for?
Flashcard·Easy