You're migrating a production prompt from Claude Opus 4.7 to GPT-5.5 to cut cost. What's the most reliable indicator that you can or cannot move the prompt as-is?
Run the prompt unchanged on both models on your golden eval set and compare per-metric retention. 95%+ on faithfulness, format, and refusal correctness means it ports; a meaningful drop means over-tuning to one model.
Imagine you have a recipe that works perfectly in your oven and you are about to buy a new oven from a different brand. The only honest way to know whether the recipe transfers is to bake the same dish in both ovens and compare. Tasting one cookie from the new oven and saying it tastes fine is the failure mode. Comparing twenty cookies on flavor, texture, and color is how you actually know. Same with prompts and models: vibe checks lie, eval scores do not.
Detailed answer & concept explanation~7 min readEverything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.
Everything important, quickly.
3 min: eval as portability gate + per-metric retention + axis divergences (XML vs JSON, refusal calibration) + flag-rolled rollout + when to maintain two prompts.
Real products, models, and research that use this idea.
- Cursor's engineering posts describe running the same coding prompts against Claude Opus 4.7 and GPT-5.5 on a golden code-edit set and routing by model strength per metric.
- Perplexity's stack runs side by side evals on Claude and GPT-5.5 prompts and tags every call with the model snapshot, enabling per-model regression attribution.
- Notion AI documented their migration from Claude Sonnet 4.x to a multi-model stack including Gemini 3.1 Flash by running the production prompt unchanged against each candidate on their golden set.
What an interviewer would ask next. Try answering before peeking at the approach.
QWhat does a credible portability eval suite look like end to end?
QHow do you adapt a Claude prompt that uses XML tags to GPT-5.5?
QWhen is the right call to maintain two prompts, one per model?
Don't say thisRed flags and common mistakes that signal junior thinking. Click to expand.
Red flags and common mistakes that signal junior thinking. Click to expand.
Eyeballing five outputs on the new model, declaring portability based on the vibe, and missing a 15 percent drop in format compliance that breaks downstream parsers on the cases you did not check.
The night-before-the-interview bullets. Scan these on the way to the call.
Primary sources. Skim if you want the original framing.
Same topic, related formats. Practice these next.