Zenaique

Spot the errors in this plan to route all traffic through max effort reasoning

Spot the error·Easy·4.0 · 0·~2 min·Asked atKrutrimMercorPwc
Attempt it

Click any words you think contain an error. Click again to unmark.

Mark at least one word to submit.
TL;DR

The plan errs three ways: a single global route, a false 'more thinking is always better' claim, and a 'cost is negligible' claim that ignores how thinking tokens bill at scale.

Memory aid
Sign in to see the mnemonic that makes this stick.
Easy to grasp

Picture a restaurant where every order, water refills, simple coffees, and ten-course tastings, gets sent to the head chef who insists on twenty minutes of contemplation per dish. The water sits getting warm, the coffee gets cold, and at the end of the week the payroll is impossible. The plan in the question is the same shape. Greetings and FAQs do not need a head chef; they need a counter clerk. Real meals belong with the chef. And the claim that the bill stays small assumes the chef works for free, which is the opposite of how reasoning-model billing works. Three different mistakes, all in one short sentence.

Key concepts

Concept explanation~2 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Spot-error tasks reward careful reading. The plan in this stem looks compact (one sentence), but it bundles three different production mistakes: an architectural choice (single global route), a modeling claim (more thinking is always better), and an economic claim (cost is negligible at scale). All three are wrong, but they are wrong in different ways and need different counter-arguments.

A good answer separates the claims and addresses each with its own evidence. A weak answer notices that something is off but lumps the critique together as 'this is a bad plan' without naming which piece breaks where. The difference matters because in a real design review, you have to be specific enough that the team knows which line to change.

Error one, the architecture: a single global route

The first claim is structural. Sending every incoming request, including greetings and FAQs, through the reasoning tier at maximum effort eliminates the most useful operational lever in a reasoning-model deployment: traffic shaping.

Production patterns from 2026 are uniformly class-conditional. A cheap classifier sits in front of the model layer and decides which tier to use. Templated traffic (greetings, password resets, status checks) goes to the fast model because the answer is in the model's training distribution and deliberation buys nothing. Borderline traffic goes to the fast model first with a confidence threshold, escalating to the reasoning tier only when confidence is low. Genuinely hard work (multi-document reasoning, code generation with tests, policy interpretation) goes directly to the reasoning tier.

A single global route forfeits all three of those dimensions. You lose the ability to tier by class, the ability to escalate by confidence, and the ability to manage cost when traffic shifts. When the business team eventually asks 'why did the LLM bill double last quarter?' the answer is 'we have no per-class telemetry and no way to tune it.' That is the structural critique.

Error two, the modeling claim: more thinking is always better
Error three, the economics: cost is negligible at scale
Reading the spot-error ranges
What a correct plan looks like
Why 'route everything to max reasoning' is a beginner trap
Sign in to unlock the full deep dive.

Situations where this technique stops working.

Sign in to see when this approach fails.

2–4 min · Everything important, quickly.

Sign in to see the quick scan of the deep dive.

Real products, models, and research that use this idea.

  • OpenAI o-series exposes a reasoning_effort parameter; production teams in 2026 typically run minimal or low for FAQs, medium for triage, high only on flagged-hard tickets.
  • Anthropic Claude Opus 4.7 with extended thinking documents overthinking on easy math when budget is unrestricted, motivating per-class budget caps.
Sign in to see more production examples.

What an interviewer would ask next. Try answering before peeking at the approach.

QWhat evidence would convince you that overthinking is happening on the easy slice?
A

Plot accuracy versus thinking-token budget per intent class; look for flat or declining curves past a threshold, compared to a fast-model baseline on the same slice.

1 more follow-up an interviewer would ask next. Sign in to reveal them.

Red flags & common mistakes

The phrases that signal junior thinking. Click to expand.

Most common mistake

Treating effort as a free quality dial. Maxing it globally inflates cost, hurts latency, and can even reduce accuracy on the easy slice via overthinking.

Sign in to see all red flags and common mistakes.

60 second bullets to scan on the way to the call.

  • Identify the three independent claims in a plan and check each separately

  • Sketch a request-class router with fast and reasoning tiers

Sign in to unlock the revision sheet.

Primary sources. Browse if you want the original framing.

Similar questions

Same topic, related formats. Practice these next.

4 curated
Next question
Match each RL algorithm trait to PPO or GRPO.
Match pairs·Medium