Zenaique

When does underthinking cause reasoning model failures?

MCQ·Medium·4.0 · 0·~1 min·Asked atCrewaiOpenAIUnity·Relevant atAnthropic
Attempt it
TL;DR

Underthinking is premature exit from internal reasoning on hard multi-step problems — the model answers confidently while budget and task difficulty still demand more deliberate search.

Memory aid
Sign in to see the mnemonic that makes this stick.
Easy to grasp

Underthinking is like handing in a math test early because you felt confident, even though three multi-step problems needed more scratch work. The model stops its internal thinking trace too soon on a genuinely hard question, while overthinking is the opposite — wasting pages on an easy one. Billing and GRPO details are unrelated distractors.

Key concepts

Concept explanation~2 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Reasoning models introduced two symmetric failure modes on the thinking budget dial: overthinking and underthinking. This MCQ tests the latter and filters distractors about billing and GRPO architecture.

Underthinking is a policy behavior — not an API pricing artifact.

Defining underthinking

Underthinking occurs when a reasoning model stops internal deliberation too soon on a problem that still requires extended multi-step search — and does so despite remaining thinking budget.

Symptoms: short hidden traces on hard items, confident wrong final answers, skipped verification steps, failure on problems needing backtracking.

The model had room to think longer but the decoding policy terminated early — mis-calibrated difficulty estimation or reward hacking toward short answers.

Mirror failure — overthinking
Why C and D are distractors
Mitigations and monitoring
Sign in to unlock the full deep dive.

Situations where this technique stops working.

Sign in to see when this approach fails.

2–4 min · Everything important, quickly.

Sign in to see the quick scan of the deep dive.

Real products, models, and research that use this idea.

  • OpenAI o-series users report hard AIME items failed with surprisingly short reasoning traces — classic underthinking symptoms.
  • DeepSeek-R1 eval discussions note early-stop behaviors on multi-step proofs when thinking budgets are low.
Sign in to see more production examples.

What an interviewer would ask next. Try answering before peeking at the approach.

QHow does RLVR training interact with underthinking?
A

Outcome-only rewards may encourage short lucky paths — process rewards or length-aware shaping can penalize premature answer emission on hard items.

1 more follow-up an interviewer would ask next. Sign in to reveal them.

Red flags & common mistakes

The phrases that signal junior thinking. Click to expand.

Most common mistake

Picking option B — that describes overthinking (too many tokens on easy tasks), the mirror failure, not underthinking.

Sign in to see all red flags and common mistakes.

60 second bullets to scan on the way to the call.

  • Define underthinking in one sentence

  • Contrast with overthinking

Sign in to unlock the revision sheet.

Primary sources. Browse if you want the original framing.

Similar questions

Same topic, related formats. Practice these next.

4 curated
Next question
Match each RL algorithm trait to PPO or GRPO.
Match pairs·Medium