A team switches a workload from a non-reasoning model to a DeepSeek-V4-class reasoning model. The user-visible answers look the same length, but the monthly output-token bill jumps roughly 10-50x. Explain the mechanism behind that, how the hidden tokens are billed, and what the right cost-side mitigations are.
Reasoning models emit a hidden chain-of-thought before the visible answer. Those thinking tokens count as output tokens on the bill, often 10-50x the visible reply, which is why output cost explodes silently.
Imagine hiring a contractor who writes a thick notebook of design notes before sending you the final blueprint. You only ever see the blueprint, but you pay for every page of notes too because the contractor charges per page of work, not per page delivered. A reasoning model is doing the same thing under the hood. Before the visible reply, it generates a long internal scratchpad of thoughts, checks them, revises, and only then emits the short final answer you read. The provider's API bills you for every token the model produced, including all the scratchpad tokens the UI hides. That is why your bill can jump dozens of times even though the answer on the screen looks the same length as before.
Detailed answer & concept explanation~7 min readEverything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.
Everything important, quickly.
3 min: hidden chain-of-thought as billed output + reasoning_tokens API counter + 10-50x amplification + instrumentation + budget caps + difficulty routing.
Real products, models, and research that use this idea.
- DeepSeek V4 exposes thinking_tokens in its API usage block separately from completion_tokens, so cost attribution per route is mechanical.
- Anthropic's extended-thinking endpoints on Claude Opus 4.7 expose reasoning_tokens in the usage block and let callers cap the reasoning budget per request.
- OpenAI's o-series reasoning models bill reasoning tokens at the same output rate and surface them in the response usage object.
- Coding agents that switched to reasoning-tier backends commonly report 10-30x monthly cost growth that resolves once they add a difficulty router.
- Cost-monitoring tools like Helicone and LangSmith added reasoning-token dashboards in 2026 specifically because the old completion-token charts hid the new cost driver.
What an interviewer would ask next. Try answering before peeking at the approach.
QHow would you design the dashboard that catches reasoning-token regressions?
QWhen does capping the reasoning budget hurt quality, and how would you detect that?
Don't say thisRed flags and common mistakes that signal junior thinking. Click to expand.
Red flags and common mistakes that signal junior thinking. Click to expand.
Reading only completion_tokens on the bill and missing the separate reasoning-token counter. The hidden thinking pass usually dwarfs the visible reply for this model class.
The night-before-the-interview bullets. Scan these on the way to the call.
Primary sources. Skim if you want the original framing.
Same topic, related formats. Practice these next.