Zenaique

Estimate the daily bill for the reasoning tier behind a 30% router split

Predict output·Hard·4.0 · 0·~2 min·Asked atCoinbaseGongTypeface
Attempt it
Your product takes 200,000 requests per day. The router sends 30% to the reasoning tier, where requests average 5,000 thinking tokens plus 500 visible output tokens, all billed at $10 per 1M output tokens. Ignoring input token cost, estimate the daily spend on the reasoning tier.
TL;DR

60,000 reasoning calls daily times 5,500 output-billed tokens at $10 per million lands at $3,300 per day, and over 90% of that bill is hidden thinking.

Memory aid
Sign in to see the mnemonic that makes this stick.
Easy to grasp

Picture a metered taxi where the meter runs while the driver thinks about the route in their head, not just while you are moving. A reasoning model is that taxi. The reasoning tier sees 60,000 trips a day. Each trip costs 5,000 thinking-meter tokens plus 500 driving-meter tokens, all charged at the same rate. Multiply trips by tokens, divide by a million, multiply by the price, and you get a daily bill of $3,300. The lesson is where the bill sits: almost all of it is the thinking meter, not the driving meter. If you want to cut spend, you tune what the driver thinks about, not how long they talk at the end.

Key concepts

Concept explanation~2 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Reasoning-tier capacity planning is a different exercise from chat-tier capacity planning. A chat model bills only the visible answer, so unit economics line up cleanly with what the user sees. A reasoning model bills a large hidden trace at the same rate as the visible answer, and that trace dominates the per-call cost on most prompts. To plan budget you have to think in terms of output-billed tokens, not visible tokens.

The scenario walks through one common shape: 200,000 daily requests with a router that escalates 30% to the reasoning tier, 5,000 thinking tokens plus 500 visible tokens per call, $10 per million output tokens. The number lands at $3,300 per day. The arithmetic is easy. What makes this a senior-tier question is the structure, the levers, and the reconciliation gotchas that fall out of the structure.

The arithmetic, step by step

Start with traffic. 200,000 total daily requests, 30% to reasoning, means 60,000 calls per day arrive at the reasoning tier. The other 140,000 hit the fast tier and are priced separately.

Move to per-call cost. Each reasoning call emits two streams that bill at the output rate: 5,000 thinking tokens and 500 visible tokens. Total output-billed tokens per call is 5,500.

Multiply through. 60,000 calls times 5,500 tokens equals 330,000,000 output-billed tokens per day. Divide by 1,000,000 to land in millions, multiply by the $10 unit rate, and the daily reasoning-tier bill is $3,300.

The single highest-leverage check at this point is to decompose the bill. Thinking-only cost: 60,000 x 5,000 x $10 / 1,000,000 = $3,000. Visible-only cost: 60,000 x 500 x $10 / 1,000,000 = $300. Hidden thinking is 91% of the reasoning-tier bill at this prompt mix. Internalize that ratio. It is what drives every interesting cost-control decision downstream.

Why thinking-token share matters more than the absolute number
Ranking the levers
Capacity planning and peak versus average
What would change the answer
Predicting the bill across reasoning tiers
Sign in to unlock the full deep dive.

Situations where this technique stops working.

Sign in to see when this approach fails.

2–4 min · Everything important, quickly.

Sign in to see the quick scan of the deep dive.

Real products, models, and research that use this idea.

  • OpenAI o3 and o4-mini bill reasoning tokens at the output rate, and the usage object explicitly reports reasoning_tokens as a subset of output_tokens.
  • Anthropic Claude Opus 4.7 with extended thinking exposes a thinking-budget knob and bills the trace at output rates.
Sign in to see more production examples.

What an interviewer would ask next. Try answering before peeking at the approach.

QIf you drop the router split from 30% to 20%, what is the new daily bill?
A

Recompute calls (40,000), keep 5,500 tokens per call, redo the math. The answer is $2,200 per day, a $1,100 saving from a 10-percentage-point shift.

1 more follow-up an interviewer would ask next. Sign in to reveal them.

Red flags & common mistakes

The phrases that signal junior thinking. Click to expand.

Most common mistake

Pricing only the visible answer tokens. That undercounts the bill by an order of magnitude on the reasoning tier because hidden thinking dominates output-token usage.

Sign in to see all red flags and common mistakes.

60 second bullets to scan on the way to the call.

  • Compute calls per tier from total requests and router percentage

  • Combine thinking and visible tokens at the output rate to get per-call billed tokens

Sign in to unlock the revision sheet.

Primary sources. Browse if you want the original framing.

Similar questions

Same topic, related formats. Practice these next.

4 curated
Next question
Match each RL algorithm trait to PPO or GRPO.
Match pairs·Medium