What coordination overhead does a multi-agent system introduce that a single-agent system avoids?
Describe the coordination overhead that a multi-agent architecture introduces compared to a single-agent system. Under what condition is this overhead worth paying?
Multi-agent systems add routing, shared-state synchronisation, and inter-agent messaging. That overhead only pays off when sub-tasks are genuinely parallel or need true specialists.
Imagine one person cooking a whole dinner. They know what is in every pot, they never have to explain anything to anyone, and they just work down their list. Now imagine a team of cooks. Someone has to decide who makes what. They have to share the one cutting board without bumping into each other. They have to shout updates so nobody salts the soup twice. All that talking and waiting is real work that the solo cook never did. The team is faster only if there are genuinely separate dishes that can be made at the same time, or if one cook is a dessert specialist who is simply better at desserts. If it is just one simple dish, the solo cook wins.
Detailed answer & concept explanation~8 min readEverything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example.
Everything important, quickly.
Open by framing multi-agent as a distributed system, then name the three overheads (routing, shared-state synchronisation, and inter-agent messaging) and show how a single loop avoids each. Cover the failure-propagation angle, note context isolation as the one real upside, and close with the precise conditions that justify the cost.
Real products, models, and research that use this idea.
- Anthropic's multi-agent research system uses a lead Claude Opus 4.7 agent that spawns parallel sub-agents to search independent sources, then synthesises their reports: a textbook parallel-decomposition fit.
- OpenAI's Swarm and the Agents SDK model handoffs as explicit actions, making routing and inter-agent message passing first-class concepts the developer must wire up.
- LangGraph supervisor graphs encode the orchestrator as a routing node and the shared state as a typed object, so synchronisation is the graph's central concern.
- CrewAI assigns role-specialised agents to sub-tasks and passes outputs between them, which only pays off when the crew's specialists genuinely beat one generalist agent.
What an interviewer would ask next. Try answering before peeking at the approach.
QHow do you decide between a supervisor orchestrator and a peer-to-peer handoff topology for a multi-agent system?
QWhat are the ways agents communicate, and what are the tradeoffs of a shared scratchpad versus explicit messages?
Don't say thisRed flags and common mistakes that signal junior thinking. Click to expand.
Red flags and common mistakes that signal junior thinking. Click to expand.
Reaching for multi-agent because it sounds more capable. Most tasks are sequential and tightly coupled, where a single agent with the right tools is simpler, cheaper, and easier to debug.
The night-before-the-interview bullets. Scan these on the way to the call.
Primary sources. Skim if you want the original framing.
Same topic, related formats. Practice these next.