Zenaique

Flashcard: in the agent loop, what counts as an 'action' and how is it different from a thought?

Flashcard·Easy·4.0 · 0·~30s·Asked atAndurilNykaaZoho
Attempt it
TL;DR

An action is a step that touches the world or fetches new information; a thought is internal reasoning. In ReAct, the model alternates them so the runtime can execute actions and let thoughts pass through.

Memory aid
Sign in to see the mnemonic that makes this stick.
Easy to grasp

Imagine writing a recipe out loud. 'I think the dough needs more flour' is a thought. 'I add half a cup of flour' is an action. The first one is talking about what to do; the second one is actually doing it. An LLM agent works the same way. When the model writes 'I should search the database for recent orders,' that is a thought: it has not searched anything yet. When the model emits a structured tool call to the database, that is an action: the runtime sees it and actually runs the query. Thoughts help the model plan and explain itself. Actions are what change something or bring back fresh information.

Concept explanation~2 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Action and thought sound like the kind of vocabulary that comes from cognitive science, and in a sense they do. The agent literature borrowed the terms because they map cleanly onto the structural distinction every LLM agent has to make: which parts of the model's output are reasoning the runtime should let pass, and which parts are requests the runtime should actually execute.

This deep dive defines both terms precisely, walks through the ReAct pattern that canonicalized the split, shows how modern function-calling APIs encode it structurally, and explains why getting this boundary right is the foundation of agent safety. By the end, the difference between describing a step and taking it should be sharp enough to apply when reading any agent trace.

The core distinction

An action is a step that affects the world or fetches new information from outside the model. Calling a search tool. Querying a database. Running a script in a sandbox. Sending a Slack message. Clicking a button in a browser. Each of these touches something the model could not affect by writing more text.

A thought is text the model writes for itself. Reasoning about the task, planning the next step, narrating its understanding of what it has learned so far. Thoughts contribute to the model's own next decision because they become part of the context window, but they do not cause anything external to happen. A thought is the agent's notebook.

This distinction matters because the two have completely different operational properties. Actions have latency (the time to call the tool), cost (any computation or API charges incurred), side effects (state changes that may not be reversible), and safety implications (anything the tool can affect is now influenceable by the model). Thoughts have none of those. They cost tokens, but compared to actions, tokens are cheap and reversible.

The model's job on each turn is to produce both: some reasoning text (thoughts) and either a tool call (an action) or a final answer. The runtime's job is to forward the thoughts to the conversation history and execute the actions for real.

ReAct: the pattern that made the split explicit
How function-calling APIs encode the split
Why the boundary is the safety boundary
Practical implications and 2026 patterns
Sign in to unlock the full deep dive.

Situations where this technique stops working.

Sign in to see when this approach fails.

2–4 min · Everything important, quickly.

Sign in to see the quick scan of the deep dive.

Real products, models, and research that use this idea.

  • Anthropic's API distinguishes content blocks structurally: type=text blocks are thoughts, type=tool_use blocks are actions. The runtime only executes tool_use blocks.
  • the 2022 ReAct paper is the landmark pattern that made the alternation explicit; every modern function-calling API encodes its split structurally.
Sign in to see more production examples.

What an interviewer would ask next. Try answering before peeking at the approach.

QWhy did ReAct interleaving improve agent performance over a model that emits tool calls without explicit reasoning?
A

Explicit thoughts give the model a structured scratchpad to plan before committing to an action. Empirically, this reduces wasted or wrong tool calls because the model commits to a plan in text before executing, and that text steers the subsequent action.

2 more follow-ups an interviewer would ask next. Sign in to reveal them.

Red flags & common mistakes

The phrases that signal junior thinking. Click to expand.

Most common mistake

Treating the model's reasoning text as an action. Reasoning is a thought; nothing has happened until the model emits a tool call the runtime executes.

Sign in to see all red flags and common mistakes.

60 second bullets to scan on the way to the call.

  • Define an action versus a thought in the agent loop.

  • Explain the ReAct pattern and the alternation structure it makes explicit.

Sign in to unlock the revision sheet.

Primary sources. Browse if you want the original framing.

Similar questions

Same topic, related formats. Practice these next.

4 curated
Next question
What is the Model Context Protocol (MCP) and what problem does it solve?
MCQ·Easy