Zenaique

Walk through three distinct ways LLM04 (model DoS) shows up in production

Flashcard·Medium·4.0 · 0·~30s·Asked atAutodeskDecagonWhylabs
Attempt it
TL;DR

Model DoS shows up as token floods, recursive agent loops, and expensive-tool spam; the shared defence is per-dimension ceilings (tokens, steps, dollars) plus rate limiting so every request is bounded in every

Memory aid
Sign in to see the mnemonic that makes this stick.
Easy to grasp

Picture a small restaurant. A denial of service is when one customer orders so much that the kitchen cannot serve anyone else. There are different ways to do this. The customer can order a hundred plates of pasta and tie up the cooks. Or they can ask for a custom dish that requires the kitchen to keep going back to the pantry, the prep station, and the freezer in an endless loop. Or they can keep ordering the truffles, which cost the restaurant a fortune even though only one customer is at the table. The owner protects the restaurant by setting limits, most pasta plates per customer, longest the kitchen can spend on one order, biggest bill any single customer can run up. Each limit closes one trick.

Concept explanation~2 min read

Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.

Model denial of service sounds like the easiest item on the OWASP LLM Top 10 to defend against, surely rate limits handle it, and it consistently surprises teams in production. The reason is that LLM applications consume resources along several independent dimensions, and an attacker only needs to win on one of them to cause damage. Treating DoS as a rate-limiting problem misses two-thirds of the defence.

This card walks through three canonical production manifestations, the per-dimension ceiling stack that defends against them, the cost-telemetry foundation that has to come first, and the 2025-2026 wrinkles introduced by reasoning models and multi-modal inputs.

Three production manifestations of LLM04

Token-flood. A crafted prompt induces the model to generate the maximum-length output every request. Concurrency slots are the scarce resource, every active request occupies one of your provider's concurrent-request slots for the full generation time. Long generations hold slots longer. A handful of attackers can saturate a small team's provider quota and lock real users out, all without any unusual request rate.

The attack is amplified on models with long maximum outputs (32k tokens for many 2026 models, 100k+ for some). Each completed flood request can take 30-90 seconds, so even a modest attack rate translates into large concurrent-load.

Recursive agent loop. Against agentic deployments, the prompt does not just generate text, it triggers a long tool-call loop. The attacker either constructs an input that confuses the agent into loop and retry behaviour, or supplies content that injection-triggers a deliberately verbose plan. Each step costs model tokens for the planning call, plus whatever the tool costs. Without a step cap, a single user request can issue thousands of tool calls.

This is also where the attack overlaps with LLM08 (excessive agency), the attacker actively wants more iterations because each one is another chance to slip a destructive call through.

Expensive-tool spam. Where the agent has tools that cost real money per call, vector search over a large index, sandboxed code execution, paid third-party APIs, large-context embedding requests, the attacker steers the agent toward the most expensive tools. The request count stays low; the cost rises sharply. Rate limiting alone does not catch this, because the requests are individually legal.

Per-dimension ceilings, the non-substitutable stack
Rate limits, multi-scale, not single
Cost telemetry, reasoning models, and operational metrics
Sign in to unlock the full deep dive.

Situations where this technique stops working.

Sign in to see when this approach fails.

2–4 min · Everything important, quickly.

Sign in to see the quick scan of the deep dive.

Real products, models, and research that use this idea.

  • Major LLM API providers (OpenAI, Anthropic, Google) all enforce per-account concurrency caps and per-model token rate limits precisely because token-flood is a known attack pattern.
  • Agent frameworks (LangGraph, CrewAI, AutoGen) ship default step caps because production teams reported runaway-loop incidents within months of agent deployment.
Sign in to see more production examples.

What an interviewer would ask next. Try answering before peeking at the approach.

QHow would you bound the damage from a single legal but expensive request?
A

Per-tier cost caps, automatic throttle on cost-anomaly detection, and a request-cost preview that estimates spend before execution for outlier-shaped requests.

2 more follow-ups an interviewer would ask next. Sign in to reveal them.

Red flags & common mistakes

The phrases that signal junior thinking. Click to expand.

Most common mistake

Treating DoS as a rate-limiting problem only; the real defence is per-request ceilings on every resource the request can consume (tokens, steps, downstream calls, dollars) layered with rate limits.

Sign in to see all red flags and common mistakes.

60 second bullets to scan on the way to the call.

  • Three distinct production manifestations of LLM04

  • Why per-dimension ceilings (token, step, cost, wall-clock) are non-substitutable

Sign in to unlock the revision sheet.

Primary sources. Browse if you want the original framing.

Similar questions

Same topic, related formats. Practice these next.

4 curated
Next question
Pick the strongest reason…
MCQ·Medium