Match each compliance regime to the concrete guardrail control it forces
Drag each answer to line up with its matching prompt
HIPAA safe deployment
BAA covered model endpoints and PHI redaction on input and trace export
FedRAMP safe deployment
Right not to be subject to solely automated decisions; human in the loop for significant decisions
SR 11-7 (banking model risk)
Inference inside an authorised boundary, FIPS validated crypto, immutable audit logs
SOC 2 Type II
Operating effectiveness evidence over a period, every guardrail decision logged with reviewable trail
GDPR (Article 22)
Independent model validation, documented limitations, ongoing performance monitoring
Each compliance regime forces a distinct guardrail control: HIPAA needs BAA-covered endpoints plus PHI redaction; FedRAMP needs an authorised boundary and FIPS crypto; SR 11-7 needs model validation; SOC 2 wants
Think of compliance regimes as different inspectors visiting your kitchen. The hospital inspector wants to see signed contracts with all your suppliers and to watch you cover patient names before any photo leaves the kitchen. The government inspector wants you cooking inside a specific approved building with government-grade locks. The bank inspector wants someone other than the chef to validate each recipe. The audit inspector wants a year of log books showing every meal went through the controls. The privacy inspector wants a human to approve any big decision before it affects a customer. Each regime forces a specific control in your LLM stack, same idea.
Concept explanation~2 min read
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Concept explanation~2 min read
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Compliance regimes are not interchangeable. HIPAA, FedRAMP, SR 11-7, SOC 2, GDPR, EU AI Act, NIST AI RMF, and ISO 42001 each impose a specific set of architectural and evidence requirements on LLM deployments. Treating compliance as one undifferentiated bucket and shipping a generic safety stack to cover "compliance" produces a stack that satisfies none of the regimes that actually apply.
This deep dive walks through the five most common regimes for LLM deployments, the concrete control each one forces, and the operational practices that make the evidence chain audit-ready.
HIPAA, BAA-covered endpoints plus PHI redaction
HIPAA (US health-information privacy law) regulates Protected Health Information (PHI). For LLM deployments handling PHI, two controls are non-negotiable.
Business Associate Agreement (BAA)
Any third party processing PHI must sign a BAA, a legal-paper control that flows liability. Anthropic Claude on AWS Bedrock under BAA, Azure OpenAI Service under BAA, and GCP Vertex AI under BAA are the 2026 patterns. Self-hosted Llama 4 in a covered VPC also qualifies. Calling a non-BAA-covered API with PHI is a HIPAA violation regardless of how the prompt is constructed.
PHI redaction at input and trace export
PHI categories, patient name, address, date of birth, medical record number, account number, diagnoses tied to identity, must be redacted before the data leaves the covered boundary. The 2026 pattern is Bedrock Guardrails' sensitive-information filter or Azure AI Content Safety PHI detector at the gateway, plus a re-redaction pass on observability exports (Langfuse, Helicone, Datadog) so PHI does not leak into vendor systems that lack BAAs.
The evidence chain a HIPAA audit follows: signed BAAs on file, gateway logs showing redaction firing, observability vendor BAAs (or proof the export pipe is redacted), and incident-response procedures for any breach.
Situations where this technique stops working.
2–4 min · Everything important, quickly.
Real products, models, and research that use this idea.
- AWS Bedrock publishes HIPAA-eligible configurations for Claude Opus 4.7 and Llama 4 Maverick with BAA coverage and Bedrock Guardrails PHI filters
- Azure OpenAI Service offers a FedRAMP High authorisation for Azure Government deployments with FIPS-validated crypto and immutable Log Analytics retention
What an interviewer would ask next. Try answering before peeking at the approach.
QA FinTech wants to ship LLM-driven credit-decisioning. Which regimes apply and what do they force?
SR 11-7 for the model risk management framework with independent validation. GDPR Article 22 for the right not to be subject to solely automated decisions (and analogous provisions in the EU AI Act high-risk regime for creditworthiness scoring). SOC 2 Type II for operating-effectiveness evidence. EU AI Act conformity assessment if deployed into the EU. The stack needs a validation team, a HITL path, an immutable audit log, and a continuous-evaluation harness producing per-category robustness evidence.
Red flags & common mistakes
The phrases that signal junior thinking. Click to expand.
Red flags & common mistakes
The phrases that signal junior thinking. Click to expand.
Treating compliance as one undifferentiated checkbox and shipping a single generic rails layer that satisfies none of the regimes' specific control requirements.
60 second bullets to scan on the way to the call.
What specific control HIPAA forces on an LLM deployment
What architectural commitment FedRAMP makes irreversible
Primary sources. Browse if you want the original framing.
Same topic, related formats. Practice these next.