6 patterns

Safety & Oversight

Checks and human approval points wrapped around any of the other patterns.

Patterns in Safety & Oversight

Human-in-the-Loop

Safety & Oversight · 6 nodes · 2 LLM calls · branch · human · 3 scenarios

+2 variants · No single inventor

Pause before high-stakes or irreversible actions so a person can approve, edit or reject; then resume.

Guardrails

Safety & Oversight · 7 nodes · 5 LLM calls · parallel · branch · 3 scenarios

+3 variants · OpenAI 2025

Checks that run before and after the agent, any of which can block or redirect the flow.

Permission Policies

Safety & Oversight · 6 nodes · 5 LLM calls · loop · branch · human · 2 scenarios

No single inventor

Every tool call is checked against declarative allow, ask and deny rules and a budget before it runs.

Sandboxed Execution

Safety & Oversight · 8 nodes · 2 LLM calls · loop · branch · human · 2 scenarios

No single inventor

Agent commands run inside an isolated filesystem and network boundary, so only crossings of that boundary need approval.

Dual LLM

Safety & Oversight · 8 nodes · 2 LLM calls · 2 scenarios

+1 variant · Simon Willison 2023

A tool-holding LLM never sees untrusted text; a tool-less LLM reads it, and code passes its output along only as variables.

LLM-as-Judge

Safety & Oversight · 7 nodes · 3 LLM calls · branch · 2 scenarios

+3 variants · Zheng et al. 2023

A separate judge model scores a system's outputs against a rubric, and the scores gate releases or rank candidates.