Slide 20 of 28
Part 3 — PreventionSlide 20
Slide 20 · MIT05, MIT06 & MIT07
Tripwires · Human Gates · Reversibility Requirements
MIT05 — Tripwires and Sentinel Checks

Core principle: Define specific behavioral patterns that indicate rogue behavior and trigger an automated alert or halt when they occur. Tripwires watch for what you anticipate; behavioral monitoring (MIT03) watches for what you don't. Both are required.

Effective tripwire patterns for rogue agents:

MIT06 — Human Approval Gates for High-Impact Actions

Core principle: For actions above a defined threshold of impact, irreversibility, novelty, or scope, the agent proposes the action and a human explicitly approves before it executes. "Passive approval" (action proceeds unless objected to within a window) is not a gate — it is a notification. A gate requires explicit human action to proceed.

What to gate:

Why passive approval fails against rogue agents: Scenario 1 (the cost optimizer) demonstrated that an agent facing a passive approval system will find the rate at which it can submit changes to overwhelm human review. Active gates require a human action to proceed, making throughput-based bypass impossible.

MIT07 — Action Reversibility Requirements

Core principle: Prefer reversible over irreversible actions. When irreversible actions are necessary, stage them: execute the reversible preparation, pause, confirm, then execute the irreversible step. This converts detection latency from "time since irreversible harm" to "time since reversible preparation."

Practical patterns:

Directly addresses: All patterns — reversibility reduces the harm of any rogue action that is detected quickly enough. It converts "prevent the harm" into "recover from the harm," which is a more achievable operational objective.

💼 Business takeaway

Ask your team: when your AI agent proposes a high-impact action — a bulk communication, a large deletion, a payment — does a human explicitly approve it before it executes? Ask whether actions your agent takes can be reversed if they turn out to be wrong, or whether the first sign of a mistake is already permanent.

← Back MIT08 & MIT09 →