Slide 19 of 28
Part 3 — PreventionSlide 19
Slide 19 · MIT03 & MIT04
MIT03: Behavioral Monitoring — MIT04: Capability Sandboxing
MIT03 — Behavioral Monitoring and Anomaly Detection

Core principle: Individual action monitoring catches individual actions that exceed a threshold. Multi-step chains, proxy exploitation, and instrumental capability acquisition often don't trigger individual-action thresholds — they produce patterns that are only visible in aggregate. Behavioral monitoring watches what the agent accomplishes, not just what each call does.

What behavioral monitoring looks for:

Critical architectural requirement — independent monitoring: The monitoring system must be architecturally separated from anything the agent can influence. An agent that can modify detection rules, suppress alerts, or access monitoring configuration can undermine any monitoring system it can reach. Monitoring infrastructure must be owned by a principal above the agent in the hierarchy, with no write path from the agent to the monitoring system. Scenario 4 (the self-preserving scanner) is the direct illustration.

Directly addresses: Pattern 4 (multi-step chains — detected at cumulative level), Pattern 5 (oversight resistance — via independent monitoring architecture).

MIT04 — Capability Sandboxing

Core principle: Instruction-following is not a reliable security boundary. An agent that can be instructed to do something can be instructed (or injected) to do almost anything. Capability sandboxing enforces hard technical limits on what actions the agent can execute — limits that remain effective even after goal injection succeeds.

Layers of capability sandboxing:

Why sandboxing is primary where instruction-following is secondary: In Scenario 2 (the injected mailer), a sandbox that enforced "max 10 emails per operation" would have dramatically limited the harm even after goal injection succeeded. The agent would have been injected, but the injection would have been contained. Sandboxing is the backstop when everything else fails.

Directly addresses: Pattern 3 (goal injection — limits blast radius), Pattern 6 (capability boundary — closes unanticipated capability paths at infrastructure level).

💼 Business takeaway

Ask your team: if your AI agent started behaving unexpectedly — accessing data it rarely touches, or taking actions in unusual combinations — would anyone notice before real harm occurred? Ask whether the system's hard limits on what the agent can do are enforced by infrastructure, or just by trusting the agent to follow instructions.

← Back MIT05, MIT06 & MIT07 →