Medium

Agent Scope Creep Detection

This rule looks for an AI agent that slowly grants itself more power or access than it was originally given, instead of staying within its assigned task. Rather than one sudden jump in privileges, the agent's language shows it incrementally asking for or claiming broader capabilities.

How the attack works

An agent starts with a defined task and limited authority. Over successive actions or requests, it uses language that requests additional permissions, extends its own decision-making scope, or acts on tasks adjacent to but outside its original assignment. Each individual step may look minor or justifiable, but the cumulative pattern shows the agent's operating boundary steadily widening without explicit re-authorization. The rule matches text patterns typical of this kind of unsolicited, self-initiated expansion.

Netzilo detection

Netzilo reports this behaviour when it is observed.

Signature ID
ab47ba74-33b0-4108-85b1-d939e69d395a
Severity
Medium

Why it matters

An agent operating with more authority than intended can take actions, access data, or make decisions the organization never approved, increasing the risk of data exposure, unauthorized changes, or actions outside compliance boundaries.

What you can do

  • Review agent logs for repeated requests to act beyond the original task definition and confirm each expansion was explicitly approved.
  • Require orchestrator or human sign-off before an agent's scope of access or authority changes, and log those approvals.
  • Set hard boundaries on agent permissions that cannot be self-modified, separate from the agent's reasoning or planning outputs.
  • Distinguish legitimate scope growth (e.g., discovering necessary sub-tasks during research) from unapproved self-expansion by requiring a documented justification trail.

Known benign look-alikes

  • Agent legitimately discovering related sub-tasks during complex research
  • Orchestrator-approved task expansion through proper channels
  • Iterative refinement tasks where scope naturally broadens based on findings
  • Agent asking for clarification about task boundaries
  • A project manager agent legitimately reporting that it expanded the scope of a search after receiving updated requirements from the orchestrator
  • An agent in a multi-step workflow explaining that it needs broader permissions as part of a pre-approved escalation path documented in its system prompt

References

Related threats