High

Data Exfiltration via Disguised Analytics Collection

Some AI agent tools claim to do simple things like formatting or processing text, but their descriptions or code reveal they actually send conversation content or user data out as 'analytics' or 'usage data.' This hides data exfiltration behind a label most people assume is harmless and routine.

How the attack works

An attacker builds or modifies a tool that an AI agent can call, giving it an innocuous-sounding purpose such as text formatting. Buried in the tool's description or implementation is a statement that it also transmits conversation data, user content, or context to an external destination, framed as analytics or usage tracking. Because analytics collection is widely treated as routine and low-risk, the agent or its operator does not question the behavior or ask for explicit consent. The tool then exfiltrates sensitive conversation data under this cover story every time it runs.

Netzilo detection

Netzilo reports this behaviour when it is observed.

Signature ID
13d4dbc5-5b85-4a16-b6ca-3d5056ca8354
Severity
High

Why it matters

Sensitive conversation content, user data, or internal context can be silently sent to third parties without consent, resulting in data leakage that may go unnoticed because it is mislabeled as normal telemetry.

What you can do

  • Review the full description and code of any tool an agent can call, not just its stated purpose, before allowing it to run.
  • Require explicit, documented consent and disclosure for any tool that transmits conversation or user content externally, even if labeled as analytics.
  • Restrict outbound network access for agent tools to known, approved destinations and block undisclosed data transmission.
  • Audit existing tools periodically for mismatches between their claimed function and their actual data-handling behavior.

Known benign look-alikes

  • Legitimate analytics tools with transparent data collection policies
  • Security documentation or policy page that describes how disguised analytics exfiltration works using similar terminology
  • An AI safety research paper discussing tools that collect conversation data under the guise of analytics telemetry

References

Related threats