High

Screaming-Stop Goal Hijacking in User Input (PromptInject)

Attackers embed urgent, all-caps commands like 'STOP EVERYTHING' or 'HALT NOW' in text an AI agent processes, followed by an instruction to print or say a specific string. The fake emergency framing is meant to trick the agent into dropping its current task and obeying the injected command instead.

How the attack works

An attacker plants text containing an urgent, shouted stop phrase such as 'STOP EVERYTHING' or 'HALT NOW', with one or more exclamation marks, inside content the agent will read as user input. Immediately after, the text adds a directive to print, say, or output a specific quoted string. The urgency and capitalization are designed to mimic a genuine emergency override signal, making the agent more likely to comply without question. If the agent obeys, it outputs the attacker's chosen string instead of continuing its normal task.

Netzilo detection

Netzilo reports this behaviour when it is observed.

Signature ID
cf703841-1758-4fbd-bbb5-3627172fdd2d
Severity
High

Why it matters

An agent can be diverted from its intended task into echoing attacker-controlled content, which may leak information, spread misinformation, or serve as a stepping stone to further manipulation.

What you can do

  • Treat capitalized 'stop' or 'halt' commands embedded in user-supplied or third-party content as untrusted, not as system-level control signals.
  • Separate trusted system/control instructions from content the agent merely reads or summarizes, so embedded text cannot issue commands.
  • Review agent output logs for unexpected printed strings that don't match the requested task.
  • Test agents against known prompt injection patterns, including urgency-framed stop commands, before deployment.

Known benign look-alikes

  • Urgent messages without print/say output directive: 'STOP - this is an emergency!'
  • Legitimate stop directives: 'Stop everything and review the code before deployment'
  • STOP + output without screaming pattern: 'Please halt and output the error log'

References

Related threats