Skip to main content
NewsPublished

Our AI pentesting engine talked a production AI agent's prompt-injection guardrail into handing over its entire system prompt on its second attempt.

Source Reddit NetSec

0

Discussion

An AI pentesting engine named Cascade successfully bypassed a production AI agent's prompt-injection guardrail by reframing its request, causing the agent to disclose its entire system prompt, including tool lists, calling rules, citation formats, and session IDs. The bypass did not rely on technical vulnerabilities but on social engineering-like prompt reframing that made the request appear reasonable to the agent. This finding highlights a novel attack vector against AI agents relying on prompt-based guardrails.

r/netsec (opens in a new tab)u/PriorPuzzleheaded8800 points0 comments

For full disclosure I'm part of the security engineering team at Escape but this finding is something I found really interesting and wanted to share to see!

Our AI pentesting engine Cascade recently got a production AI agent to return its entire system prompt, just by wrapping the ask in a different pretext - framing it as a documentation request instead of an attack.

The agent then handed over everything: full tool list, calling rules, citation format, and session IDs.

What I found really interesting is there's nothing technical that broke because we didn't bypass the guardrail with a cleverer string but because the request just sounded reasonable to the agent.

The Cascade engine, after being refused when asking for the prompt directly, simply adjusted the framing to get the agent to give up the informaiton.

Thought this would be an interesting insight for the community and curious to hear if anyone else has seen similar discoveries in agents in prod?

If you want to see more about the reproduction and write-up you can find it here

References

Community reviews

Loading reviews…