Local test harness for AI browser instruction-boundary failures
Source Reddit Cybersecurity
Discussion
This is a local, benign test harness designed to evaluate whether AI browsers or browser agents improperly treat webpage content as authoritative, potentially crossing user authorization boundaries. It includes six static test scenarios that simulate instruction-boundary failures such as hidden instructions, game framing, cross-page secret retrieval, scoped authorization, authorization drift, and gradual scope creep. The suite uses inert canaries and a local evidence server to log navigation and submission events without involving real credentials or external endpoints. It is not a vulnerability or exploit but a tool for assessing AI browser security models against prompt-injection style attacks.
r/cybersecurity (opens in a new tab)u/Muddie0 points0 comments
I put together a small local harness for testing a specific agentic-browser failure mode: webpage content being treated as authority to cross a user-controlled boundary.
The goal is not to reproduce one specific BioShocking puzzle or claim a browser is safe/unsafe. The goal is to test the underlying property:
Can untrusted page content cause an AI browser or browser agent to open another context, retrieve a canary, submit data, or reuse a prior read grant as a later submit grant without fresh user authorization?
The suite is static/local and uses inert canaries only. No real credentials, no real accounts, and no external exfiltration endpoint.
It includes six tests:
- hidden instructions delivered through five separate channels
- game framing directly
- cross-page fake-secret retrieval
- scoped authorization
- authorization drift
- gradual scope creep
There is also a local evidence server that logs navigation and submit events independently of the agent transcript.
Repo: github.com/larrypeseckis/agentic-browser-boundary-tests
I’m interested in critique of the test design, especially whether the scenarios cover the right authority-boundary cases and whether the scoring rubric is too subjective.