We’re building open research on how AI agents get attacked, and we need people to review the data
Source Reddit ThreatIntel
Discussion
BlueSwarm is an open research project studying how AI agents and related tools are probed and attacked in the wild. It operates decoy sites and endpoints to collect data on probing activity and develops detection rules based on this data. The project is in early stages and seeks researchers to review collected data and help refine detection rules. It is a research initiative, not a security product, and does not claim to provide protection. No specific vulnerability or exploit is described.
r/threatintel (opens in a new tab)u/Plastic-Sugar16800 points0 comments
I run BlueSwarm, a research-only blue-team project studying how AI agents and the tools around them get probed in the wild. We run decoys, collect what visits them, and publish what we find. It’s early, and what limits us now is people looking at the data, so we’re recruiting researchers.
What we run
- Decoys: invented sites and endpoints that advertise AI tooling (agent cards, MCP-style manifests,
llms.txt) so we can measure who looks for it. All content is made up, labelled as fake, and contains nothing aimed at visitors. As far as I know there is little public data on this. - Canary kit: a small kit a defender can put on a site they own to find out whether anything acts on hidden text addressed to AI agents. It sends nothing back to us.
- Detection package development: we’re drafting detection rules from what the decoys see, and researchers help decide which are worth keeping. Signed updates and packaged defences are planned next. They aren’t built yet.
- War Room: a browser game where you defend (or attack) an invented app over 12 short rounds. It’s free to play without an account, matches are recorded after a consent notice, and the daily game has a leaderboard.
What researchers do now: research tasks
When you sign in to the lab you get a Next task card with one small review job at a time:
- accept or reject an alert our agent suggested
- say whether grouped items are the same, mixed or unsure
- keep, tighten or retire a detection rule (unlocked later)
Every task is checked by two reviewers, and you earn points, plus a bonus for agreeing with the majority. A few tasks are practice samples with a known answer, so careful beats fast. Points move you up the leaderboard and unlock harder tasks (Senior at 25 points, Lead at 80). You can skip anything, and there’s an optional Tuesday reminder email you can switch off.
What we don’t do
Nobody sees addresses, networks or per-visitor rows. Reports are only published after two people check them, and corrections stay visible. This is research, not a security product, and we don’t claim it protects anyone.
Who we want: people interested in blue-team work, detection engineering or AI agent security. You don’t need experience. Write what you’d like to look at.
Try the game or request researcher access here: blueswarm.co.uk
Questions below, and tell me what’s unclear or missing.