Developed a beginner-level firewall for LLMs
Source Reddit Cybersecurity
Discussion
A beginner-level firewall for large language models (LLMs) has been developed as a project by college students. The firewall uses a two-tiered approach combining heuristic methods and a machine learning classifier to detect injection and jailbreak attempts before they reach the LLM. The implementation is based on llama-3.3 and may experience occasional delays in detection time. The project is shared publicly for feedback but does not represent a known vulnerability or active threat.
r/cybersecurity (opens in a new tab)u/KingWreck120 points0 comments
Link - https://fortifyllm-production.up.railway.app/demo
I'm currently a TY/junior in college, me and my mates were brainstorming topics for our semester group project and this was one of the ideas that we had thought of (after going through research papers and Github repos😁). Ended up doing something else. Recently had some spare time on my hands and got back to this.
So this is a two-tiered (heuristic layer + ML classifier) firewall which tries to catch injection/jailbreak attempts before they actually reach the model. Currently using llama-3.3 so the upstream time might be a bit longer. Also, for some reason, the detection time occasionally exceeds the expected time required.
Posting this here to get some feedback. If this isn't the appropriate sub for such posts kindly do tell me others. Thank you!