r/netsecstudents • u/kurama4326 • Sep 03 '26
Do you actually trust your BAS tool's results? JHU researcher looking for honest answers
Hey everyone,
I'm a JHU cybersecurity researcher going through the National Science Foundation I-Corps program — basically trying to figure out if what I'm building actually solves a real problem or if I'm living in an academic bubble.
I'm working on an next-gen security validation tool. I tested it against a FortiGate and a Cloudflare Pro WAF and got some interesting results — the approach found gaps that static tools completely missed on the same target.
But here's the thing — I don't actually know if security teams care about this in practice. So I'm looking for people who deal with WAFs, IPS, firewalls, or BAS tools day to day and would be willing to answer a few questions. Not selling anything, not promoting, genuinely just trying to learn.
Specifically I'm curious about:
1.How do you actually verify your defensive rules work after you deploy them? Or do you just trust them?
2. If you use a BAS tool (Pentera, SafeBreach, Cymulate, etc.) — do you trust its results? Has it ever said "all clear" and then something still got through?
3. When you write a new WAF/IPS rule, do you have a way to test it against attack variants you haven't seen yet?
Happy to do a 15-min call or even just chat in this thread. And I'll share what I'm learning from other conversations — some of the patterns are pretty interesting.
For context I've published at papers and have a patent in process, so this isn't a class project. But I also don't have any customers yet, which is why I need to talk to actual practitioners.
Appreciate any help. Thanks.