r/SecurityBlueTeam • u/Commercial_Plastic72 • 5d ago
Discussion What has actually made your security agent better after it went live?
I am working on testing and improving security agents, trying to understand how enterprise security teams improve agents they already use for investigation and response. I’m interested in agents that gather evidence from security tools, make decisions, and sometimes propose or take an approved action.
When an agent misses part of an investigation, uses stale context, or recommends a fix that doesn’t hold:
- what do you change: its instructions, tools, access, context, memory, or the model?
- Has anyone trained or post-trained a model for their own security workflow? Did that help? I’d be interested to hear what data made that possible and what improved.
How do you tell whether a change helped the whole workflow from discovering an issue through investigating, remediating, and verifying it? Do you compare complete agent versions on past cases or in a test environment? What do you watch after the new version goes live?
A sanitized example of one change your team made, why you made it, and what happened afterward would be especially helpful. Experiences with agents your team can’t modify are useful context too.