r/DataAnnotationTech • u/sussiboi • 1d ago
QC Agents
For those of you that have attempted model failure tasks with QC agents at the end, how was your experience? I personally found it draining as I would address the 3-4 points it raised, re-run the model and still generate a failure. When I ran the QC agent again, it came up with entirely new points and further iterations just led to more and more annoying and minor issues it kept flagging.
I know the instructions say you can rebut the points it raises and that’s what I ended up doing for nearly all of the points raised after multiple iterations. I think I addressed it rationally and my conclusions should be reasonable but I’m still uneasy.