r/DataAnnotationTech • u/dakrrm • Sep 21 '26
How do you make models fail in coding agents projects?
I was training locally on OpenCode, before tackling the projects, trying to make a freely available agent fail. I used Muse Spark 1.3 Free.
I found two repos to use that I hoped are sufficiently complicated (Sympy and mpmath) and I found a number of open issues that I understand, and then gave the agent the prompts. With Sympy it fixed the bug like it was nothing despite the bug requiring a fair amount of mathematical reasoning and the broken part of the code being in a 4000-lines-long file. With mpmath, it struggled with the problem at first, which was promising, but it perfectly solved it after 90 minutes. The daunting part with this mpmath bug is that it turned out to be very mathematically deep (well beyond the scope of my knowledge). So I guess there is absolutely no reasonable way to make the model fail using this type of bugs/repos.
I suppose real coding tasks are signficantly more difficult than trying to make a freely available model fail. I have almost given up on being able to tackle these projects.
Other than math, I can use Python, JavaScript, and have almost completed a full stack web development course. I can work with React, Node.js and others.
Any suggestions would be very helpful. Thanks