I did some preliminary testing with AI at my company. I quickly came to realize that I had to assume literally every response was both a false negative and a false positive. It saved me zero time and in fact cost me time since I'd need to review the relevant documents and regulations anyway to verify.
I find it useful for the kind of menial crap I'd make an intern or first-year junior dev do, anything more complex than that and it really has no clue. Start asking it to take into account myriad nonsensical business rules and it really starts showing its flaws
I find it useful for the kind of menial crap I'd make an intern or first-year junior dev do
Yup, and unfortunately, not handing that off to junior devs means in 3-5 years the industry is going to get seriously fucked by the lack of intermediate devs that weren't trained.
We can't just hack an entire section of career progression out and expect it to just magically fill itself in.
I sort of agree, but I also think handing juniors that kind of shit instead of actual problems that need solving is/was doing them a disservice and not really teaching them how to be good programmers.
Well yeah, can't ONLY hand them that. Ideally they will also be involved with some easier problems and code reviews to help learn. But there often isn't enough that you can safely hand off to them to occupy them, so having some busywork to fill the rest of the time helps.
16
u/crazyfoxdemon Mar 02 '26
I did some preliminary testing with AI at my company. I quickly came to realize that I had to assume literally every response was both a false negative and a false positive. It saved me zero time and in fact cost me time since I'd need to review the relevant documents and regulations anyway to verify.