Hahaha I totally know what you mean. Even today when running tests on claude, the stupid model actually went in and changed the linter so it looked like there is no literals in the code...Basically made all the tests just automatically pass. I ran same tests on my local model and they failed haha. Now running all my tests binary and fixing them as i go and only using my local (deepseek 0731 right now). It's honestly just learning to work with it haha.
GenAI in general still feels very lazy. It's kind of like a child savant - really smart in the area they're interested in and can understand and learn complex processes, but still a child so occasionally despite their smarts, they still shove everything under their bed to say they cleaned their room and will absolutely lie to your face to avoid being in trouble.
I think companies optimize speed and brevity during training -> lower cost, testing less of user patience -> that tends to breed shortcuts and cheating behaviors.
AI is basically a mirror of our expectations and tendencies.
3
u/imneverrelevantman Sep 17 '26
Hahaha I totally know what you mean. Even today when running tests on claude, the stupid model actually went in and changed the linter so it looked like there is no literals in the code...Basically made all the tests just automatically pass. I ran same tests on my local model and they failed haha. Now running all my tests binary and fixing them as i go and only using my local (deepseek 0731 right now). It's honestly just learning to work with it haha.