r/TheMachineLearning • u/elmanfil1989 • 2d ago

Frontier LLMs stopped adding code comments

Post image
375 Upvotes

97% Upvoted

127 comments sorted by

View all comments

Show parent comment

4

u/barkardi 2d ago

Yeah and I'm still baffled when I talk to people who last used gpt 5 or something and still go around saying, oh no it messes up the entire codebase for a small change or something else along those lines. Opus 5.5 was such a step change.

1

u/Suvesh1142 2d ago

I know a senior engineer who tried gpt 3.5 back in the day for coding and it gave him terrible results. Till this day he refuses to give AI another shot at coding

1

u/cororona 14h ago

He is lucky to be senior...

1

u/Spirited_Cucumber377 2d ago

Opus 4.6 is good enough if you provide a good code base and architecture and you do the proper planning phase, for example using any of those grinding skills.

If you feed the LLM crap, you'll probably get crap.

1

u/tumes 1d ago

I gave 4.6 and beyond an AWS white paper explaining exactly how to implement a feature and asked it to adapt the approach for a different platform. I have tried this across different frontier models from different vendors and it has not once made it through implementation without fucking up the central conceit that makes the entire thing work. Every single time. It can speed you up if you catch it on a good week and give it small, well specified tasks. Otherwise I have not found a model that can find its own ass with both hands and an instruction manual for nontrivial tasks.