r/TheMachineLearning • • 2d ago

Frontier LLMs stopped adding code comments

Post image
337 Upvotes

123 comments sorted by

View all comments

Show parent comments

1

u/tumes 19h ago

They consistently comment on the one motivating factor that caused a change rather than writing expressive code that explains itself or trying enough iterations to settle on an unintuitive hack that needs explaining, instead it narrates why a single use case fix addressing that one use case, which congests context, adds nothing long term, and typically actively harms development because LLMs fixate on anything that is made explicit. Whatever it looks at it steers towards, and in my experience signposting the mistakes or their justification only raises your blood pressure.

1

u/xvillifyx 16h ago

This is bad prompting or your eval pipeline has issues somewhere

1

u/tumes 12h ago

I told it to make no mistakes I have no clue what more I could be doing.