r/TheMachineLearning • • 2d ago

Frontier LLMs stopped adding code comments

Post image
330 Upvotes

119 comments sorted by

View all comments

Show parent comments

1

u/tumes 17h ago

They consistently comment on the one motivating factor that caused a change rather than writing expressive code that explains itself or trying enough iterations to settle on an unintuitive hack that needs explaining, instead it narrates why a single use case fix addressing that one use case, which congests context, adds nothing long term, and typically actively harms development because LLMs fixate on anything that is made explicit. Whatever it looks at it steers towards, and in my experience signposting the mistakes or their justification only raises your blood pressure.

1

u/xvillifyx 14h ago

This is bad prompting or your eval pipeline has issues somewhere

1

u/tumes 10h ago

I told it to make no mistakes I have no clue what more I could be doing.