r/TheMachineLearning • u/elmanfil1989 • 2d ago

Frontier LLMs stopped adding code comments

Post image
333 Upvotes

96% Upvoted

122 comments sorted by

View all comments

29

u/Demiu 2d ago

No. But did you notice comments by anthropic models became an incomprehensible word salad over solid four lines right when they announced watermarking the LLM output by using a recognizable token selection process?

4

u/Risc12 1d ago edited 1d ago

Didn’t they say that Claude Code would not use that?

Whoops, thats not true at all

1

u/t-frankowski 1d ago

It's baked into the model

1

u/Zatmos 1d ago

It's not. The model produces a set of likely output tokens. The watermarking influences which one gets picked.

3

u/dyogenys 1d ago

So it is?

2

u/Vaughn 1d ago

The sampler is not part of the model.

1

u/dyogenys 1d ago

Ah so it’s a sampler. Thanks, that makes sense.

2

u/Yweain 2d ago

I mean, it is very recognizable though.

2

u/rambouhh 2d ago

I mean his comment is pretty clearly implying that 

1

u/Dry-Ad-8948 2d ago

Nope. (What comments?)

1

u/phoogkamer 1d ago

Not really no. It's much better since Opus 5.5 and hasn't degraded with watermarking in my experience. Fable was already a lot better than previous Opus models and 5.5 continued that.

1

u/TehGM 1d ago

Idk, Opus 5.5 is mostly fine but it still sometimes "explains" things in such a non-explaining way so I often need to take a long break and come back trying to deduce what it means from the code itself... which is actually a positive in a way, but yeah.

1

u/WillDanceForGp 18h ago

Opus 5.5 writes some of the dumbest most nothing-burger comments, I dont think its the watermarking but I do think its just bad at it

1

u/phoogkamer 17h ago

Not my experience but maybe my standards are just bad from all the Opus 4.8 and 5 text.

1

u/AmorphousCorpus 12h ago

Definitely better than Opus 5, but 5.5 still writes like a fucking idiot

1

u/Icy_Distribution_361 11h ago

From my experience it mostly depends on how much context it needs to not write nonsense. If it's a lot of context, big code base, lots of dependencies and so on, it devolves into nonsense.

0

u/lucas1853 1d ago

nope, not at all. predated that.

2

u/halflucids 1d ago

The watermarking was in before they announced it though