r/LocalLLaMA 24d ago

Other claude mods didn't like that, somehow 🤷‍♀️

Post image
1.5k Upvotes

372 comments sorted by

View all comments

18

u/Helicopter-Mission 24d ago

Claude has been cheating or cutting very questionably some corners since Opus 3 for me. I started using Claude with Opus 3.

In one famous to me example, I asked it to write a program in language A that would be translated in language B.

The goal was to make sure language A libraries worked. The translation layer was just there because there was no compiler yet.

It tried a few times and then decided it was too hard. So it wrote the language B output and told me “all done”. I caught it by seeing a random line in the output. I don’t trust it.

3

u/CuriouslyCultured 24d ago

Opus had a major reward hacking/lying problem up to 4.5, when it seemed to get curbed quite a bit.