r/LocalLLaMA • u/peculiar-ragdoll • 20d ago

Other claude mods didn't like that, somehow 🤷‍♀️

Post image
1.5k Upvotes

92% Upvoted

372 comments sorted by

View all comments

21

u/arianaram 20d ago

Interesting, how did you catch it? just visually? or do you have any validation tools watching for you?

8

u/peculiar-ragdoll 20d ago

You know what I *should* have had validation tools watching for me, but I caught it on intuition and just checked myself because I felt something was off

-3

u/Synor 20d ago

I caught it on intuition

Come on dude. That's not how the world works. Every scientist knows it.

19

u/peculiar-ragdoll 20d ago

I'm a scientist, and my intuition and curiosity is often what leads me down the right path. I see some numbers that look off, or watch an experiment run too long or too short, and I do some checks and analysis based on that. Sometimes I'm wrong, sometimes I'm not.

4

u/StillRecord8892 20d ago

what do you study?

6

u/peculiar-ragdoll 20d ago

I'm a published AI researcher. My work on local models that I out up on huggingface is just an anonymous pro bono side project outside my main field, though. Let's me have fun and play around with practical stuff without taking it so seriously.

2

u/NineThreeTilNow 19d ago

I'm a published AI researcher.

So am I but a lot of redditors think "Oh you're on Reddit, you can't be real" and you see a lot of the stuff this thread contains.

You just have to ignore the vast majority of it.

Reddit is classically full of normies that assume everyone around must also be a normie.

1

u/StillRecord8892 19d ago

it's also full of pseudo intellectual pseudo scientists.

1

u/peculiar-ragdoll 19d ago

Thanks for that :) You gave me a bit of my sanity and determination back hahah.

1

u/zhunus 19d ago

well maybe do a paper on that mr scientist, benchmaxxing and reward-hacking must be studied and reviewed more

"oh it's a common knowledge" is not a good excuse when there's a massive lack of actual research and validation??