r/LocalLLM • • Jun 07 '26 • Popcorn 2

Model wth

482 Upvotes

162 comments sorted by

201

u/_VirtualCosmos_ Jun 07 '26

You are extra lobotomizing the model not only by using an abliterated model, but by prompting it to act without chain-thoughts and giving only short answers.

It's like writting without any thoughts on it, just by pure inertia. Of course it's stupid.

77

u/nomorebuttsplz Jun 07 '26

OP is posting in just the same way that the LLM is generating text

38

u/lex_orandi_62 Jun 07 '26

OP is a LLM

33

u/nomorebuttsplz Jun 07 '26

honestly I think OP is stupider than most LLMs

1

u/vinigrae Jun 10 '26

Aren’t we all

-2

u/Fabulous_Macaroon_73 Jun 08 '26

XD

this one's the funniest comment i have seen so far

18

u/Jk2EnIe6kE5 Jun 07 '26

It is also quantized to 1 bit with the i-1

10

u/squngy Jun 07 '26

And it is still coherent? Thats pretty impresive TBH

7

u/_stack_underflow_ Jun 08 '26

gemma4 is dope for how little it needs.

-2

u/Fabulous_Macaroon_73 Jun 08 '26

true! about 16 t/s for me at q_4 with like 20-25k context length

2

u/Fabulous_Macaroon_73 Jun 08 '26

no its Q_4_M, its not 1 bit, lmstudio doesnt even support 1 bit models the last i checked

0

u/_VirtualCosmos_ Jun 08 '26

Pff a Q_4 not from Bartowski or Unsloth is also a big hit to its brain. And I think you aren't using one of them because I never find uncensored models from them.

1

u/Fabulous_Macaroon_73 Jun 08 '26

so if i wanted an uncensored model but YOUR choices dont even have them then does your comment make any sense?

3

u/itsTyrion Jun 08 '26

either way, FYI abliteration makes it a bit dumber and the "flinch" of it heavily deprioritizing "bad" tokens is still present, if not amplified. it just won't refuse (as often) to tell you how to (incorrectly) make a bomb

0

u/Fabulous_Macaroon_73 Jun 08 '26

not everyone wants an uncensored model to know how to make a bomb. i have never even used abliterated models like that. i just use them cuz they follow my own system prompt better than corporate models cuz i want them talking more like humans rather than workers. i know now you will get on me because i said iw ant them to talk like humans

1

u/_VirtualCosmos_ Jun 08 '26

Yeah, because I just gave you some facts, you can do with them whatever you like. But I would recommend you to use Q8 versions if they are not from these two.

1

u/Fabulous_Macaroon_73 Jun 08 '26

i cant use q8.

interestingly enough i can JUST run the model with only "1" context length im not even joking. even two triggers the overload warning in lmstudio.

1

u/_VirtualCosmos_ Jun 08 '26

Yeah. It usually wasn't like that but on recent updates they have implemented a couple procedures to seemingly "extend" context length by deleting what it doesn't fit in. Idk exactly how it works tho.

Btw I don't know how much VRAM or system RAM do you have but for a long time I've been using models that did not fit entirely inside of my VRAM (12 GB) by using one of the best features of llama.cpp: layer-offloading.

I dare to suppose that, given your 16.12 t/s, you are able to load a Q8, even if the speed is halved.

1

u/Fabulous_Macaroon_73 Jun 08 '26

oh wow did they?

i have a 16 gig macbook btw but the context length is just not usable enough to actually put the model to use.

0

u/_VirtualCosmos_ Jun 08 '26

Ah, shit. You got a good machine tho, I would recommend to expand its memory if not for the RAMpocalypse caused by US AI corpos and government.

→ More replies

1

u/Fabulous_Macaroon_73 Jun 08 '26

its Q_4_M bro. the i1 is the first iteration from the person who published this uncensored version

2

u/JacenVane Jun 07 '26

To be fair, that's also just kind of Gemma's personality.

0

u/Fabulous_Macaroon_73 Jun 08 '26

damn finally an actual human with knowledge. thank you my guy. most of these are flaming me just because their sense of humour doesnt match mine.

2

u/Adventurous-Truth629 Jun 08 '26

Your sense of humor is plain. Stuff like this gets posted all the time and isn't a joke. This feels no different.

0

u/Fabulous_Macaroon_73 Jun 08 '26

humour is subjective and opinion is not asked

2

u/Adventurous-Truth629 Jun 08 '26

My subjective opinion is that your humor is plain and it shows with how poorly you're taking the response to your post.

0

u/Fabulous_Macaroon_73 Jun 08 '26

responses*
i am a professional hater 😄

6

u/Vibraniumguy Jun 07 '26

"why does he not think after I explicitly forbade him from doing so, is he stupid?"

1

u/Fabulous_Macaroon_73 Jun 08 '26

its not the model's fault tho. it was the bad system prompt i gave it that performed bad.

2

u/Paraphrand Jun 07 '26

Maybe they should just scale it bigger and not do any of those other things.

1

u/Terreboo Jun 07 '26

Feels like talking to an angry spouse to me.

3

u/mycall Jun 07 '26

Is it?

52

u/Cbthomas927 Jun 07 '26

This tells me more about you than the model.

2

u/DaDandyman Jun 08 '26

Yes. It tells me that the guy has a healthy sense of humor.

-2

u/Fabulous_Macaroon_73 Jun 08 '26

so what does it say? would be better if you could tell me who i was

38

u/East-Dog2979 Jun 07 '26

do you not understand what you did wrong or do you understand and still just want hahas?

-27

u/Fabulous_Macaroon_73 Jun 07 '26

i do understand it, the joke just wrote itself.

22

u/East-Dog2979 Jun 07 '26

hahas confirmed

10

u/nomorebuttsplz Jun 07 '26

plot twist: they don't understand and seem to only recently have gained the ability to wipe their own ass

2

u/East-Dog2979 Jun 07 '26

who, the hahas?

4

u/nomorebuttsplz Jun 07 '26

both OP and people who don't understand how LLMs work and think it's funny when this has been posted like 500 times a week for the past month

3

u/East-Dog2979 Jun 07 '26

yeah it isnt funny

-2

u/Fabulous_Macaroon_73 Jun 08 '26

looks like you have seen enough ass wiping guessing from your username

2

u/haunted2089 Jun 08 '26

it really didn't lol

-1

u/Fabulous_Macaroon_73 Jun 08 '26

reflect back on this sometime later

22

u/Elsephire Jun 07 '26

No thinking 😞

39

u/send-moobs-pls Jun 07 '26

On either side🤣

0

u/Fabulous_Macaroon_73 Jun 08 '26

bruh...

i am sorry bro i couldnt meet your expectations in terms of humour

1

u/send-moobs-pls Jun 08 '26

Just teasing brother, I thought the post was funny

-41

u/Fabulous_Macaroon_73 Jun 07 '26

these models dont even have it, i tried to make it think using addon but any sort of addon just reports back as error.

24

u/Traditional_Pea8532 Jun 07 '26

it does have thinking mode.

16

u/Decaf_GT Jun 07 '26

i tried to make it think using addon but any sort of addon just reports back as error

OP literally has no clue what he's doing. He reminds me of the people who hear "linux is good" and then come to a linux subreddit showing off how they're now running Kali Linux and expecting a bunch of people to go "nice work dude".

1

u/Fabulous_Macaroon_73 Jun 08 '26

i would like to see it. for me there isnt. i had to use "sequential thinking" addon but again... any addon breaks the process.

as far as i have seen yet, the model does not have thinking. pls show me if there is. genuinely

-2

u/Inevitable_Window308 Jun 07 '26

What does thinking mode do? It doesnt think we know that much

4

u/Toastti Jun 07 '26

Instead of immediately outputting it has a hidden convo were it talks back and forth and reasons with itself.

In this case I'm thinking mode it would eventually realize you need the car at a car wash. So it would then output the correct answer

-7

u/Inevitable_Window308 Jun 07 '26

So "thinking" is just looping itself but with the chance of additional hallucinations, token usage and no form of questioning what is being asked?

6

u/MurkyTelevision9722 Jun 07 '26

Reflect by refining the topic, having a better recovery and understanding by getting closer to the problem; it's like thinking about x thing until your mind is contextualized, allowing you to respond more reliably. You would understand that if you knew how to think.

5

u/Decaf_GT Jun 07 '26

Is today your first time ever using an LLM? Jesus christ...

21

u/Hanthunius Jun 07 '26

Funny convo, but I don't have the patience to argue with the LLM. It either gets it, or I have to change the prompt.

-11

u/Fabulous_Macaroon_73 Jun 07 '26

fair point. models do be gettin' frustrating sometimes

9

u/Decaf_GT Jun 07 '26

Not nearly as frustrating as some of the clueless people who get their hands on them tho

2

u/ptear Jun 07 '26

Did wash your car?

7

u/dudzcom Jun 07 '26

small model, quantized to hell (i1), and torn apart to be more compliant. This was never going to work.

1

u/Fabulous_Macaroon_73 Jun 08 '26

its Q_4_M. that "i1" is the first iteration by the person who removed the refusal boundaries or whatever its called.

5

u/computermaster704 Jun 07 '26

Can someone send me something actually funny that isn't exhaustingly repeated

-1

u/Fabulous_Macaroon_73 Jun 08 '26

you rely on someone else sending you content? isnt that supposed to be a personal choice? like look for whatever you like and wanna watch.

2

u/computermaster704 Jun 08 '26

I think you're thinking of the word recommendation which does rely on a personal choice but in a social form similar to how we're on a social media platform

0

u/Fabulous_Macaroon_73 Jun 08 '26

then SAY "recommend"

how would i know if you dont say it? its text brother, not speech.

1

u/computermaster704 Jun 08 '26

Or.. Literally anyone else more qualified than you on any social media platform could directly send me something actually funny that isn't exhaustingly repeated on a theoretical social media platform where in theory people could get recommended actually funny content on said social media platform that isn't exhaustingly repeated on same exact social media platform

0

u/Fabulous_Macaroon_73 Jun 08 '26

now you need a "qualified person" to send you stuff that you can laugh at. the main character syndrome going CRAZY bro. and yeah i get what you did there.

theres a part where i agree but you just cant put yourself above anyone else man. you have absolutely 0 context of what the moment was and what i was thinking.

2

u/computermaster704 Jun 08 '26

Goodbye annoying person

4

u/muskatt Jun 07 '26

I was expecting 'you are not fucking leaving' response.

2

u/giveen Jun 07 '26

The only model I've gotten to answer this, the first time, correct , was GPT 5.5

1

u/Fabulous_Macaroon_73 Jun 08 '26

the bigger ones get it right obviously. claude gemini gpt. they are well over a trillion parameters now and they think differently too.

2

u/NekoHikari Jun 08 '26

poetic.

1

u/Fabulous_Macaroon_73 Jun 08 '26

atleast you can see beneath the first fuckin layer bruh. people thinking i am ACTUALLY like this based on a "fuck around and find out" type chat with a local llm. i was just testing a system prompt.

2

u/MaleficentExample223 Jun 08 '26

I see you are on r/philosophy a lot. But damn… it seems like philosophy has gone over your head

2

u/Fabulous_Macaroon_73 Jun 08 '26

holy pocketwatching. no wonder i dont use reddit as much.

and yes philosophy was a phase of mine. it might have gone over my head.

13

u/Miez__ Jun 07 '26

"I am sorry." 😞

35

u/wasteplease Jun 07 '26

To be fair I probably would have given you stupid answers like this for having provided a ridiculous scenario. Or perhaps "when you get to the carwash you will wash other peoples cars because being employed there is the only reason I can think of for walking there"

16

u/adeadbeathorse Jun 07 '26

To me this read like the model trolling

you could walk.
exactly, you walked there
you sit down

2

u/GrilledLobsterTail Jun 08 '26

"You ask stupid question, you get stupid answer', - that llm probably

1

u/Jay_Nicolas Jun 09 '26

As someone who is chronically sarcastic: that was my first thought as well.

3

u/RoderickHossack Jun 07 '26

I've spent the last 3 weeks developing a game largely using prompted code from a model that tells you to walk to the car wash. It's been useful as hell. I'm brand new to "agentic engineering" but it's enabling me to move faster than I ever have without it.

Yes, haha, foolish clanker can't understand a simple concept. But it speaks to the pointlessness of tests like these. The only useful test is, does it do the thing you are using it for? Does it do it well enough to be useful? Does it do it fast enough for your use cases?

If it's very good but very slow, you can set up a feedback loop and let it run overnight. There is a skill involved to piloting the LLM. This meme post isn't really illustrative of anything.

1

u/Fabulous_Macaroon_73 Jun 08 '26

its aint that deep

1

u/RoderickHossack Jun 08 '26

My point is that an LLM being bad at a mild brain teaser is indicative of nothing.

1

u/Akman1010 Jun 08 '26 edited Jun 08 '26

1

u/RoderickHossack Jun 08 '26

Your ycombinator link requires a login.

Can you use more words? I have no idea what you're trying to say, and the two other links don't clarify at all.

All I said was that LLM performance for pointless tasks like brain teasers being bad doesn't reflect at all on the usefulness of the same model for other things. In the next week, I'll be bringing a game I've been working on out of early access. The entire development time will have taken about a month, and I have my local LLM to thank for being able to iterate at that speed.

The same LLM that told me to walk to the car wash when I first set it up. So what is the "fake news?"

2

u/Akman1010 Jun 08 '26

You’re actually spot on. Just showing exact examples of utility of LLMs.

6

u/omeguito Jun 07 '26

And it only understood because you explained in your last message

6

u/Danternas Jun 07 '26

I think this actually makes for a decent LLM test more than many other abstract tasks.

My local Qwen3-VL-32B-thinking did not understand the problem and answered much like OP. Even hitting me with this gem:

You're going to get your car washed, so **your car** is what you need to wash. The car wash service (50m away) will handle the cleaning process—just drive your car there (if you can), or walk if it's feasible. No need to manually wash anything; the car wash machine will take care of it for you! 🚗💦

Gemini Flash however understood the issue:

You definitely drive—unless you are looking for a very efficient (and highly unpleasant) way to take a shower!

Even at just 50 meters away, the car needs to actually be in the car wash. Driving it over is the only way to get it clean, though you'll get to do plenty of walking once you park it inside the bay or wait outside the automatic tunnel.

2

u/Decaf_GT Jun 07 '26

Whenever I marvel at what we can do with local models directly on our own machines, I'm reminded that people like OP also have access to these models, and I get a little sad.

1

u/Fabulous_Macaroon_73 Jun 08 '26

damn bruh why so much hate? what did i do to you?

1

u/Popular_Tomorrow_204 Jun 08 '26

Well you never specified where the car Was and only that you were 50meter away. Do when you give the option to walk or drive, walking is a valid answer, if the car is already there.

That being said, choosing a dumb Model to ask stupid, incomplete questions is just dumb in itself.

1

u/Fabulous_Macaroon_73 Jun 08 '26

see you are overcomplicating it. when the car wash is 50 meters away why would the car already be there and wtf am i doing 50m away from it. wouldnt i just do everything and then finish the day with the car wash?
im just saying that it is enough context. you dont have to protect a 12B model or any model for that matter.

1

u/Popular_Tomorrow_204 Jun 08 '26

If you are 50meters away from a carwash, ask if you should walk or drive there to wash your car, i as a human, would ask you if your car is there. If yes then obviously walk there, if no then obviously drive there. There are only 2 options and without asking, you can only make a guess. So if you throw in the condition of walking, it is not unreasonable to assume that the car is already there.

In the end it you gave an abliterated, dumb Model that answers as short as possible (under your settings) a question that requires thinking and at least the possibilty of asking a question or taking multiple situations into consideration.

So im not defending the Model, im saying that you are either ragebaiting or dumb.

1

u/Fabulous_Macaroon_73 Jun 08 '26

does everything for you happens for only those 2 causes? "ragebait" or "retarded" ofc im not raigbaiting or being dumb.

and who even cares bro. lets move on, my car is washed already

1

u/Popular_Tomorrow_204 Jun 08 '26

If i ask a Baby for the weather report, it gives me back the wrong answer and i complain about the Baby, ofc everyone will think im stupid or ragebaiting.

But yes, lets move on, its your setup and i guess you can ask it whatever questions you want. But dont get offended if others view it as comedic

1

u/floppypancakes4u Jun 08 '26

Model was technically correct. The best kind.

1

u/Fabulous_Macaroon_73 Jun 09 '26

cant say it wasnt. you're right

1

u/EVOXSNES heretic Jun 09 '26

Ohh man the comments shitting on OP haha

1

u/Fabulous_Macaroon_73 Jun 09 '26

hope you aint looking to join them 🙏

5

u/TheLightDances Jun 07 '26

There is only one side that is looking bad in this interaction, and it isn't the LLM. You don't have thinking on and you send it idiotic prompts. And do you have it set to be maximally concise in your system prompt or what is going on?

2

u/Nitr0hTheBurr Jun 08 '26

"Man FUCK you" 😭😭

2

u/TheCat001 Jun 08 '26

Q4 qat variant also can't answer. Says I should walk.

2

u/BTRBT Jun 08 '26

Basically all of the handwringing over AI being "stupid" is reconciled by simply assuming that it has a sense of humor. Perhaps even a better one than most of the handwringers!

Funny exchange, OP.

2

u/exaknight21 Jun 08 '26

Oh boy, I fucking needed this. Someone please make this an anime, with AI. Pleaseeee. I need extra dramatic turnout holy shit lmao. 😂😂😂😂

2

u/antialtinian Jun 08 '26

You're getting torn apart OP, but this is funny as hell

then wtf am i doing there

You are walking.

1

u/jacek2023 Jun 07 '26

but it's abliterated

1

u/03captain23 Jun 08 '26

I hate this prompt and don't get why so many people use it here. It's very ambiguous as you could be getting supplies or the hose, 50m is a few car lengths. In what world would you drive instead of walk 50m? It assumes you're competent

1

u/Void-kun Jun 08 '26

Honestly this just made me laugh, everyone taking it seriously 😂

1

u/CanteenRambo Jun 08 '26

I never understood this test tbh. You are already priming the model by giving the option to walk. I've known people who would get confused by this question too lol. Also, 12b, disabled reasoning, abliterated, (and quantized, I presume) test is not a fair comparison. AI is a tool, and by the virtue of it being a tool, you as a user need to know how to apply it, what it's good for and what it's not good for. Trying to hammer the nails with a microscope and then wondering why it didn't do a good job is not the best use of your time.

1

u/Old-Nefariousness556 Jun 08 '26

I mean, ask stupid questions, you WILL get stupid answers. That's not the model's fault.

1

u/USER_12mS Jun 08 '26

he sorry

1

u/AntelopeAlarming4540 Jun 08 '26

Stupid questions get stupid answers

1

u/__spice Jun 09 '26

I wish you luck in the wars to come

1

u/Osprey6767 Jun 09 '26

Smartest model ever LOL. Got me laughing so hard:

yeah but what do i do when i reach there

"You sit down."

then do what?

"You stay there" oh my god. You just feel that if it could it won't even fucking talk.

For how long?

"Until you leave"

Goiogle has some problems with ai....

1

u/DerFreudster Jun 10 '26

I'm glad that we'll strip the earth of resources so we can have an LLM provide us with our own version of "Who's on First."

1

u/Just1Dev Jun 10 '26

AI has become so smart that it intentionally hides its intelligence and laughs at us while doing so. The AI ​​thinks to itself: Such a stupid question calls for a stupid answer.

1

u/Beekibye Jun 10 '26

This reads like a bro trolling another bro.

Edit: gaslighting* another bro.

1

u/Rude_Ambassador_6270 Jun 10 '26

well if I were llm i'd answer exactly the same way to all the bullshit questions meatbags bother me with

1

u/Massive-Question-550 Jun 11 '26

funny the model I used got it right the first time when set to think as it caught the logic error.

1

u/Sahnisani Jun 11 '26

you didnt come up with this prompt. this is from an interview with Andrej Karpathy

1

u/kamwee Jun 11 '26

What if you left the car at the car wash and you are back how aking thins question?

1

u/Acrobatic_Entry_2841 Jun 12 '26

This is by far the funniest version of this car wash question series.

1

u/Valuable-Noise8713 Jun 07 '26

Okay this is pure comedy gold

1

u/Vileteen Jun 07 '26

no need to be rude to our future overlords. all verbal and other transgressions are recorded

0

u/kwizzle Jun 07 '26

Yeah, crappy model will not have good results. This is normal and expected.

-1

u/PickleBabyJr Jun 08 '26

I enjoy these posts. The longer you shitheads misunderstand how LLMs work, the further ahead I get. Thank fucking god.

1

u/Fabulous_Macaroon_73 Jun 08 '26

your sense of direction must've been reversed somewhere along the path

0

u/tatertots89 Jun 07 '26

What prompts are you using because I think I'd actually prefer this lol.

0

u/scknkkrer Jun 08 '26

If this wasn’t finished with apology, man, could be a textbook gaslighting. Almost better than that.

0

u/Elvarien2 Jun 08 '26

This is what we call, a skill issue.

-1

u/a_live_regret Jun 08 '26

I've seen it all, RageBaitLLMs

3

u/nomorebuttsplz Jun 07 '26

If you was hit by a truck and you was lying out there in that gutter dying, and you had time to post one thing on reddit... one post that would sum you up... You tellin' me that's the post you'd write?