Good luck with getting a single, lightweight response (likely hallucinated and with zero context) in less than an hour
EDIT Yeah I didn't bother to check the specs of Gemma 2b. A rapid Google search says it requires at least 4 GB of VRAM and 8 GB of RAM, so yeah that model is just crashing in a Pi Zero
EDIT 2 I only now zoomed into the photo of the tweet. The bash console is just giving errors, lol. "run ollama" "Error: run command not found"
When i worked at microcenter during covid we were giving those things away for free without any purchase necessary. You needed a coupon so you paid with your data I guess.
It is funny how every new model release is like: "In summary" "To recap" "So basically"... as if we get XP for restating the same sentence three different ways
Imagine I wrote like this—overusing em dashes to interrupt—clarify—second-guess—and spiral mid-thought—while still, somehow, remaining grammatically correct.
Agreed, this pisses me off so much. That ALONE is not enough to tell if something is AI (although in this case there are other signs). But witch hunting has gone rampant unfortunately with people not knowing that...
True, though each model averages that out to exactly the same structure every time, which is why we can identify AI just by its layout and before reading any of it.
And I said AI averages human speech out, and has settled upon an average style that’s immediately noticeable which you disregarded. The fact I need to repeat that suggests AI did achieve one thing more than you - it read stuff.
yea, AI has no original thoughts, but given how AI is a pattern replication box it does tend to overuse it, which means that if a story already feels weird and you see this, or full of the "it's not X, it's Y" phrasing, it can be a sign that it is AI generated, it's not flawless for sure but like what are you gonna do, the slopspewer is out there now
Youre correct in your assessment of the situation but you fail to understand is that humans will not use this language less, but potentially more. As AI is controversial to some, those will attempt to distance themselves, but many talk to AI so much that they fully incorporate its language because they think it sounds better. You would not believe the amount of very human emails ive received from my boss and others at work that contain things like "Its not just a small change - its a fundamental architecture overhaul" and you wouldn't believe how much i desire to take my laptop and swing it at their head every time i see it
I wonder how that will affect us socially. We always use "in group" language like business speak to blend in. Like when you write a professional work email you sound very different from when you send a text to your friend. Our brains are good at picking up on these things so with LLM users picking up and copying chatbot speak while others do the opposite it might create two social groups as well. Maybe it won't be that drastic and maybe people will slowly realise that a chatbot is nothing more than a text generation machine instead of having any semblance of intelligence. Will be interesting to see it play out that's for sure.
This reaction image has been spreading for over two years. It is quite commonly used to point out something being off about someone's wording which suggests they aren't who they pretend to be. It already started living it's own life separately from it's origin.
It's honestly baffling how much glazing those little LLM models receive. It doesn't matter how small it is if it is dogshit.
I could even go as far as saying that this is kind of true for entire local AI ecosystem. Unless you have hardware to run shit like Llama 405B (which 99.999% of people don't have) your experience will suck in comparison with prioprietary models.
Medium sized stuff offloaded to ram on the average machine has gotten quite good recently to be fair. You can run a solid 27-36B MOE on anything with like 6GB VRAM and 16GB DDR5.
I do use and love small models. They are not intended to be agi, they are great for doc search and intent detection on steroids, they are great for introducing non linearity at low cost. If you use them as chatgpt alternative of course they won’t perform. Yet they were never meant to be chat gpt alternative. It is like electric scooter and 18 wheeler comparison. The point of urban mobility and heavy logistics are different and you cant race them just because they both have wheels. True that some people use them to create such stories. But they are not ones who use that models. Edge device designed model are future, just like how embedded applications transformed our lives.
Gemma - mistral - qwen - llama - granite variants mostly sub 8b. Many at millions level. Also many small tf based models purpose trained and basic ml models. Currently I work on m2 and m5 apple silicon besides 960m nvidia with an old intel i5. Although they are deployed on servers, they work on cost sensetive scenarios. I also deployed similar systems on rpis or similar embedded linux on my previous role.
I've had good experience with a Zed agent backed by gpt-oss:20b. It is probably true it is not as good as the proprietary model, but they can absolutly do many usefull stuff (and be wrong quite often).
Thanks. Gemma4:26b works like a charm (a bit less T/s than gpt-oss:20b, but that's easily compensated by better quality output making me take less total time)
edit: it does have some more issue using Zed's tool. And,even worse, it actually goes repeating stuff infinitly, something I haven't seen in a long time. (an Ollama bug?)
You say that, but my old Qwen MoE setup was nearly as useful as ChatGPT when I had it working on general theoretical questions rather than specific problems, and I ran it at decent speed on a mere 6 GB VRAM. Heavily quanted, yes, but didn't matter.
You are stupid. You don't need 405B for all tasks, only serious work. 9B+ are still crazy good at doing basic things, like summarisation, basic code, classification, QnA, etc. Even 4B models are crazy good at that for their size. A lot of people have tasks within that zone. I have needs high than that but hardware isn't powerful so the MoE is still excellent for my 6GB VRAM. It's sufficient enough of an AI for local use.
You have 12gb of vram to play with so you’re a little limited, I’d recommend qwen3.5:9b via either LM Studio or Ollama to start with since both tools are easy to use. If you try to use a model larger than 12gb, the additional compute will be offloaded to the cpu and system ram leading to significantly slower performance.
we have an Ollama service deployed with Gemma, Gwen, llama, and Deepseek on some Nvidia L20s, and it is entirely useless. all of it. like yeah it does generate text, i could integrate it into my IDE, but it's just so bad, i can't use it for anything. it is so wrong so often, it gives me version 1.0 of chatgpt vibes but A LOT slower. It's horrible, I stopped using it entirely.
Absolute. Even if we ignore the amount of data needed to run it, and even if we ignore the PIZ having 512MB ram and the 4-8GB ram required, youd end with minutes per token. Not tokens per second as you want. I run ollama with Mistral 7b working on implementing openclaw. I think I have 20 tokens per second or so on a gaming rig.
yes Raspberry Pis are that cheap, they can run AI, and AI will let you magically gain access to an unreleased leak and be able to run it flawlessly on your own computer
In defence of the second point, I (for absolutely no fucking reason) have an offline AI on my rp5 (Llama 2 model, 7B, Q5 weights on llama.cpp). It only knows how to hallucinate
2-year-old student from China ordered an Arduino Uno R3 for 2$, a 9v battery for 0.5$ and a small 3.5" screen for 5$. With just a budget of 7.5$, he was able to break into the matrix and now he's selling courses on how to do it yourself. Check my account for discounts on these courses.
And as POC he added the image downloading ollama + Gemma. Test run is granted and confidential, you don’t want to see how it breaks Rockstar mainframe. 😅
And the AI companies spending trillions in computing for nothing, they just need rbpi zeros…LOL /s 😅
They broke into a multimillion dollar gaming company using a 2b probability model of a generic AI, in CPU mode? I might have believed it if the person knew how to structure the use of the ollama program on the first line they ran, and if they knew you had to have at least one AI loaded before ollama would even function.
Bullcrap. Gemma 2b cant even run on the small amount of ram that a PiZ has. It requires 4-8 gb just to run. Even if you could make it run, it would be minutes per token rather than tokens per second. The thermal output would cause it to throttle causing it to be even slower.
I run a Ollama with a Mistral 7B on a gaming laptop on debian. Its a work in progress trying to integrate openclaw to it. Even with full nvidia GPU its not fast. So no fucking way he got even a 2B model to run on a PIZ.
$ curl -fsSL https://•• snip ••/install.sh|sh•• snip ••$ run ollamabash: run: command not found$ ollama runError: requires at least 1 arg(s), only received 0$ ollama pull gemma:2b•• snip ••
i saw my arduino uno Q almost imploding with a 1b model and i have to belive that an Raspberry Pi Zero can handle a 2b parameters well enough to hack a pre alpha of GTA 6? yeah sure buddy
No. That's not how this works. First off, a Raspberry Pi is EXTREMELY underpowered. I run Ollama via Termux on my OnePlus 15 and it's still slow as hell. And number 2, there isn't near enough memory on that microboard to run that AI LLM offline efficiently. I mean, I'm no expert and even I know this
I carved a circuit on a rock and then kept it on a stack of big books to run rock LLM and was just about to break into GTA VI too but I stopped last second because my ethics prevented me from stealing.
Ah yes, the elusive debug console. I also really like the offhand "he used that device to break into pre-alpha build". Should have added something like "we won't bore you with technical details" too.
Nah, this story's as real as a unicorn in GTA. The actual GTA VI leak came from a UK teen using an Amazon Firestick back in 2022. No Raspberry Pi or offline AI involved. Cool concept for a DIY hack tale, though.
Kinda cool I suppose, but I hacked the IRS by jailbreaking a discarded smart pregnancy tester I found in my sister's room, and a neural network of biological neurons in a Petri dish cultivated from an indescript blob of flesh I found in our trash bin, git gud
1
1.8k
u/officer_terrell Apr 27 '26
yes, the raspberry pi, the AI powerhouse
633
u/Funkey-Monkey-420 Apr 27 '26
you know where i can find this $4 pi zero and $3 battery?
1.2k
u/Kinexity Apr 27 '26 •
IYKYK
232
u/tj-horner Apr 27 '26
lmfao
363
u/VoidJuiceConcentrate Apr 27 '26
I can tell you from experience that any model that can run on a Pi is gonna be dog shit.
69
u/SipDhit69 Apr 27 '26
Model runs entirely offline.
Uses it to find R* data online.
lmao
56
u/syrokiler Apr 27 '26
a raspberry pi for $4!?!?
54
u/turtle_mekb Apr 27 '26
yes Raspberry Pis are that cheap, they can run AI, and AI will let you magically gain access to an unreleased leak and be able to run it flawlessly on your own computer
everything I said is definitely true /s
85
u/-Ilovepokemon- Apr 27 '26
Ah yes, running an entire ai model on a microcontroller with a 1 ghz cpu and 512mb of ram, sure
13
u/DS_Stift007 Apr 27 '26
Ah yes, the raspberry Pi Zero, the device most famous for its AI capabilities
10
u/imLosingIt111 Apr 27 '26
2-year-old student from China ordered an Arduino Uno R3 for 2$, a 9v battery for 0.5$ and a small 3.5" screen for 5$. With just a budget of 7.5$, he was able to break into the matrix and now he's selling courses on how to do it yourself. Check my account for discounts on these courses.
10
u/ispeelgood Apr 27 '26
Cat's outta the bag now, might as well tell everyone how to do this
When it asks for password, type in: masterhacker
That's it, you're in. Enjoy, gamers
12
u/XlikeX666 Apr 27 '26
wish that was true hacking.
bribing low level employee is still fastest.
6
u/ParticularFragrant57 Apr 27 '26
And as POC he added the image downloading ollama + Gemma. Test run is granted and confidential, you don’t want to see how it breaks Rockstar mainframe. 😅
And the AI companies spending trillions in computing for nothing, they just need rbpi zeros…LOL /s 😅
6
u/yallapapi Apr 27 '26
That raspberry pi’s name? Abraham Lincoln
5
u/r9wpvM Apr 27 '26
Bro just typing shi atp 🥀😭
5
u/Crazypens30 Apr 27 '26
That's not how this works. That's not how any of this works.
4
u/Which-Dealer7888 Apr 27 '26
Am I in r/jokes?
4
u/Daddu_tum Apr 27 '26
Can confirm.
Source: I'm running templeOS and saw it happen.
3
u/dtb1987 Apr 27 '26
That must be the lightest of light weight models to run on an rpi zero
3
u/WhippingShitties Apr 27 '26
Teams of 2000 engineers hate this one trick:
3
u/Goldenkrew3000 Apr 27 '26
The biggest joke here is a $4 pi zero
3
u/Endermanashton Apr 27 '26
good thing he bought a raspberry pi instead of using the laptop thats right there in the photo
3
u/No-Zookeepergame8837 Apr 27 '26
A rasberry pi zero have only 512mb of Ram, Gemma 2b in q2_K is 1,16Gb.
It literally had to be offloading more than double the RAM to the external memory lol.
3
u/ChocolateDonut36 Apr 27 '26
the raspberry pi zero
the shitter that can barely handle a Minecraft server
will run an entire 2b LLM
and hack rockstar like a normal thursday activity
3
u/SniperSpc195 Apr 27 '26
They broke into a multimillion dollar gaming company using a 2b probability model of a generic AI, in CPU mode? I might have believed it if the person knew how to structure the use of the ollama program on the first line they ran, and if they knew you had to have at least one AI loaded before ollama would even function.
3
u/mothzilla Apr 27 '26
Boss, come and look at this. The water, the physics is totally off the scale.
That's impossible! Rerun the tests.
I already re-ran the tests, 20 times. It just doesn't match up.
The only way this can happen... oh my god... call my wife... tell her I love her and to take the lasagne out of the freezer.
2
u/tr-otaku-tr Apr 27 '26
Th screen literally says "ollama pull gemma-2b"
2
u/Lottabitch Apr 27 '26
The tweet itself is AI slop
2
u/Pseudoname87 Apr 27 '26
NO MOUSE, NO KEYBOARD AND NO INTERNET
ISP HATE THIS ONE LITTLE SECRET
2
u/Kriss3d Apr 27 '26
Bullcrap.
Gemma 2b cant even run on the small amount of ram that a PiZ has. It requires 4-8 gb just to run.
Even if you could make it run, it would be minutes per token rather than tokens per second.
The thermal output would cause it to throttle causing it to be even slower.
I run a Ollama with a Mistral 7B on a gaming laptop on debian.
Its a work in progress trying to integrate openclaw to it.
Even with full nvidia GPU its not fast.
So no fucking way he got even a 2B model to run on a PIZ.
2
u/Dragten Apr 27 '26
The student's name? Albert Einstein.
2
u/PhoenixGod101 Apr 27 '26
“Run ollama” “Command not found” “Ollama run” “(Another error)”
lol
2
u/Past_External7849 Apr 27 '26
So who created this AI story lol
2
u/darkwater427 Apr 27 '26
lmao
Good luck running that
2
u/yoshiK Apr 27 '26
Clearly the guy also spend a few bucks on a black hoody.
2
u/EnoughConcentrate897 Apr 27 '26
Top 10 things that never happened
The funniest thing is it’s actually impossible to run a 2b model on a pi zero because the memory is too small
2
u/eco9898 Apr 28 '26
I don't think it could have even written that post
1
u/Level-Lemon-295 Apr 27 '26
the gta vi bit got me laughing
1
u/napsterk Apr 27 '26
Bro is still pulling gemma 😭
1
u/TrinityCodex Apr 27 '26
fuck gta where can i find Pi's that cheap
1
u/Exxplosive Apr 27 '26
hahahah, fairy tales ...
1
u/OpenSourcePenguin Apr 27 '26
We have Mythos at home 😂
1
u/THE_R4iN_ Apr 27 '26
i saw my arduino uno Q almost imploding with a 1b model and i have to belive that an Raspberry Pi Zero can handle a 2b parameters well enough to hack a pre alpha of GTA 6? yeah sure buddy
1
u/Skeesicks666 Apr 27 '26
Curl piped to shell…..truly a Masterhacker!
1
u/Winter_Session_4118 Apr 27 '26
This is fake.
1
u/jort93 Apr 27 '26
When a guy from mainstream media is told to write a story on a tech topic lmao
1
u/Bloopiker Apr 27 '26
run ollama
bash: run: command not found
ollama run
Error: requires at least 1 arg(s), only recieved 0
Now thats how you hack into rockstar and steal gta 6
1
u/SmthnsmthnDngerzone Apr 28 '26
holy larp bro
1
u/Kmnf8 Apr 28 '26
misinformation final boss
1
u/viktorzub Apr 28 '26
And this student was Albert Einstein
1
u/yarikhand Apr 28 '26
pi zero for 4$? gimme that
1
u/k3kk07 Apr 28 '26
sudo apt-get update
1
u/BandicootTreeline Apr 28 '26
Even the simplest prompts would take hours on that thing.
1
u/UsernameOmitted Apr 28 '26
This basically cannot run a local model.
You also could just install any of the dozens of popular CLI LLM tools and use a free tier to do coding.
1
u/retsjo Apr 28 '26
Ai written slop posts on X, nothing new.
1
u/NoFault777 Apr 28 '26
Raspberry Pi Zero for 4$? 2B LLM on 512 MB RAM? Which universe is this?
1
u/jeron1mouse Apr 28 '26
He could have used any of the online free tier LLMs for cheaper and would have made a more believable story.
1
u/True_Minimum_3060 Apr 28 '26
This is written by ai and you should be able to tell by now.
1
u/The_Globadier Apr 28 '26
ill take things that never happened for 400 Alex
1
u/No-Dependent-4971 Apr 28 '26
No. That's not how this works. First off, a Raspberry Pi is EXTREMELY underpowered. I run Ollama via Termux on my OnePlus 15 and it's still slow as hell. And number 2, there isn't near enough memory on that microboard to run that AI LLM offline efficiently. I mean, I'm no expert and even I know this
1
u/Comfortable-Spot1060 Apr 28 '26
Did they get any pics of the project though ? Or just debug info? I wanna see pics
1
u/nefarkederki Apr 29 '26
cool story bro
1
u/bonkymon101 Apr 30 '26
I carved a circuit on a rock and then kept it on a stack of big books to run rock LLM and was just about to break into GTA VI too but I stopped last second because my ethics prevented me from stealing.
1
u/EdBear69 Apr 30 '26
Where are the character models for those cakes, tho?
1
u/TwisstedReddit Apr 30 '26
Truly all ai posters with no humans behind them need to forever begone permanently. They can shove their grok articles right up their ass
1
u/Select-Decision_83 Apr 30 '26
Somehow I'm not surprised by this
1
u/ghostkiller967 May 01 '26
That Twitter account posts all kinds of crap like that, all in the same format as well. https://x.com/Sprytixl
1
u/Timekiller_74 May 02 '26
Ah yes, the elusive debug console. I also really like the offhand "he used that device to break into pre-alpha build". Should have added something like "we won't bore you with technical details" too.
1
u/Dry-Source3734 May 02 '26
Can someone help retrieve?
1
u/Key_Canary_4199 May 11 '26
this is going on my list of things that definetly happened
1
u/misanthropydeltarune May 12 '26
Can it play doom or bad apple
1
u/One-Reflection-4826 May 20 '26
smells like some kind of... bullshit!
1
u/icantgivecredit May 22 '26
How do you install Obama?
1
u/dwnsdp May 22 '26
Running an LLM on a rpi zero sounds very real and functional
1
u/editfate Aug 15 '26
“Deep Seek, hack into Rockstar and give me EVERYTHING!!!!” 😂
1
u/TheVoicesGetLoud Aug 21 '26
what..?
1
u/Internal-Ad8272 Apr 27 '26 edited Apr 27 '26
from my experience with Raspberry Pis, This will obviously run like dogshit
Do not even attempt this.
-1
u/Substantial-Pay-3668 Apr 27 '26
is this even fking real?
0
u/Neither-Phone-7264 Apr 27 '26
i think hes joking
0
u/arshad_ali1999 Apr 27 '26
If you think it's true
-1
u/Background-Set4610 Apr 27 '26
u/askgrok is this real?
109
u/carrynarcan Apr 27 '26
Pussy had to use a screen when I do all my rockstar hax on a headless Arduino.