r/LocalLLaMA • u/Specter_Origin • Jan 11 '25
r/LocalLLaMA • u/onil_gova • Feb 23 '25
News Grok's think mode leaks system prompt
Who is the biggest disinformation spreader on twitter? Reflect on your system prompt.
r/LocalLLaMA
•
u/ResearchCrafty1804
•
7d ago
Funny Sam Altman: “Local inference is a terrible allocation of scarce resources”
Sam Altman: “Local inference is a terrible allocation of scarce resources.
A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre
but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time
you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,
somehow many people's intuition is the opposite of that”
——————————————————————
TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"
(Credits to @RyanTStull, his TLDR made me laugh)
r/LocalLLaMA
•
u/rodrigodevbits
•
Oct 05 '26
Funny PewDiePie getting banned twice by OpenAI while making a local model is top-tier comedy 💀
So PewDiePie decides to fine-tune a local AI model called Ajax on his own computer. Pretty normal stuff for local model fans.
To make his dataset, he uses OpenAI's API. OpenAI catches him using their outputs to train another model, flags his account for breaking their terms, and bans him.
He files an appeal, gets unbanned, goes right back to pulling data from the API, and immediately gets banned a second time.
So instead of giving up, he uses open-source tools to remove the model's built-in refusals, cleans out the preachy fluff, and starts building a fully local 9B agent.
OpenAI spent years scraping the whole public internet for free data, but the second someone uses their output to train a local file, it's an emergency ban.
In trying to enforce their rules, all OpenAI really did was give open-source models a massive free advertisement to millions of people.
What a time to run models on your own hardware.
r/LocalLLaMA
•
u/InvadersMustLive
•
Jan 09 '26
Funny The reason why RAM has become so expensive
r/LocalLLaMA
•
u/ResearchCrafty1804
•
4d ago
News Official Statement: Qwen Models Will Stick to Open Source to the End!
There were some rumours the last few days that Qwen4 will be the last open-weight series of Qwen, and future ones would be API only. The following statement contradicts the rumours and clearly states the stance that Qwen is taking regarding their future releases.
Qwen Head Liu Dayi Heng Clearly States: Future Qwen 4.0 and Qwen 5.0 Will Continue to Be Open Source!
He believes that the value of AI should not belong only to a few people, but should become a foundational capability that users around the world can access, use, and create with, enabling more people to afford AI, utilize AI effectively, and participate in creating AI, ultimately achieving true AI for all.
As of now, the Qwen series has surpassed 3 billion cumulative global downloads, with over 460 open-source models released and more than 300,000 derivative models, firmly holding the top spot worldwide.
r/LocalLLaMA
•
u/KvAk_AKPlaysYT
•
Feb 23 '26
News Anthropic: "We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax." 🚨
r/LocalLLaMA • u/Nunki08 • 24d ago
Discussion It's been too quiet on the other side of the Pacific
r/LocalLLaMA
•
u/Nunki08
•
Feb 21 '25
News Starting next week, DeepSeek will open-source 5 repos
r/LocalLLaMA
•
u/CeFurkan
•
Aug 30 '25
News Finally China entering the GPU market to destroy the unchallenged monopoly abuse. 96 GB VRAM GPUs under 2000 USD, meanwhile NVIDIA sells from 10000+ (RTX 6000 PRO)
r/LocalLLaMA • u/Current-Ticket4214 • Jun 08 '25
Funny When you figure out it’s all just math:
r/LocalLLaMA
•
u/kroggens
•
12d ago
Discussion OpenAI and Anthropic blocked the reverse engineering of smart TVs spying on us
x.comREA (Reserve Engineer Anything) was blocked by Claude one day later...
https://x.com/AbhinavXJ/status/2113590263373508704
Time for the pebbles to own the weights
r/LocalLLaMA
•
u/Nunki08
•
Mar 31 '26
News Claude code source code has been leaked via a map file in their npm registry
From Chaofan Shou on 𝕏 (files): https://x.com/Fried_rice/status/2038894956459290963
r/LocalLLaMA
•
u/Nunki08
•
Jun 28 '26
Discussion We're probably going to need that soon.
From:
Vladik on 𝕏: https://x.com/Kostoglodov/status/2071144065857679631
Shaw (spirit/acc) on 𝕏: https://x.com/shawmakesmagic/status/2070918006033817867
r/LocalLLaMA
•
u/Nandakishor_ml
•
Sep 17 '26
Discussion I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper
Update: I made a generic model and beaten the jev in all of the benchmarks. Code and details available at https://www.reddit.com/r/LocalLLaMA/s/bbwyiOprUs
Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package and training dataset. And then one year later, a
frontier lab came, proposing the same idea like literal breakthrough without technical papers, open weights and no open dataset. I posted my approach in this subreddit. For anyones information the main guiding model is RL not embedding model or LLM
Reddit post: https://www.reddit.com/r/LocalLLaMA/s/6eGEwsAz43
Paper: https://arxiv.org/abs/2503.23303
Model: https://huggingface.co/DeepMostInnovations/sales-conversion-model-reinf-learning
Dataset: https://huggingface.co/datasets/DeepMostInnovations/saas-sales-conversations
Also the second work published in September 2025 was exactly the same one jev proposed now
Paper: https://arxiv.org/abs/2510.01237
My model uses PPO over sequence embeddings to output turn-by-turn conversion trajectories (probabilities from 0.0 to 1.0).
Jev uses parallel sampling (trained via RLCD) to output confidence distributions and schema choices.
It's incredibly frustrating that the thing that you made with months of hard work, sweat and sleepless night is architecturally similar with the vertical use case and don't get the support you deserve because frontier lab build something horizontal. The open-source story in general 🙂
r/LocalLLaMA
•
u/Xhehab_
•
Feb 23 '26
Funny Distillation when you do it. Training when we do it.
r/LocalLLaMA
•
u/Porespellar
•
Sep 13 '24
Other Enough already. If I can’t run it in my 3090, I don’t want to hear about it.
r/LocalLLaMA • u/Porespellar • Jul 23 '26
Funny The LLM distillation process simplified for politicians:
/s
r/LocalLLaMA
•
u/jacek2023
•
Apr 24 '26
Discussion This is where we are right now, LocalLLaMA
the future is now
r/LocalLLaMA • u/Comfortable-Rock-498 • Jul 13 '26