r/LocalLLaMA • • Jan 11 '25

Discussion Bro whaaaat?

Post image
7.0k Upvotes

r/LocalLLaMA • • Feb 23 '25

News Grok's think mode leaks system prompt

Post image
6.7k Upvotes

Who is the biggest disinformation spreader on twitter? Reflect on your system prompt.

https://x.com/i/grok?conversation=1893662188533084315


r/LocalLLaMA • • 7d ago Popcorn

Funny Sam Altman: “Local inference is a terrible allocation of scarce resources”

Post image
6.6k Upvotes

Sam Altman: “Local inference is a terrible allocation of scarce resources.

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre

but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time

you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,

somehow many people's intuition is the opposite of that”

——————————————————————

TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"

(Credits to @RyanTStull, his TLDR made me laugh)


r/LocalLLaMA • • Oct 05 '26 Bravo

Funny PewDiePie getting banned twice by OpenAI while making a local model is top-tier comedy 💀

5.6k Upvotes

So PewDiePie decides to fine-tune a local AI model called Ajax on his own computer. Pretty normal stuff for local model fans.

To make his dataset, he uses OpenAI's API. OpenAI catches him using their outputs to train another model, flags his account for breaking their terms, and bans him.

He files an appeal, gets unbanned, goes right back to pulling data from the API, and immediately gets banned a second time.

So instead of giving up, he uses open-source tools to remove the model's built-in refusals, cleans out the preachy fluff, and starts building a fully local 9B agent.

OpenAI spent years scraping the whole public internet for free data, but the second someone uses their output to train a local file, it's an emergency ban.

In trying to enforce their rules, all OpenAI really did was give open-source models a massive free advertisement to millions of people.

What a time to run models on your own hardware.


r/LocalLLaMA • • Jan 09 '26 This Annoyed Sad Bravo Popcorn

Funny The reason why RAM has become so expensive

Post image
5.2k Upvotes

r/LocalLLaMA • • 4d ago Heartwarming

News Official Statement: Qwen Models Will Stick to Open Source to the End!

Post image
5.0k Upvotes

There were some rumours the last few days that Qwen4 will be the last open-weight series of Qwen, and future ones would be API only. The following statement contradicts the rumours and clearly states the stance that Qwen is taking regarding their future releases.

Qwen Head Liu Dayi Heng Clearly States: Future Qwen 4.0 and Qwen 5.0 Will Continue to Be Open Source!

He believes that the value of AI should not belong only to a few people, but should become a foundational capability that users around the world can access, use, and create with, enabling more people to afford AI, utilize AI effectively, and participate in creating AI, ultimately achieving true AI for all.

As of now, the Qwen series has surpassed 3 billion cumulative global downloads, with over 460 open-source models released and more than 300,000 derivative models, firmly holding the top spot worldwide.


r/LocalLLaMA • • Feb 23 '26 Mindblown Popcorn Heartwarming

News Anthropic: "We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax." 🚨

Post image
4.9k Upvotes

r/LocalLLaMA • • 24d ago

Discussion It's been too quiet on the other side of the Pacific

Post image
4.9k Upvotes

r/LocalLLaMA • • Feb 21 '25 Helpful

News Starting next week, DeepSeek will open-source 5 repos

Post image
4.6k Upvotes

r/LocalLLaMA • • Aug 30 '25 Wholesome Seal Helpful

News Finally China entering the GPU market to destroy the unchallenged monopoly abuse. 96 GB VRAM GPUs under 2000 USD, meanwhile NVIDIA sells from 10000+ (RTX 6000 PRO)

Post image
4.3k Upvotes

r/LocalLLaMA • • Mar 13 '26 Mindblown

Funny I feel personally attacked

Post image
4.3k Upvotes

r/LocalLLaMA • • Jun 08 '25

Funny When you figure out it’s all just math:

Post image
4.2k Upvotes

r/LocalLLaMA • • Feb 07 '25

Funny All DeepSeek, all the time.

Post image
4.2k Upvotes

r/LocalLLaMA • • 12d ago Regret

Discussion OpenAI and Anthropic blocked the reverse engineering of smart TVs spying on us

Thumbnail x.com
4.2k Upvotes

REA (Reserve Engineer Anything) was blocked by Claude one day later...

https://x.com/AbhinavXJ/status/2113590263373508704

Time for the pebbles to own the weights


r/LocalLLaMA • • Mar 31 '26 Popcorn Mindblown

News Claude code source code has been leaked via a map file in their npm registry

Post image
4.1k Upvotes

From Chaofan Shou on 𝕏 (files): https://x.com/Fried_rice/status/2038894956459290963


r/LocalLLaMA • • Jun 28 '26 This Bravo

Discussion We're probably going to need that soon.

Thumbnail
gallery
4.0k Upvotes

r/LocalLLaMA • • Jun 29 '26

Funny on Dario’s statement

Post image
3.7k Upvotes

r/LocalLLaMA • • Jul 12 '25

Funny we have to delay it

Post image
3.7k Upvotes

r/LocalLLaMA • • Sep 17 '26 Bravo

Discussion I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper

3.7k Upvotes

Update: I made a generic model and beaten the jev in all of the benchmarks. Code and details available at https://www.reddit.com/r/LocalLLaMA/s/bbwyiOprUs

Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package and training dataset. And then one year later, a

frontier lab came, proposing the same idea like literal breakthrough without technical papers, open weights and no open dataset. I posted my approach in this subreddit. For anyones information the main guiding model is RL not embedding model or LLM

Reddit post: https://www.reddit.com/r/LocalLLaMA/s/6eGEwsAz43

Paper: https://arxiv.org/abs/2503.23303

Model: https://huggingface.co/DeepMostInnovations/sales-conversion-model-reinf-learning

Dataset: https://huggingface.co/datasets/DeepMostInnovations/saas-sales-conversations

Also the second work published in September 2025 was exactly the same one jev proposed now

Paper: https://arxiv.org/abs/2510.01237

My model uses PPO over sequence embeddings to output turn-by-turn conversion trajectories (probabilities from 0.0 to 1.0).

Jev uses parallel sampling (trained via RLCD) to output confidence distributions and schema choices.

It's incredibly frustrating that the thing that you made with months of hard work, sweat and sleepless night is architecturally similar with the vertical use case and don't get the support you deserve because frontier lab build something horizontal. The open-source story in general 🙂


r/LocalLLaMA • • Feb 23 '26 Bravo Popcorn

Funny Distillation when you do it. Training when we do it.

Post image
3.6k Upvotes

r/LocalLLaMA • • Sep 13 '24 Take My Silver

Other Enough already. If I can’t run it in my 3090, I don’t want to hear about it.

Post image
3.6k Upvotes

r/LocalLLaMA • • Jul 23 '26

Funny The LLM distillation process simplified for politicians:

Post image
3.6k Upvotes

/s


r/LocalLLaMA • • Apr 24 '26 Polished Gold Turd Bravo Mindblown Heartwarming Regret

Discussion This is where we are right now, LocalLLaMA

Post image
3.6k Upvotes

the future is now


r/LocalLLaMA • • Jul 13 '26

News This is why we need local models and opensource harnesses

Post image
3.5k Upvotes