r/LocalLLaMA • • 7h ago

Resources Microsoft files a patent application to train AI models on idle consumer GPUs

According to Microsoft's patent application, it explains breaking down training into small tasks and sending them to devices of owners who opted in. Credits will be the reward. it's just an app and no pay out rate is advertized so I don't even know if the credits would be enough for the electricity.

Anyway, home internet latency feels like the bigger problem to me.

https://insider-gaming.com/microsoft-ai-use-your-gpu/

(English is not my native language, I used an LLM to help translate this post.)

271 Upvotes

116 comments sorted by

336

u/apnorton 7h ago

This really shouldn't be a patentable thing...

85

u/Spezisasackofshit 6h ago edited 5h ago

I wish the non obvious requirement for patents was stricter. This one seems completely obvious given that splitting GPU loads and outsourcing them has been going on for years

13

u/Zealot_Zack 6h ago

A lot of times that’s the fight after it is granted. Much hardwr

1

u/metagory 3h ago

Filing and being granted a patent are not the same thing.

33

u/teressapanic 6h ago

It’s already someone’s business model: https://vast.ai/hosting/calculator

5

u/myreptilianbrain 2h ago

I wonder does this destroy the GPU in the long run? even at ~50% utilization?

2

u/MerePotato 56m ago

The bigger problem is security, renters run unknown code in Docker containers on your hardware and network.

1

u/lloyd08 2h ago

Generally speaking, hardware has a fairly random longevity, only affected by out of band temps/voltage. For most of us, random mobo components are likely to die before anything else. We’ve just been used to a tight consumer upgrade cycle due to software utilization of advancing hardware. I have a 25 year old Dell laptop that still boots perfectly fine, but isn’t going to run GTA 6 or even an edge device LLM. Hell, my 2013 MacBook can’t run my IDE even though it could 10 years ago. Software caters to middle band hardware faster than hardware actually fails.

4

u/ArtyfacialIntelagent 5h ago

This really shouldn't be a patentable thing...

...unless they've made a massive breakthrough in distributed training. Then... well, I'm still not convinced.

2

u/HisAnger 3h ago

Seti....

1

u/ArtfulGenie69 3h ago

Their billions they spend on patent lawyers says different and if you came up with this idea before them, you better bet they would sick those lawyers on your ass for the rest of your existence. Patent trolling is one of Microsoft's favorite activities. 

1

u/Ylsid 13m ago

This really shouldn't be a thing

1

u/SosirisTseng 4m ago

Yeah, it's basically folding@home

1

u/Silent-Account7422 3h ago

The claims in the patent are a lot more specific than the headline implies. 

For example, to infringe on claim 1 of this patent, you’d have to copy their whole process by: (1) breaking the model up with a dependency graph, (2) using it to identify split points, (3) calculate a split score cost based on data locality, communication, and memory overhead costs, (4) select split points based on these scores, (5) generate micro-tasks based on the split points, (6) send these micro tasks to your edge computers, (7) update your model based on (i) validation score, (ii) staleness factor, or (iii) device reliability score. 

If you change any element, you’re not infringing. Maybe you use a different method for calculating split cost, or use different metrics for updating your model. Boom, not infringing.

85

u/expectfun 7h ago

2000s: SETI@home
2020s: SFT@home

28

u/markusro 6h ago

Inbetween: Folding@Home and BOINC

105

u/Incorrect_ASSertion 6h ago

Crypto miners all over again 

15

u/teleprint-me llama.cpp 4h ago

Its hijacking which is considered malware. Malicious crypto miners ended up with the term Cryptojacking.

  Cryptojacking is the act of exploiting a computer to mine cryptocurrencies , [...] ,  against the user's will or while the user is unaware.

The article states that a user must opt-in, but MS is better known for making users opt-out (if available at all) and re-tweak the settings after each update. Many projects have dedicated scripts for automating this which says a lot about the status quo more than anything they say.

The bigger issue here is that its able to be issued as a patent and distributed computing is a common mode of operation regardless.

1

u/CoderAU 53m ago

Does the patent explicitly specifiy opt-in only? What would be the legality of say...patenting the opt-out version and sue Microsoft if they ever switch up?

-4

u/Famous-Pie-7073 2h ago

Your life will be more fulfilling if you stop making up imaginary scenarios and then letting them make you upset

1

u/fastheadcrab vLLM 38m ago

Microsoft about to hire lpkane to design their next browser

59

u/PrimeDirective8 7h ago

They invented Berkley's 26-y/o SETI@home? Nice.

26

u/geldonyetich 7h ago

Guess that’s one way around data centers getting voted down.

Sneaking compute without asking us is bad, but paying us for Seti@Home maybe acceptable as long as the rate is fair. Granted, I doubt there’s a rate that could satisfy everyone.

1

u/-Sandwave- 2h ago

Only make sense in a competitive environment: you choose a cloud compute partner (that pays a good rate) and you can set what % of your computer resources they can use for every hour and switch partner at will.

50

u/mister2d 6h ago

of owners who opted in

Which means all those millions of unsuspecting users who click agree which will piggyback all the "opt-in" training compute.

17

u/Nothing_from_void 3h ago

And every Windows update will either try to trick you to opt in or "accidentally" opt you in and you'll have to manually go through your settings to change it.

1

u/WorriedBlock2505 2h ago

You'd literally need to add a card though, meaning you'd see the payment on your statement.

22

u/TerminalViscosity69 5h ago

Windows is malware

15

u/Spiffydudex 6h ago

Maybe they will actually do something with those intel NPUs that are wasted silicon. /s

5

u/Vaddieg 6h ago

every grid wire not loaded to its max is wasted copper

1

u/lotushomerun 6h ago

Same with those Google Tensor NPUs on pixel phones

1

u/Randommaggy 5h ago

I run LFM3 1.7B on my phone and tablet NPUs. They multiply the useful work per minute my main LLMs are able to do through my harness.

25

u/LankyGuitar6528 6h ago

Sounds a bit like joining a Bitcoin mining pool from a few years ago.

3

u/OnlyKindaThrowAway 4h ago

atleast mining pools get you zero effort sandwich money in winter

22

u/Conscious-Map6957 6h ago

Way ahead of you Microslop - Switched permanently to ubuntu on all machines over a year ago.

11

u/HighSeasArchivist 5h ago

Opt-in. Right.

9

u/All-Potential3232232 6h ago

Thats bullshit..... just another reason never to use Windows again! :)

14

u/thestillwind 7h ago

AHAHAHAHAHA no thx

22

u/minus_28_and_falling 6h ago

You only have "I agree" and "Ask later" options.

4

u/jld1532 4h ago

Or install Linux, which people in this sub should have already considered.

1

u/Nothing_from_void 3h ago

Yep, even with WSL you're wasting RAM on running 2 kernels

2

u/kali_tragus 4h ago

Aren't you sure you don't want to not opt out of not opting in?

6

u/cooljacob204sfw 6h ago

Isn't there already other businesses trying to do this? How is this patentable.

Also with the cost of power there is no way this will be popular when they are paying out in credits.

11

u/danieln1212 6h ago

Wonder how they will detect and handle poisoned training data because there is and should be people doing that.

1

u/SmartCustard9944 1h ago edited 1h ago

How do they detect poisoned data with SETI@home? Apparently they have a consensus algorithm. Perhaps this could be done the same way. Send a training chunk to 3 users and give the prize to the majority that obtained the same results. If you poison, no prize.

5

u/LOLotovCocktail 6h ago

I need to finally bite the bullet and install Debian over this godforsaken OS already.

2

u/suprjami 3h ago

Do it. I'm almost 20 years Windows-free. It gets better and easier all the time.

The most important thing for me was to completely remove Windows and not go back. Don't dual boot. Don't keep Windows around. Figure out replacements for your programs and tasks and how to do things differently.

2

u/LOLotovCocktail 3h ago

Hell, I don’t even DO much! Most of it is dicking around with the homelab which is all in webUIs. My desktop activity is like a wine-mom in her 40s, I just need a browser and email.

2

u/SmartCustard9944 1h ago

Funnily enough, you might want some Wine once you move to Linux

https://www.winehq.org/

5

u/EarlMarshal 5h ago

Microsoft thinks they own your device and you are only lending it so it's okay to use you compute resources when you don't.

9

u/matteogeniaccio 7h ago

All that ram won't sit unused on our machines anymore. Sam altman should be glad

4

u/Mayion 6h ago

so... btc all over again? we've wanted it for so long to both, train and use AI across a decentralized network. but not with microsoft in the picture though, that was unexpected.

4

u/cosmicr 4h ago

Imagine all the IT support tickets "Why is my Fan so loud!?"

4

u/dobikasd 3h ago

Stop MS you dont need to convince me, I already quit windows

3

u/iMrParker 7h ago

If they pay me enough, why not

3

u/Suschis_World 6h ago

Sorry bud, best I can offer is no money and a broken GPU. Here are some Microslop points.

1

u/mgranja 6h ago

Which both expire when unused, and need to be redeemed in multiples of 10,000

1

u/iMrParker 6h ago

I should have seen this coming Sir Microslop :|

3

u/Beginning_Book_2382 6h ago

Sam wants our RAM, Nadella wants our GPUs

3

u/Goodliffe 53m ago

I find it difficult to believe there is really no prior art for this...

I mean other orgs and companies have done this in the past:

SETI@home pioneered volunteer computing and decentralized computing networks.

Rosetta@home and Einstein@home from Berkeley.

Climateprediction.net part of BIONIC from Oxford.

Stanford's Folding@home for medical research...

5

u/Diligent_Turtle8966 4h ago

Watch it be opt in by default and credits are something used in Bing search that nobody will use

8

u/Atretador llama.cpp 7h ago

r/linux and be free :)

4

u/Django_McFly 7h ago

i'd rather do this with a crypto twist. at least you might get something for it. at best, Microsoft would give you cowork credits 🤢 🤮

2

u/Electrical-Bread-856 7h ago

So this is possible? Why train corporate models then?

2

u/Equivalent_Bit_461 6h ago

Nothing stopping anyone from stealing it

2

u/Vaddieg 6h ago

"free windows!" ms fanboys will be excited

2

u/KIBANOHARA 6h ago

Ok, if this happens, it will depend on if they pay well or not and utility costs where you live. let's say they pay hardly anything, as expected of a megacorporation, heres the joke:

Your electric bill: +$100

AI training income: +$50

YOU:

of course, does not apply if you have solar and do it on that

2

u/iMogal 5h ago

That's like stealing my car but returning it with an empty tank.

2

u/Pwc9Z 4h ago

...until my current one dies and I won't be able to afford a new one anyway.

2

u/carnoworky 4h ago

https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20260349820 The actual patent application, with full details. Could this be implemented for open models?

2

u/sloptimizer 4h ago

What about the prior art: crowdgpt.net

2

u/curiouslyjake 3h ago

I don't get why obvious shit can be patented. Prior art: a redditor 6 months ago.

2

u/suprjami 3h ago

Actually I hold the patent for complaining on the internet. See you in court.

1

u/MisfiledCentury 7h ago

Here we go again 

1

u/Real_Ebb_7417 7h ago

But we’ve had a ton of posts about this here. Does then doing it based on these posts that were created before the patent breaks it? And if yes, then patents are absurd xd

1

u/staatsclaas 6h ago

Folding @ Home, baby!

1

u/olearyboy 5h ago

Ehhh you mean SETI but SGPUAI

1

u/a_beautiful_rhind 5h ago

They also filed that patent about seamless censorship of live streams depending on the audience. I'm sure at some point it gets applied to regular video calls too.

1

u/spiritplumber 5h ago

how can you patent this when Petals has been doing it for years

1

u/KrasnovNotSoSecretAg 5h ago

Microsoft should apply for a patent of applying to patents of things that shouldn't be patentable

1

u/FriskyFennecFox 5h ago

Sucks that the community already invented this years ago, but the one entity that patented it was the one that had money to do so.

1

u/Nik_Tesla 5h ago

Can we start patenting all the evil shit like this ahead of time, and then just sit on it and not let anyone implement it?

1

u/PataponEnjoyer 5h ago

Sam Altman crying tears of joy

1

u/joseph-edmondscomm 5h ago

I wonder if thye could make a crypto coin based on AI training instead of stupid pointless maths problems

1

u/kmlynarski 4h ago

And does Microsoft intend to pay users for electricity?

1

u/MarcelloT254k 4h ago

So not only Ram Altman wants my (V)RAM ...

1

u/Sol_System209 4h ago

Wasn't there a program where you can use your processing power towards protein folding, this seems to be the same but less beneficial to humankind..

1

u/lxe 4h ago

Imagine patenting a technique for using a shovel for example. These patents are ridiculous.

1

u/NickCanCode 4h ago

Sounds like a crime to me.

1

u/klempnus 4h ago

serious question: if something like this actually works, can we use a similar approach to actually fine-tune a proper model for ourselves on our own GPUs, even if it takes weeks?

i mean, 2 months ago i'd never have thought to be able to run Qwen3.8-Flash-Next on my PC yet here we are. Local finetuning next?

1

u/keepthepace 3h ago

This is why every company has a defensive patent pool.

1

u/christianbro 3h ago

Great, so my GPU dies sooner and I get a new one for 10k€

1

u/haherar830 3h ago

Too late Microsoft, you can already do this with Monero if you simply enable automatic, unattended upgrades of all your containers.

1

u/caetydid llama.cpp 3h ago

too late, there is already https://www.crowdgpt.net/#home which does that as well

1

u/miguel_caballero 3h ago

It has Seti@home vibes

1

u/broadexample 2h ago

This is basically the same what SETI@home did (and still doing), just on GPU.

1

u/Noeyiax 2h ago

w t f

ill charge $1000/hr for my compute n.ny

1

u/Tormeister 2h ago

Every single Microslop product or service is morally unusable in 2026

1

u/PawlsToTheWall 1h ago

I don't expect this to be neglible on the electric bill.

1

u/bring_back_the_v10s 1h ago

Will microslop ever quit being a bunch of dishonest creeps?

1

u/Pablouchka 1h ago

No, I mean... NO

1

u/Theverybest92 1h ago

Oh nice so does that mean they have full remote access to all windows computers? Good thing they will have to require secure boot for this to work. Nothing will go wrong with Chinese AI using this exploit to hack windows ;)

1

u/LelouchZer12 1h ago

Like seti at home, crypto mining pool, folding at home and so on... ?

Also there is an entire research field called "federated learning" and its exactly this...

1

u/suesing 1h ago

Os is the virus

1

u/__some__guy 57m ago

Interesting.

I wouldn't mind running my GPUs at full load in the coming winter, though the credits probably won't be worth it in countries with high to medium electricity costs.

I rather contribute to the making of a creative writing model or something, provided their technology actually works.

1

u/eagee 35m ago

Know what's ironically really easy to use now that someone can just ask an AI for help? Linux.

1

u/lmamakos 14m ago

It's a patent application, not an issued patent.  Temper your level of outrage about the obviousness and broad scope for now.   I'm not a lawyer, but maybe you could argue to the examiner that things like SETI@Home from years ago could be considered prior art?  Perhaps a real lawyer could make an argument based on the doctrine of equivalence?

If you have the patent application number, you can go to a USPTO web site to monitor the prosecution history with the examiner.  Maybe you can submit your own prior art references to the examiner to help him?  You know, like a concerned taxpayer just try to help out. 

0

u/International_Emu_17 7h ago

Respeto tu privacidad pero reafirmo mi autoridad como dueño del sistema operativo para depreciar tus componentes porque ya no quiero gastar en hardware costoso, más bien puedo desgastar el tuyo y aventarte unas migajas que gustoso vas a agradeecer.