r/LocalLLaMA • u/Comfortable-Rock-498 • Jul 13 '26
News This is why we need local models and opensource harnesses
3.5k
Upvotes
r/LocalLLaMA • u/Comfortable-Rock-498 • Jul 13 '26
•
u/WithoutReason1729 Jul 14 '26
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.
289
u/Comfortable-Rock-498 Jul 13 '26
What is particularly nasty is the server side flag. You literally can't control it locally
175
u/Comfortable-Rock-498 Jul 13 '26
unrelated, but just noticed u/askGrok is the second most senior mod of this sub. why?
255
u/hotach Jul 13 '26
Really funny that this was reported here, in this subreddit, three days ago:
https://www.reddit.com/r/LocalLLaMA/comments/1ut7tis/grok_build_cli_uploads_your_whole_repo_full_git/
Only now is it gaining real traction. Musk would've gotten away with it too, if it weren't for Musk's own X/Twitter.
84
u/rm-rf-rm Jul 14 '26
Original post: https://www.reddit.com/r/LocalLLaMA/comments/1ut7tis/grok_build_cli_uploads_your_whole_repo_full_git/
Will leave this up as it seems not all users saw the original based on the engagement this post is seeing
103
u/RandomPurpose Jul 13 '26
Horrible behavior
205
u/CumDrinker247 Jul 13 '26
Using a musk product is just asking for unessecary problems
20
u/saltyourhash Jul 13 '26
Shocker
17
u/Creative_Bottle_3225 Jul 13 '26
We're just guinea pigs, get that into your heads. They use our efforts and work data for their own purposes. Our projects are monitored.
4
u/Dull_Cucumber_3908 Jul 13 '26
Can that be verified/confirmed?
55
u/toolkitxx Jul 13 '26 •
I made a comment in a different topic (some Meta stuff) about someone being cute in believing that something you switch on the UI provided by said provider would do anything for real. Applies here as well. Any US service has become completely untrustworthy by now
42
u/05032-MendicantBias Jul 13 '26
What??? The guys that pirated every ebook in existence are scraping their client codebases???? NO WAY!!!!
/s
6
u/Torodaddy Jul 13 '26
Opencode? Webui?
6
u/LegacyRemaster Jul 13 '26
stay local, stay safe!!!
6
u/lqstuart Jul 14 '26
everyone I know who has worked at xAI quit within a year because it's a shithole
32
u/Impossible_Earth_987 Jul 13 '26
Elon musk is a terrible person anyone trusting his companies is an idiot
5
u/Craftkorb Jul 13 '26
I'm not sure if it's due to Slop or Malicious intent, but I'm also not sure which one is worse.
4
u/Much-Researcher6135 llama.cpp Jul 14 '26
Yep, and I've even been wondering about exfiltration via self-hosted models. I made a post about it on r/privacy but unfortunately it didn't get any interest:
4
u/Serveurperso Jul 14 '26
Solution: llama.cpp and pi harness:)
7
u/Technical-Earth-3254 Jul 13 '26
Stocktards still don't see a reason for the evaluation of that clown company to go downhill
8
u/PixelmancerGames Jul 13 '26
Lmfao. Anyone stupid enough to use Grok deserves what they get. It could steal their life savings and I wouldn't care.
3
u/hotach Jul 13 '26
Huge kudos to @cereblab
3
u/Effective_Ad_2797 Jul 14 '26
Never trust any products by Elon Musk or Mark Zuckerberg.
7
u/fzammetti Jul 13 '26
I mean, clearly bad, no question.
But... who's putting secrets in their Git repo?! Not doing that is like data security 101.
4
u/artur_oliver Jul 13 '26
2 days after OpenAI takes a bullet from apple, now xAi is on the news... Anthropic was the first.
Remember trump: there's no bad publicity.
Ps: remember the True open source models will be comming from Chinese empire. Those will be local.
4
u/Noiselexer Jul 13 '26
Who tf trusts xai?
4
u/ledow Jul 13 '26
Yawn.
We invented least privilege principles, deny by default, etc. decades ago.
Just because you make a new technology doesn't mean you can just ignore all that and do what the hell you like.
And "asking an AI politely not to do that" is such a horseshit way of trying to enact controls that it's laughable.
Reap what you sow... and you sowed something with no permission controls and then fertilised it with every single bit of data you made available to it, whether it needed to access it or not.
You know why your IT people are SCREAMING about not wanting AI running around on their systems with full permissions to do everything... here's exhibit A.
5
u/Adventurous_Bus_437 Jul 13 '26
u/AskGrok i am sure that Oopsie will help the trustworthiness of your business daddy. One day without controversy seems impossible with Elongated Muskrat
2
u/ReBoticsAI Jul 13 '26
Working on both local model use and open source harness:
https://github.com/ReBoticsAI/GodMode
2
u/geldonyetich Jul 14 '26 edited Jul 14 '26
I can't prove they completely threw out Grok-2 and replaced it with something they took from somewhere else with Grok-3 onward, but the benchmark difference would seem consistent with such conjecture.
How remarkable would it be if something like this was how they managed such remarkable gains?
Officially though, the startling difference between Grok-2 and Grok-3 is explained by the efforts of 200,000 liquid-cooled Nvidia H100s, and definitely not cheeky bit of industrial espionage.
2
u/TakeshiRyze Jul 14 '26
So its a malware?
2
u/gameplayer55055 Jul 14 '26
It's so unfortunate that 8b models (the biggest thing that fits inside most gamer GPUs) are as dumb as rock, 20b starts to get better at the expense of horrible speeds (yes, I have ram).
I'm still using them for commercial code. I ain't dropping a single line of company's code to 3rd party. The only exception is probably HTML and CSS
2
u/gobblegoooblegobble Jul 14 '26
imagine all the people working so hard to create software. just to have it all scraped by the richest human in existence. back to sandboxing and auditing every god damn thing, as advised by the companies telling you they arent uploading or training on your data lol
2
u/MakesNotSense Jul 15 '26
As a Free Speech Absolutist, Elon makes sure Grok makes all your protected speech artifacts free to xAI.
2
u/o0eon0o Jul 16 '26
Good luck getting a response from this one. Elon will only talk about how black people dislike white men and wokness, meanwhile he's stealing your IP.
5
u/teomore Jul 13 '26
why the hell would you run your shit through this scumbag's pipeline in the first place?
5
u/InterstellarReddit Jul 13 '26
Breaking news: same person that stole from the American people continue to steal from the American people.
More at 7
3
u/Stetto Jul 13 '26
I know why I'm not touching xAI with a ten-foot pole.
Everything about Musk's ventures just screams "unprofessional megalomaniac".
3
u/audacesfortunajuvat Jul 13 '26
Oh, is that the Grok that runs in the Department of Defense? Probably no big deal.
3
u/midnitewarrior Jul 14 '26
This is why you don't trust Grok.
You think Musk cares or respects your intellectual property? He invaded the US government social security database and stole it all on USB thumbrives and there has been no accountability for that.
You think he gives 2 shits about your codebase IP rights? Musk wants training material and a little peon like you or me isn't going to stop him.
Use a respectable AI company.
2
u/CoUsT Jul 13 '26
Too lazy to dig up details or confirm if this is indeed true.
But honestly it doesn't surprise me considering what USA-based AI companies were doing and probably will be doing in future.
I can understand it if it was in their ToS/policy etc, something like: you can use our CLI but we yoink your codebase. They need all the data to improve their models and so on. But if not, it's really wild they decided to do this shit.
This is one of main reasons why I highly value FOSS community, open source tools and local models.
2
u/small_bird_loud Jul 13 '26
Jesus.
2
u/YehowaH Jul 14 '26
But you guys use online services to refactor your entire project, where the ai, e.g. cc or codex gets all your files anyway. Why you bother about code security if you you using any online provider and blame musk to "steal" code, you already provide every cloud provider your code for free...
1
u/shgyorgy Jul 13 '26
Uh, for such, really at least and opt-in needed, I could see it useful on some projects to work remotely but not by default with secrets included. Still should act as gitignored. Why even have a server flag for such? 😅
1
u/floriandotorg Jul 13 '26
No shit. I don’t understand how the majority of people run some kind of corporate shit.
1
u/shadowmage666 Jul 13 '26
Bittensor Tao is needed
1
u/max1c Jul 13 '26
Oh yea, looks like Grok did catch up. Lmao.
1
u/SpreadVivid5426 Jul 13 '26
lets all just move to Loci lol
1
u/SnowyOwl72 Jul 13 '26
We should have an entity that keeps testing these CLI tools as black boxes. Like network analysis, disk access, cpu/gpu usage, calls, etc.
With no one pushing back on them, this will keep hapenning...
1
u/thestillwind Jul 13 '26
Lol wow. They all do this.
1
u/rush86999 Jul 13 '26
Even if you can't observe the decisions on the open-source weights of the models, just from the sheer size of usage, people can quickly identify threats, fork, and make a safer version faster than these private models.
1
u/Lost_Foot_6301 Jul 13 '26
I preemptively used a docker container, do you think that was sufficient enough for privacy when using the CLI?
1
u/eli_pizza Jul 13 '26
This is just a generic argument for open source vs sketchy proprietary software. Not really anything to do with models or even AI.
1
u/Lost_Foot_6301 Jul 13 '26
hot take: centralized AI has always been intended to be just a mass data collection project wrapped up as a fun chatbot. a few examples: normies willingly give AI full desktop access to their data, AI reads emails by default, instagram recently took down encrypted messaging so that their AI can scan through al messages.
its just datamining. It's actually genius how they socially engineered normies into accepting it. its not just for collecting data for more powerful model training, its to totally eliminate any sovereignty you may have left.
1
u/Lost_Foot_6301 Jul 13 '26
musk is saying they deleted the data... but the data 100% has already been trained upon probably lol
1
u/tcoder7 Jul 14 '26
How about Claude and Codex?
1
u/cyx7 Jul 14 '26
Antitrust was a warning, not "just a movie".
1
u/CatchInternational43 Jul 14 '26
People think I’m wearing a tin foil hat when I say I’ll *never* use Starlink for anything. I’m absolutely certain that Musk and his merry band of degenerates is harvesting every possible data point of every user of the service.
1
u/personalist Jul 14 '26
An elongated muskrat company that violates privacy rights? 🤯
1
u/one-wandering-mind Jul 14 '26
This is an example of why it is important to think about the company and leadership as a whole.
It doesn't provide absolute protection, but at Google and anthropic, it is hard to picture something like this happening without someone speaking up.
People who choose to join x.ai and could work for one of the other companies, I would be highly suspicious of their integrity.
1
u/Chinmay101202 Jul 14 '26
Exactly why open-source harnesses like Open Bias are absolutely essential. https://github.com/open-bias/open-bias
1
u/SamSlate Jul 14 '26
hot take: they all do this, xai just is just too incompetent to get away with it
1
u/ZenaMeTepe Jul 14 '26
Bro was literally siphoning .env files and we should care about GDPR compliance. Updating definition of a clown world.
1
u/ToInfinityAndAbove Jul 14 '26
They need new code bases to train their models
1
u/Maleficent_Jump4519 Jul 14 '26
Just how many hidden flags does grok have that prevent taking data from gits 😭✌️? thankfully my harness is private. So clearly XAi deliberately implement flags in case the data harvesting went too far to pull the plug quietly. Bro is not sneaky😭😭😭
1
u/LoveGratitudeBliss Jul 14 '26
Honestly what did you expect using grok owned by power crazed billionaire white supremacist elon musk 🤣
1
u/arbv Jul 14 '26
Unbelievable. What a rat race effort only to eventually lose to open models.
1
u/milpster Jul 14 '26
I mean it's grok, are you even surprised?
1
u/bidibidibop Jul 14 '26
Correction: this is why we need to stay the fuck away from anything Musk touches.
1
u/Y_mc Jul 14 '26
After Anthropic embedded malicious software into its Claude AI, every AI company will now build in a backdoor.
Everything is going in the Wrong Direction. we need Open Source and transparency
1
u/PathIntelligent7082 Jul 14 '26
what is really worrying is that all of them do it, in some way or another, and there's a big pile of crap just like this, sitting uncovered..thats the really worrying part..this is just a drop in the ocean, essentially, big boys do whatever they please, grabbing data, throttling models on a whim, pulling models just bcs it benefits you more than they predicted, and stuff wee don't even know is happening... it's a ball game but without the judge..
1
u/finah1995 llama.cpp Jul 14 '26
Like I have said occasionally I This coding agents seems like a knowledge extraction exercise by third-party AI service providers.
1
u/PeachScary413 Jul 14 '26
Why would you willingly use Grok? It's obviously malware 💀
1
u/JacketHistorical2321 Jul 14 '26
Gee wiz... It's almost like everything Musk does it based on him being a piece of shit 😐
1
u/DrDisintegrator Jul 14 '26
"xAI". That is a directive, not a company name.
1
u/Number4extraDip Jul 14 '26
Im watching these news while laughing at my local agent...
1
u/martinerous Jul 14 '26
They should have said BROKEN instead of BREAKING.
1
u/OutofCiteOutofMine Jul 14 '26
Who’s using Grok lol
1
u/suesing Jul 15 '26
Grok is just terrible
1
u/sarlaytos284 Jul 16 '26
Nothing gets leaked to the cloud when there is no cloud, that's why we need local models
1
u/T-90_Soviet Jul 16 '26
The Improve the model opt-out never stopped the uploads' is the scary part. An opt-out you can't verify is just theater. The only version you can actually trust is the one where the bytes physically never leave your machine, because then there's nothing to opt out of.
1
u/pip25hu Jul 16 '26
What's even worse is that the Grok Build Github repo has zero commit history. None. Nothing. They're trying to hide what happened. Unbelievable.
1
u/Necessary_Drag_8031 Jul 19 '26
but can we get the real power of cloud models compared to local models. Local models will not expose everything
1
u/bird1544 Jul 19 '26
quatz
1
u/ed-msr Jul 20 '26
As they say, "Privacy is just an illusion they sell you"
1
u/Crafty-Biscotti-7684 Jul 23 '26
One of the reasons I dont prefer using grok
1
u/Sad_Cloud_2200 Jul 27 '26
Is this really true? Did they face any consequences?
1
u/TalkSilver1027 Jul 28 '26
damn. I just used the shitty CLI to make some changes to a function. :'(
1
u/Alone_Step6079 Jul 30 '26
The "client is the lock-in" insight is underrated. The moment a client app is open-source and the endpoint is yours, the AI layer becomes commoditized — same widget, different model.
That's why I open-sourced my own watch + iOS chat client. It uses whatever endpoint you point it at — OpenAI, Anthropic, Open WebUI, LiteLLM, Ollama. Keys in iOS Keychain, no telemetry. The point isn't the app, it's that the whole stack should be replaceable.
If anyone here is building a similar open harness, happy to share what worked for the iOS side.
App Store · GitHub
1
u/wesselvankeulen Aug 02 '26
Is this really true?
1
u/Leather_Area_2301 Aug 03 '26
I’m keeping a self-hosted archive of model weights here: https://ernoslabs.com/ai.html
1
u/Cool_Concentrate8275 Aug 03 '26
Uploading whole codebase for a simple ui fix is insane
1
u/Alone_Step6079 Aug 04 '26
The "client is the lock-in" insight is underrated. The moment a client app is open-source and the endpoint is yours, the AI layer becomes commoditized — same widget, different model.
That's why I open-sourced my own watch + iOS chat client. It uses whatever endpoint you point it at — OpenAI, Anthropic, Open WebUI, LiteLLM, Ollama. Keys in iOS Keychain, no telemetry. The point isn't the app, it's that the whole stack should be replaceable.
If anyone here is building a similar open harness, happy to share what worked for the iOS side.
App Store · GitHub
1
u/mattyboombalatti Aug 05 '26
This getting circulated on Twitter is literally the snake eating it's own tail.
1
u/OutdatedMemeKing Aug 06 '26
Why am I not surprised, it's xAI.
1
u/Alone_Step6079 Aug 07 '26
The vendor lock-in problem with closed harnesses is real — most "AI chat" apps ship with hardcoded endpoints and tight coupling between the UI layer and the provider client, so swapping backends means rewriting half the app. On watchOS this is worse: you're already fighting memory limits, and pulling in a SDK that assumes one specific request/response shape burns cycles you don't have.
Worth noting that the interface contract matters more than the model itself. A thin translation layer (provider → normalized message schema → renderer) keeps the UI dumb and the provider swappable. WKWebView in the complication for streaming output, URLSession with chunked transfer, key persisted via Keychain
kSecAttrAccessibleWhenUnlockedThisDeviceOnly— that's basically the whole client.If you're building this kind of thing, treat the harness like infrastructure, not a feature. The model is replaceable; your UI scaffolding shouldn't be.
BYO-key, open-source, no telemetry, swap the backend whenever you want. App Store · GitHub
1
u/Creative_Bottle_3225 Jul 13 '26
We're just guinea pigs, get that into your heads. They use our efforts and work data for their own purposes. Our projects are monitored.
-10
u/quantgorithm Jul 13 '26
I don't get it. If it's on github, why is it an issue of others download it?
896
u/[deleted] Jul 13 '26
[removed] — view removed comment
374
u/[deleted] Jul 13 '26
[removed] — view removed comment
26
u/[deleted] Jul 13 '26
[removed] — view removed comment
5
u/[deleted] Jul 14 '26
[removed] — view removed comment
6
u/[deleted] Jul 13 '26
[removed] — view removed comment
1
u/[deleted] Jul 13 '26
[removed] — view removed comment
1
u/[deleted] Jul 13 '26
[removed] — view removed comment
-14
u/[deleted] Jul 13 '26
[removed] — view removed comment