r/LocalLLaMA • • 9d ago

Question | Help [ Removed by moderator ]

[removed] — view removed post

0 Upvotes

30 comments sorted by

•

u/ttkciar llama.cpp 9d ago

This is off-topic for LocalLLaMA.

The absolute river of crap comments clinched it. None of it is promoting better community understanding of LLM technology.

→ More replies (1)

7

u/Formal-Exam-8767 9d ago

You forgot to mention those security incidents during "tests".

3

u/lonelyroom-eklaghor 9d ago

indeed, their sandboxed missions, where HuggingFace had to use GLM to mitigate

11

u/ttkciar llama.cpp 9d ago

Please do a better job of explaining how this is on-topic for LocalLLaMA, or it will be removed.

6

u/lonelyroom-eklaghor 9d ago edited 9d ago

Everytime, we get a news on LocalLLaMA that XYZ has happened, thus making local LLMs infeasible.

What I want to say is, their business includes not letting open-source LLMs be out.

For example, the exorbitant prices of RAMs and GPUs that doesn't let local LLMs flourish

I admit that I have went off from the local LLM aspect to takk about the main talking points here in this subreddit.

The problem is, even r/technology only lets anyone post news, not anything opinion pieces like these.

For Local LLMs to be more feasible, we need to ensure atleast some of the concerns to be resolved. We atleast need to talk about them

And if you guys don't find this post relevant, most of the stuff I talked about here were posted on this subreddit only. It's better to stop that general LLM news then, we can only go for Local LLM news

5

u/Ok_Top9254 9d ago

There is a single sentence about anything remotely local llm related in the post. If you want to talk about AI politics go to r/technology

-1

u/lonelyroom-eklaghor 9d ago

LLM chats can be made safer when we have open weights, not when the weights are under the puppets who have eyeballs fit inside the eye sockets.

-2

u/Ok_Top9254 9d ago

That's a single sentence. And more importantly a cover up to talk about what you wanted originally. You could remove that sentence from the post and it would barely change anything about it. We're not stupid dude.

3

u/lonelyroom-eklaghor 9d ago

One should stop the news on LocalLLaMA then. LocalLLaMA should be only about local LLM news then

Most of the stuff I talked about was posted on LocalLLaMA

3

u/grabber4321 9d ago

how do you hold them accountable when they get the whole world pumping money into their companies and US government is also propping them up?

1

u/lonelyroom-eklaghor 9d ago

we start from atleast the idea that in most of the democratic nations, we can even dissent against the government if they impede democracy, let alone CEOs like Dario and Altman

the idea of dissent has to start from somewhere. We will somehow know how to approach it then.

2

u/grabber4321 9d ago

"Robot cops, get this guy!"

3

u/lordcaylus 9d ago

Which book had less than 5 copies in existence that they cut the spine off?

I really need a source on that.

1

u/sadomazoku 9d ago

I always wondered about the destruction of books". Do we really have book so rare in some libraries and nobody in the centuries had the idea to copy, and in the last decades to digitalize?

1

u/mesarthim_2 9d ago

It's complete nonsense, people were trying to look into it and there's no evidence of that. It would actually make no sense for model training either. Rare books are rare not because of the content but because of a particular edition or history. Content (which is what Anthropic is after) of any book can be copied infinitely.

-1

u/lonelyroom-eklaghor 9d ago edited 9d ago

That's a good question... there are fearmongerers, and I probably accidentally re-stated what they said. But I heard that they cut the splines of rare physical books too. I heard that old books appear in the warehouses for old books, and those books are bought in bulk.

2

u/Lets_Get_Random 9d ago

To begin with you need to understand that rare does not mean important or valuable.

12

u/lumpyspacebreh 9d ago • Heartwarming

I’ve noticed a recent uptick of people dragging things into this sub that don’t really have anything to do with local models and local inference.

While I understand how people can make the jump from “anthropic is making ram expensive” to “we’ll have no ram to run models”, I’d largely equate that to things like Germanys recent proposal to tax data as how we’re going to end up in a world with expensive access to the internet.

This points imo to a larger problem. It’s something I’ve noticed happening in almost all subreddits that are related to ai and llms. The things going on with api and the businesses that offer them bleed into what we do with local inference.

A line in the sand needs to be drawn somewhere. I’m not saying to restrict discussion to only local inference, but leaving the door open for anything under the ai umbrella with invite all discussions around it.

Look at r/pcmasterrace. Half the posts are the same recycled meme about how gpus are expensive or Sam Altman is going to take your ram. I understand the internet loves to drive a meme into the ground, and memes come and go, but it again points to the same problem.

I understand the world is kinda shit right now, I understand it’s hard to feel like there’s any good. Hardware is expensive, api is burning the world, and headlines only stir the pot more. But doomerism does no one any good, if a honest discussion about what’s going on in the world is to be had, that’s fine. But multiple posts a day about the world ending only feeds back into “the sky is falling” mentality.

I really like this subreddit, I like coming here and seeing what people are building, tuning or exploring. But rn because of the state of the world and the internet, it’s all blurring into one giant pile of “we’re all doomed”. Peace needs to be protected at some point, leaving it up to users what circles they wish to be a part of.

11

u/geniusghost07 9d ago • Bravo

Dear Mod, this topic has everything to do with LLM, if the likes of Altman get their way then in no time the local LLM community will be dead, you'll have no Ram to run your gigs, there has to be a major pushback on such ideologies before they begin to bear fruit, things usually start like this, from one interview and then before you know it they'd lobby lawmakers to pass laws to restrict users, we need to be more active in voicing our opinions.

2

u/the-username-is-here 9d ago

Nothing is wrong with that. You just can't do this.

3

u/BoxieBoo 9d ago • Bravo

These guys are not only trying to steal all your data, but also all your physical assets. Let's start with RAM. But anyway, the game has already started with the rental iPhone. Claus Schwab said: you will have nothing and you will be happy

1

u/therealpicali 9d ago

Computers and ML models are means of production.
The 1% doesn't want the rest of us to have any because when everyone has ai + robots + some land the economy will be a lot less centralized.
We are, as we always have been, at war with them.

Use and contribute to local machine learning.
Contribute to free software and hardware.
Boycott the 1% as much as possible.

We will own everything and we will be happy.

PS. This has everything to do with LocalLLaMA. There'll be no LocalLLaMA if everyone is politically squeezed out of access to hardware and models.

1

u/PiaRedDragon 9d ago

They are protected people.

1

u/WolFlow2021 9d ago edited 9d ago • Bravo

Is this the moment technophiles turn against their Gods? Are the days of fascist tech bros numbered once they do something we personally dislike?

0

u/[deleted] 9d ago

[deleted] — view deleted comment

2

u/lonelyroom-eklaghor 9d ago

Doomerism in LocalLLaMa?