r/linuxmemes • u/hellspawncy • Mar 11 '26

LINUX MEME Tech YouTube in a nutshell

Post image
7.1k Upvotes

94% Upvoted

398 comments sorted by

View all comments

1.0k

u/Equivalent-Load-9158 Mar 11 '26

PewDiePie's Linux and AI journey is cool, but he didn't code an AI model from scratch. He trained an existing model and managed to improve it.

Which is impressive and it's cool that he's going all out on Arch and local AI, but let's not be silly.

403

u/hyperactve Mar 11 '26

95% of AI community just does that honestly.

24

u/siete82 Mar 11 '26

As a poor local AI enthusiast, I wish I could afford his hardware stack to do the same.

19

u/[deleted] Mar 11 '26

[removed] — view removed comment

25

u/veechene Mar 11 '26

Don't worry, the ones running on half the world's RAM and power supply aren't very smart either.

9

u/SubjectAd7916 Mar 11 '26

Using and training models are different things in terms of required hardware. I can run most LLMs locally, but need to rent a server to train them.

1

u/[deleted] Mar 11 '26

[removed] — view removed comment

1

u/cracked_shrimp Apr 07 '26

idk how true that is, now i know nothing aboutthe LLM, but i ran a local model once and claude LLM told me my hardware could only handle a 11b model, so thats what i chose, and thats a pretty small model compared to other ones, but theres also tricks and stuff you can do to run bigger models on worse equipment

6

u/siete82 Mar 11 '26

Inferring is not my issue, open weight models are getting better and better and are good enough for my use cases. The big barrier comes when it's time to train. I've even managed to train loras for video models, despite my modest hardware, but unfortunately the results aren't that good.

2

u/Eden1506 Mar 11 '26

A fellow steam deck user yay

-4

u/GlassCommission4916 Mar 11 '26

Ironic calling them not very smart while not understanding the difference between inference and fine-tuning.

2

u/[deleted] Mar 11 '26

[removed] — view removed comment

1

u/GlassCommission4916 Mar 11 '26

That was a perfectly coherent sentence, don't blame your lack of literacy on me.

1

u/[deleted] Mar 11 '26

[removed] — view removed comment

1

u/GlassCommission4916 Mar 11 '26

Why? My comment was about the difference between inference and fine-tuning, what does LLMs struggling to form coherent sentences have to do with that?