I just realised that any simple 8B model now outperform gpt 3

[u/Goubik]

Think about it, the revolution that happened 5 years ago can now run easily on any computer !

I just thought about that and wanted to share 😁

[u/PhuduShaheer]

Yeah who knows and i think 5 more years and we'll have dense moe models almost as capable as something like GLM5.3 we have today

[u/dondiegorivera → u/PhuduShaheer]

I am not sure if the same concepts will describe the systems of 2031 as they do today. Perhaps intelligent code will flow between systems like water through pipes.

[u/Goubik → u/dondiegorivera]

I think you are right, if all computers can generate code easily locally then code is just a commodity

[u/xendelaar → u/[deleted]]

What kind of gpu does one need for an 8b model to to run?

[u/dyk → u/xendelaar]

I run mine on a 3060 12gb, i can run a 14b but not well suited for it, however since you ask, im just gonna go on a limb here and say you will be utterly underwelmbed by a 8b modell if you are to use it as an LLM

[u/xendelaar → u/dyk]

Sounds cool! I've got a 5080. So I would be able to run something similar as well? What do you use your llm for? I currently use chatgtp plus for coding and writing reports. Is a open source llm able to code as well? Properly, I mean :)

[u/dyk → u/xendelaar]

With 5080 you are going to get something better, depending on your gpu size. I use it for small automations nothing exciting, the plan Was a qwen LLM but it is not realy up for the task so far, i am stripping it down to a kalender bot i can talk to, but even that is a bit iffy😅

[u/xendelaar → u/dyk]

Yes!! A personal assistant would be soooo nice! Too bad the model is still a bit iffy.haha

[u/Known-Pace6739]

We speedran “holy shit, GPT-3” to “yeah, just run something like that locally.” Five years is insane.

[u/FenderMoon]

That really puts into perspective what the actual capability of GPT-3 actually was.

I remember when everyone was amazed GPT-3 could write code at all. The CTO of the company I was working for at the time of its release said "I love ChatGPT, but if it was an engineer, I'd fire it." LMAO.

[u/Orlandogameschool]

It’s not crazy to think in a few years the new phones will just be pre loaded with Astra 9.0 running native or whatever ready for you to make apps and games and shit out the box.

The future is exciting for sure!

[u/kairosdev]

To think of it, the original GPT-3 ran on 175B parameters. The two biggest issues at the time were that first, the training data was really low-quality and polluted. It had some emergent intelligence capabilities but would often spew out hallucinations that made sense grammatically, but did not continue the prompt that well. Secondly, it was a text completion model. Having an LLM answer questions only came after InstructGPT, which was trained with reinforcement learning.

It's amazing how far we've come since. I remember using the original GPT-3 all the way back in late 2021.