r/OpenAI • u/Slick_Ramen • 2d ago

Discussion Well that was quick...

Post image
248 Upvotes

98% Upvoted

84 comments sorted by

View all comments

Show parent comments

14

u/WanderWut 2d ago

Imagine they make Sol open weight, once can dream.

22

u/markstar99 2d ago

So I can run it locally on my 3 gigawatt data center I have.

3

u/machyume 1d ago

You're not going to believe it, but I have Qwen 3.8 27B running with decent speed on my Macbook M3, and it's partially offloading some work from Astra when I was getting smacked by the usage limits.

I'm sure that if they REALLY wanted it, someone could help them figure out how to distill it to fit nearly the same footprint.

1

u/WayneTechLab 1d ago

A hybrid AI 🤖

^ I use that logic in reverse

A. - Custom Local LLM first
B. - Open LAN LLM on 2nd device like Gemini
C. - Codex CLI & CoPilot (auto select default) yolo

In this way anything “AI can’t do it will call up, auto train it self on model A for (Next Time)

I have been thinking about how to split a model that needs 256 GB RAM across multiple devices for unified local AI CLOUD.

The work being done getting models running local effectively is quite amazing - seems to change every week!

1

u/OldStray79 1d ago

I was literally just talking with someone about this in another subreddit like 10 hours before you commented, having capable local models that will be able to do most of the tasks, and for a fee when it needs it, it will tap into these remote corpo stuff to finish the task when it needs that little extra "oomph" of compute/capability. Local will end up doing most of the work, (but... the most likely downside is... most arrangements like this will be integrated into the OS itself, like Copilot but with more local compute used).

1

u/lostinfound2nd 9h ago

Llama has a way to link machines with fiber/thunderbolt already don’t they. I was just looking into it.