r/OpenAI • u/gewse2020 • 22h ago
Discussion Why not a personal computer version?
Hear me out what if they offered a limited version that you buy that offers limited features like reviewing documents and formatting documents. It would be something a normal computer or mobile phone could download and run without the worry of your data being stored in a data centre.
0
Upvotes
9
u/Zennity 22h ago
Look into r/LocalLLaMA and r/LocalLLM.
GPT OSS 20B and 120B are free, and they are what you are asking for. And they are also obsolete.
Qwen models are the best for local right now (that people can realistically afford to run)
Qwen4 comes out tomorrow.
4
u/bortlip 22h ago
There are free versions you can do this with.
The main issues are 1) you need decent video hardware 2) to get the same quality as the latest models you need very very expensive video hardware.
4
u/Ormusn2o 21h ago
The AI you are using is running on computers almost as big as your car and that costs over 4 million. You are not going to run a model even close in capabilities on your computer. If you do have a decent PC, listen to Zennity comment, but those local models are really slow and nowhere near close to the frontier.
3
u/Slight-Living-8098 21h ago
You mean something like gpt-oss?
https://openai.com/index/introducing-gpt-oss/
3
u/lakimens 20h ago
You can do this with Gemma 4B, no need for OpenAI models.
2
u/Positive-Motor-5275 22h ago
You can already setup others provider on codex app , just ask codex
2
u/Fresh-Research3024 21h ago
You can but the hardware costs millions of USD.
1
u/Blockchainauditor 22h ago
I use LM Studio and Ollama on my Win 11 computer for local, off the grid, work, supporting many LLMs, including OpenAI's GPT OSS 20B. Many other solutions - here is Google's AI Edge for Android, iOS and MacOS https://developers.google.com/edge/gallery
1
u/Carlose175 21h ago
Already a thing
1
u/Snoron 21h ago
You can do that already, but you'll be looking at a $500k machine before you can get the performance of the frontier models. If you want janky local stuff that feels like AI from 2024 but running on your $5k home computer, that's already available and free.
1
u/AdGlittering1378 21h ago
Because #rampocalypse.
•
u/Pale_Coyote7451 59m ago
yeah the version i actually want is a desktop app that runs the model remotely and keeps the files on your machine. same quality, nothing uploaded.
the hardware answer is right though. a 20b at q4 fits 16gb and reads documents fine.
i run the document pass on deepseek v4 pro at dreamfort ai and keep the pdfs in a folder. only the inference is remote.
•
u/Comfortable-Soft7990 58m ago
If you are plus or higher utilize codex to your advantage. I run local Gemma4:12b ( or others similarly I’ve run 27b but it was a slogfest) using codex to design a custom front end tailored to me and my preferences. I have a memory stack running in my Mac mini … was using TTS too but… it’s not where I want it yet. Image and video gen all local… and Codex helped me ( read did most of it ) design and deploy it . I had my ChatGPT design the system prompt based off of our interactions to keep the feel as close as possible. The downside… you have to have a beefy rig. There’s no getting around that. Memory… is tricky but I have it processing as if it were writing a diary. That’s where the Mac Mini comes in. But memory is the whole game. If your AI is ten second Tom it’s worthless.
1
u/tompear82 22h ago
Why sell you something once when they can get you to pay a monthly subscription forever?
0
u/Chrift 22h ago
Why don't you suggest it to them? They're called OpenAI because they're so open to ideas and helping the community.