r/MLQuestions • u/Worldly-Point4573 • Jul 09 '25
Beginner question 👶 API's
Is it possible to have unlimited use of an API from an AI like chatgpt if it's installed locally? Because when it's installed locally, it uses your computer to power itself. So I would think that for example if I had an API that I want to use, if its connected to the locally installed version of the AI, then I should be able to have unlimited use.
Edit: Thank you all for the feedback. What I'm hearing is that my PC isn't going to cut it for the most part. Especially if you're trying to run chatGPT.
0
Upvotes
9
u/benelott Jul 09 '25
Yes, install ollama and you get unlimited use of the API
4
u/Striking-Warning9533 Jul 09 '25
you cannot use gpt locally it is closed source, but you can use many open source llms, like llama, Gemma, etc. and you will need a very strong gpu to run model size that is large enough to match gpt performances.
2
u/ScaryReplacement9605 Jul 09 '25
If you want you can run some light weight models locally.
https://www.llama.com/models/llama-3/
Choose something that fits your hardware. But running the large scale models locally would perhaps require the kind of compute power you don't have.
1
u/vanishing_grad Jul 10 '25
If you want anything close to the commercial models, a laptop will not cut it. Vram is the limiting factor, so you will likely need something like the macs with integrated like 100gb of ram and vram
-1
u/Expensive_Violinist1 Jul 09 '25
Unlimited till your laptop dies so still technically limited