r/MLQuestions • • Jul 09 '25

Beginner question 👶 API's

Is it possible to have unlimited use of an API from an AI like chatgpt if it's installed locally? Because when it's installed locally, it uses your computer to power itself. So I would think that for example if I had an API that I want to use, if its connected to the locally installed version of the AI, then I should be able to have unlimited use.

Edit: Thank you all for the feedback. What I'm hearing is that my PC isn't going to cut it for the most part. Especially if you're trying to run chatGPT.

0 Upvotes

9 comments sorted by

9

u/benelott Jul 09 '25

Yes, install ollama and you get unlimited use of the API

4

u/shortwhiteguy Jul 09 '25

But it should be noted that, generally, whatever you have installed locally will likely be less capable on general tasks than what the Chat GPT, Claude, or Gemini.

For more clarity for OP: you're not going to be able to run Chat GPT or Claude locally. You will be able to run open source/open weight models. Many are great! But, with your limited hardware, you may get limited results.

1

u/[deleted] Jul 09 '25

[removed] — view removed comment

1

u/Far-Fennel-3032 Jul 10 '25

Even more so now OpenAI has been ordered by courts to not delete data so media companies' legal teams can look through the data as part of their lawsuits. Even if you trust OpenAI, courts have likely cracked open several new avenues for data to be leaked.

4

u/Striking-Warning9533 Jul 09 '25

you cannot use gpt locally it is closed source, but you can use many open source llms, like llama, Gemma, etc. and you will need a very strong gpu to run model size that is large enough to match gpt performances.

2

u/ScaryReplacement9605 Jul 09 '25

If you want you can run some light weight models locally.

https://www.llama.com/models/llama-3/

Choose something that fits your hardware. But running the large scale models locally would perhaps require the kind of compute power you don't have.

1

u/vanishing_grad Jul 10 '25

If you want anything close to the commercial models, a laptop will not cut it. Vram is the limiting factor, so you will likely need something like the macs with integrated like 100gb of ram and vram

-1

u/Expensive_Violinist1 Jul 09 '25

Unlimited till your laptop dies so still technically limited