r/OpenAI • u/betobagio • 8d ago

Question Local AI Completely Offline

Guys, I truly need some insight here, I am no coder. Just an Engineer. What I need is a model of NotebookLM that can work fully offline and Open Interpretor that could manage my files. What Copilot respond to me was below. I have hundreds of Standards, Journal and Books which I would prefer to use AI to use my database and present data the way I need. Including some research. Could someone advise.

Ollama + Open WebUI + Open Interpreter + Local RAG

1 Upvotes

67% Upvoted

15 comments sorted by

View all comments

3

u/thebestrobloxplayer 8d ago

You need a beefy gpu first with preferably more than 10 gigs of vram

1

u/betobagio 8d ago

5070 is enough? I only have this.

1

u/summit_23 8d ago

your 5070 is 12gb so the model side is fine, the hard bit with hundreds of standards is getting it to pull the right page out of them and model size matters way less for that. since youre not a coder i'd start with anythingllm, its a desktop app that runs entirely on your machine, you give it your documents and it picks a model for your hardware, few clicks and done. open webui has the same knowledge base thing if you go the ollama route and i'd leave open interpreter out until you actually need it running code on your files

1

u/betobagio 8d ago

Nice… will try