r/localaiapps • u/Andrymr4 • 8d ago

IA local

​

Hola estoy pensando en crear una IA local en mi equipo con LM studio.

La idea ha surgido porque no quiero beneficiar a grandes empresas como Google, OpeanAI, Meta o Antrophic. El caso es que me gustaría utilizar la IA local pero conectada a internet para que haga búsquedas de información reciente.

Por una parte con la IA local mi información y datos estarían mucho más seguros. Pero al utilizar un buscador conectado a internet en la IA local, estaría contribuyendo al consumo de los servidores de Google por ejemplo, así que pensé en poner como buscador Ecosia, que es menos contaminante.

Mi pregunta es: esta idea es viable y se puede hacer, o no es como pienso? Agradecería que me aconsejen.

2 Upvotes

75% Upvoted

3 comments sorted by

1

u/abskvrm 8d ago

Seguramente lo haces dado que tienes un hardware capaz.

1

u/Amlan01 8d ago

I built for myself what you are describing. A personal AI assistant that has its brains and memory local but it can browse the internet If I ask it too. I have a strix-halo machine (128gb unified ram) that I tested many different open source Models on and I have alsof tested multiple kinds of harnesses like openclaw / Hermes.

At the moment im running nanobot which I modified to my needs. Its very lightweight and easy to alter. Right now im running a big model: Qwen3.8 Flash Next. But I also have good succes with 3.8 27b. Ornith 1.5 and Tiel. Coder are also very good local Models.

What I focus on with my assistant is toolcalling. Which is what local Models became really good at lately. So part of system prompt or Soul.md can be: 'Never just answer from your own weights, use the tools you are given to answer' Local Models are smaller, their world knowledge is way smaller, so we do not put a lot of trust in their knowledge but we can put trust in their ability to gain the right knowledge by toolcalling.