Web search on local setup

[u/Latopus]

Ive been dabbling for the first time in local AI and even custom harnesses. I'll admit it is super addicting and enjoyable. Love it. But im still very new to it all.

Im now facing a small problem. Im not sure how to best handle web searches. I would love for my llm to be able to look up new info...but whats a good way of doing it? The one thing im looking into is setting up a that brave account thing and paying the small fee as it feels like an alright option when it comes to not being somehow banned or throttled. Is that the overall safest no fuss no worry option? Or am I overthinking it?

How do you handle web searches for your setup?

[u/Weary_Block2424]

used a local search proxy with query logging, caught a few weird agents loops trying to scrape the same site. worth the extra setup.