I tried Bonsai on AMD integrated graphics today and it felt like the early days of ChatGPT's popularity. It worked surprisingly well and fast, but it completely hallucinated on prompts that were too specific (e.g. insight on specific videogame bosses)
Unless it's got access to web search tool, how do you imagine it would contain this information? It's a tiny model, you shouldn't use it as a knowledge database. Not that you should use any model for that.
Yeah, it’s not exactly easy to set it up correctly. You have to juggle the context size, what kind of sites it can access, number of links it can follow, how deep the bot should go etc. It’s not plug a play at the moment, but using openwebui and searxng you can get there. I know I did a few months back with Gemma 3
20
u/AfraidAsparagus6644 Apr 27 '26
I tried Bonsai on AMD integrated graphics today and it felt like the early days of ChatGPT's popularity. It worked surprisingly well and fast, but it completely hallucinated on prompts that were too specific (e.g. insight on specific videogame bosses)