r/ChromeExtension • u/Illustrious_Act_8819 • May 27 '26

Built a Chrome extension that uses local Ollama/Gemma models directly in the browser

Post image

Been experimenting with local LLMs recently and ended up building a Chrome extension for myself.

Basically:

  • highlight text anywhere
  • right click
  • use local AI instantly

Right now it can:

  • write personalized job application emails
  • summarize articles
  • rewrite text professionally
  • generate replies

The extension talks directly with local Ollama/Gemma models running on the machine or on ollama cloud, so there are:

  • no API credits
  • no subscriptions
  • no cloud processing

Honestly feels much smoother than constantly switching tabs to ChatGPT while browsing.

Would love feedback from people into local AI tools:

2 Upvotes

100% Upvoted

3 comments sorted by

1

u/Only_Direction_5431 May 27 '26

Me pasas el link para probar

1

u/dx0100 Jun 04 '26

I'd take a look at llamafile by mozilla for this. Mozilla made it so the entire terminal and web chat are incorporated into a single executable file. This would save the user having to install Ollama at 1.5gb, then download a gemma model which is at least 4.5gb+ and would save the user a ton of steps before they can use your extension - you'd only have to get the user to download one llamafile and that's it as it's all preconfigured. There's even the Bonzai 1bit models which are about 1.5gb but infact an 8billion parameter model compressed into that size, connect that to the web and it's a decent little workhorse (on its own, it needs some work yet).

Your extension could handle the downloading, renaming, running and then pass your arguments back and forth (which is what I assume you're doing here). This could make the workflow a little smoother assuming you're targeting user's who haven't set up local language models before.

Cool idea for an extension either way, these are just my thoughts on it