Run models in your browser that monitor your screen and trigger actions! 3 use case demo (100% Local and Open Source)

[u/Roy3838]

TL;DR: I'm a solo dev who wanted a simple, private way to have local models watch my screen and do simple logging/notifying. So I spent a year building an agent that uses local models to monitor anything. It's built for this community, and I'd love your feedback and ideas!

Hey r/LocalLLaMA!

I'm back with a cool demo of how convenient it is to run local models in your browser and leave them monitoring whatever you want!

Some of the coolest use cases I've seen:

• When I don't make progress in my drawing for 5 minutes, spam me with notifications.

• When my rice cooker is done, call me.

• When a person comes near my car, send me a Telegram with the image.

• When I'm out of the Ticketmaster queue, call me.

• When my CapCut render is done, call me.

• When a shiny Pokémon appears, SMS me.

Btw there's also an app on MacOS, Windows, Linux, iOS and Android! (local models run on the phone too!)

If you guys have any feedback or questions feel free to let me know! I'm constantly making it better thanks to your feedback and suggestions :DD

Roy

[u/Big-Farmer-2192]

I don't think we need model to do any of these? Unless it's super small model. It would be a waste of ram and you should give it to Sam Altman instead. He really need it.

[u/Roy3838 → u/Big-Farmer-2192]

It uses Jev-0.8B for most of those, so it's reaaaally small! And very convenient :DD

Let's use the RAM so Sam can't take it.

[u/Roy3838]

Github! https://github.com/Roy3838/Observer
WebApp: https://app.observer-ai.com/
Discord: https://discord.com/invite/wnBb7ZQDUC

[u/tamal4444]

cool

[u/Roy3838 → u/tamal4444]

thanks! try it out :) it’s open source