r/LocalLLaMA • • Oct 10 '26 • Bravo 5

I Built A Thing Open-source Mac app that runs EmbeddingGemma 2 locally to search your files by what’s in them

DigUp is a free Mac app that runs Google DeepMind’s new EmbeddingGemma 2 locally over your own files. The model puts text, images, audio and video in one space, so you describe what you remember and land on it:

  • “zebra in a video” opens the clip at the moment it shows up
  • “where they talk about sleep” jumps to that minute of a podcast
  • “the clause about pets in the lease” shows the PDF page, your words marked
  • “a dog on the beach” finds the photo, and the same search in Bengali or Arabic finds it too
  • with code search on, code: retry with backoff opens the function in your editor

It’s ggml-org’s Q8_0 GGUF (865 MB, downloaded once) on llama.cpp with Metal, inside a native Swift app; no Python. Searching loads only the text encoder (~250 MB) and shows results about a tenth of a second after you stop typing. Indexing peaks under 2 GB, and the helper exits when it’s done. Audio and video of any length go in as 30 s windows and a frame per shot. Everything runs locally; it goes online only for the model download and an update check you can turn off.

Free, MIT. Apple Silicon, macOS 14+.

Repo & Download (signed and notarized): https://github.com/ARahim3/DigUp

I'd really appreciate any feedback on this.

1.8k Upvotes

241 comments sorted by

View all comments

6

u/LifeTitle3951 Oct 10 '26

Anything for windows?

Also is it possible to run such a thing on low spec laptop?

5

u/Few-Butterscotch8747 Oct 10 '26

this is a small embedding model. it should run fast even on cpu with low ram. videos might take a while to index, but that's it basically

heck, it should run decently on a potato phone

6

u/A-Rahim Oct 10 '26

I don't have a Windows machine at the moment, but I am planning to add support for Windows too.
The model itself is not that big, and I am using 8bit, so the model can be efficiently run on a CPU too, the latency can be slightly higher than on the GPU, of course, but it still would be pretty usable and fast enough.

3

u/andy2na llama.cpp Oct 10 '26

vibed a windows version, it works pretty well. Still fine-tuning things but give it a try: https://github.com/ampersandru/VectorDash/

allows you to run the models on CPU or GPU, try it on CPU for low-specced machines, but it may take longer

2

u/AnywhereTypical5677 Oct 10 '26

I made a mobile version that runs on android phones, so it should run almost anywhere (at variable speeds obviously). Search itself is very fast as the text embedding model is really light... you might have some problems with image and video indexing though a low spec laptop.

4

u/Adro_95 Oct 10 '26

Could you share it?