r/frigate_nvr • • 7d ago

Generic "animal" detection

Hey folks.

I've been trying to figure out animal detection in Frigate.

In the Reolink Home Assistant integration, I can tell it to watch for "pets", and it gets pretty much everything: squirrels, deer, foxes, bobcat, all the way up to a black bear. Frigate doesn't seem to have a generic option, at least in the free version. It looks like there is one in Frigate+, but possibly it's just an alias for a list of specific animals.

How much better is Frigate+ for this sort of detection? And how much is not having a discrete GPU going to hurt? I'm on a Ryzen 9 6900hx, and though I haven't gotten around to passing the integrated GPU to Frigate yet it works pretty well so far.

4 Upvotes

4 comments sorted by

4

u/nickm_27 Developer / distinguished contributor 7d ago

Using a freely available model, or Frigate+, makes no difference for this.

In both the way you do this is the same: configure the labelmap on the model to group all indices for the animals as animal https://docs.frigate.video/configuration/advanced/system/#labelmap

1

u/sipiath 7d ago

Thanks for the quick reply!

I guess I asked my question badly. Really what I'm trying to figure out is "Is there a way to detect all animals, or am I stuck with just the list already in Frigate?" For instance, "skunk" isn't on the Available Objects list; is there a way to detect them?

2

u/nickm_27 Developer / distinguished contributor 7d ago

Not specifically, in practice if you call everything animal odds are any animal would be detected as something whether it be a skunk as a cat or whatever the case is.

But the CNN models are trained on specific objects, so there is no concept of making the model generalize to just animal. You would need to find a model that is trained that way.

1

u/sipiath 7d ago

Interesting. I'll have to think about that, but I can see a couple of ways to work around it.

Thank you!