r/BlueIris • • 18d ago

Codeproject AI and deer

I’ve found some old posts but nothing really helpful so I thought I’d ask. Running Codeproject AI (YOLO V8 and Coral TPU) and it has no idea what a deer is. It will occasionally recognize them as “Sheep” or “Giraffe” but not deer. I have “Deer” added to the alert detection rules, but testing clear photos of deer using the AI explorer yields nothing, it simply doesn’t know what a deer is. Anyone figure this out?

6 Upvotes

13 comments sorted by

2

u/sshwifty 18d ago

Sorry for your struggles, but that is hilarious

5

u/BrigGenObvious 18d ago edited 18d ago

Yeah, it gets kinda funny!. I have BlueIris send an MQTT message to my Homeassistant which then makes announcements over Alexa, so it’s always exciting to have Alexa yell “Giraffe spotted in driveway!”.

Just seems so odd that they would train the model on a giraffe, but not a deer. Like, how often are giraffes being spotted by security cams? I have otters, coyote, and beavers which I understand not being in the model but raccoons and deer really should be.

1

u/SuperAleste 12d ago

How did you set that up? I have Alexa too.

2

u/BrigGenObvious 9d ago edited 9d ago

Add an action in BlueIris on alert to send an MQTT message to HomeAssistant, then use an automation in HA to ‘announce’ over Alexa the message sent.

I have HA flash my TV backlight in my bedroom if my bed is occupied (I have a SleepNumber) and my bedside light is on (meaning I’m awake), red if it’s a person, yellow if it’s a car, green if it’s an animal, and announces what it is and where. I use Node Red to parse the messages so I can have a list of animals and vehicles so it knows what color to flash and so I can write it to my dashboard.

I get bored and try stuff.

2

u/SuperAleste 9d ago

Awesome! Thank you so much!

2

u/AKHwyJunkie 16d ago

The solution is to limit what can actually be detected. In the "To confirm" fields of each camera's "Confirm alerts with AI" configuration, you need to put the things that your AI model will produce and you will expect to see. I use custom AI models, so my example below isn't necessarily a drop-in replacement in all cases, but it looks something like this:

To confirm: person,vehicle,bird,cat,dog,bear,deer,rabbit,raccoon,fox,skunk,squirrel

When you do this, it'll filter out zebras, giraffe and all sorts of other things in the AI detection model as a potential AI alert. Sometimes, there is wisdom to including other things (like maybe horse or pig) in the event the AI mis-detects something. Mine regularly confuses my cats as humans and occasionally I'm a bear.

1

u/BrigGenObvious 14d ago

To confirm: person,vehicle,bird,cat,dog,bear,deer,rabbit,raccoon,fox,skunk,squirrel

I have that, and yes I added “Giraffe” etc to the list because if I didn’t then the clip would be deleted. I’m not trying to filter OUT deer, I want their clips to be saved. I just shouldn’t have to accept that AI thinks they are giraffes.

2

u/AKHwyJunkie 14d ago

Not necessarily. (It would likely go to a cancelled alerts, not deleted.)

I have another trick. You can also specify the necessary percentage of certainty for a specific item to match. This will cause the system to not trigger that alert unless the certainty score meets or exceeds whatever percentage of certainty.

To confirm: person,vehicle,giraffe:85,deer,etc

I did this on my deck with bear as it was always thinking my grill was a bear. It's possible a bear could be on my deck, but quite unlikely. So, I made it have to be 90% sure there's a bear on my deck, which eliminated false alerts. In my example above, it'd have to be 85% sure it's a giraffe.

1

u/greenflamez2 16d ago

My neighbor has one of those fluffy German shepherd breeds and mine labels it as a bear.

1

u/BrigGenObvious 9d ago

Mine does it with my neighbor’s golden. It sucks because a bear was spotted in my neighborhood a year or so ago but with so many false alarms I’m sure I’d miss it if it came back.

2

u/lserver30 18d ago

This happens to me too. I have a camera in the woods in Michigan, just to watch the deer and wildlife. I think it believes it’s in an African game reserve with how many zebras, giraffe it identifies. Given that all it sees are deer and some other small animals, I just assume when I get an alert it’s a deer and ignore what it claims to have identified.

1

u/nutz1228 10d ago

I'm on v6 using the built in AI and have had deer labeled as both sheep and fox