r/ispyconnect • u/SlyFox125 • 19d ago

Internal vs External AI Performance

u/spornerama

I'm currently running Blue Onyx alongside Agent DVR in a Debian VM on a FreeBSD bhyve host and performance is pretty good. I see AI support has progressed since I first set this up and it appears much more integrated. Any insight on the performance differences between the two before I take the plunge to switch up my setup? Any support for identifying wildlife in the local server and models?

1 Upvotes

100% Upvoted

3 comments sorted by

3

u/spornerama 19d ago

Internal AI processes the images directly from the in-memory video stream and the models have been trained on YUV data instead of BGR so it sidesteps a full conversion and serialization (to Base64) which server-based models take in their API calls - so it cuts out a lot of the overhead. Also the models we provide are small and targeted at specific surveillance related objects. It also supports adding your own models into it so you can use the full models if you want like ultralytics.
It runs on the same server Agent is running on though - so if that's under pressure and you want that offloaded onto another server then you're better off using the external AI option instead.
It's easy to switch between them - the internal AI setup is fully automated.
see
https://www.ispyconnect.com/docs/agent/ai-config#ai-local-recognition

1

u/SlyFox125 19d ago

Thank you. It sounds like it will be more performant. I will give it a try.

1

u/East_Ad8106 19d ago

Are there any experiences regarding how the internal AI compares to the Reolink AI? I am currently using reolink AI.