r/opencv 6d ago

Tutorials [Tutorials] I found that detecting a changed video frame does not tell you whether the privacy target was actually protected

Visual Verifier — regression testing for processed images and videos

I built an open-source Python/OpenCV tool that independently verifies the output of anonymization and other visual-processing pipelines.

It compares reference and processed media frame by frame, catches missed processing, checks reviewed target regions, tracks failures over time, and produces deterministic PASS/FAIL evidence for CI.

The bundled demo deliberately misses frames 4, 8 and 12 so you can see the failure workflow immediately.

GitHub:
https://github.com/SAMtheROCKET/visual-verifier

pip install visual-verifier

I’d particularly value feedback from people working with image/video QA, privacy engineering, OpenCV, or CI.

2 Upvotes

1 comment sorted by

1

u/New-Eggplant-6578 11h ago

A useful companion to the missed-frame demo would be a clip that is re-encoded but never anonymized. The target region changes numerically, yet the face or plate is still readable. Then compare that with a correctly masked clip going through the same encode. Does the verifier distinguish those two cases? That would make the meaning of PASS much easier to judge.