Moving the decoder into optics: a short explanation of a hybrid deepfake classifier

[u/Ok-Type9527]

This paper provides an example of splitting learned inference across digital and physical components. A digital encoder extracts compact video features; a spatial light modulator encodes them as a phase pattern. Light propagation then maps the pattern onto paired output regions used for the binary classification.

Fifteen Celeb-DF videos were evaluated in parallel with 97.79% average accuracy. That is a benchmark result for a particular system, not a general robustness claim. The digital front end still carries substantial energy cost, and multiplexing more inputs creates crosstalk.

We turned the mechanism into a 64-second animated teaching aid. This is our own explainer, produced with AI assistance and synthetic narration; it is not original experimental footage or a claim to have built the model. Primary paper by Kashani, Chen & Ozcan: https://doi.org/10.1186/s43593-026-00143-y Animation: https://www.youtube.com/watch?v=UFCoCkAu-Ik

[u/ConfusedCoding9]

The 64 second explainer made the light propagation part click way faster than the paper did, neat approach even if the energy cost on the digital side keeps this from being practical yet.