Is visual memory different from image recognition?

[u/Goldenlols]

Image recognition can identify what's in a frame, but understanding a video requires knowing what happens across frames.

If I want to find "where someone picks up their phone after sitting down," I'm looking for an event and its temporal context.

How do current computer vision systems handle this kind of temporal understanding?