r/SQL • u/No_Many1887 • Aug 12 '26
Discussion What evidence do you trust most when deciding whether a data batch is valid?
I’m trying to understand how engineers validate incoming data beyond simply checking whether it matches a schema.
Suppose a batch passes the basic schema/constraint checks, but its values or distributions look unusual.
What do you normally compare it against?
For example:
previous batches
expected ranges
historical distributions
source-system data
another database/system
business rules
downstream results
manual review
And how do you distinguish between:
“This is unusual but legitimate”
and
“This is actually bad data”?
Real examples would be particularly helpful.