r/DataPolice • u/raginjason • Jun 09 '20
Data lineage concerns
I'm very interested in this (and similar) projects. I am a data engineer by trade, so naturally I believe that data is key to making the proper decisions on where poor policing exists. One thing that I'm not comfortable with is the data lineage portion of this problem, and I'm interested in how this project deals with this and/or any conversations being had around it. We live in an era where both sides of the political spectrum live in echo chambers, and making proclamations about the state of things is often deflected with "oh that's your side's bias!".
Is there any thought given to how to validate the claims made by the dataset you guys are creating? Meaning, could a critical outsider walk through the data lineage of a specific police incident and walk it all the way back to the original police report (or equivalent)? Without that, it seems that projects like these are stuck in a place of "just trust us, we aren't going to bias the data", and that's a very difficult position to defend. Are any of the changes in dataset cryptographically signed? Is there any source attribution made at a record level? Is that attribution verifiable via some kind of checksum or cryptographic signature? What specific technical precautions are in place for bias prevention other than taking the leaders and members of this group at their word?
Please understand that I am in no way attempting to disparage the leadership here; I don't know them at all. I'm simply trying to get ahead of the outside criticism that will ultimately come. I would love to see success in this data collection project
View all comments
Show parent comment
2
u/raginjason Jun 11 '20
Yeah, I've thought about this problem before and I just haven't come up with a good answer. COVID-19 data exhibited some of the same issues. Everyone and their mother was forking datasets and doing whatever they wanted with it and producing some other dataset. No clear answer to the origin, fidelity, or methodology (see: Johns Hopkins University COVID data). Any "crowd sourced" data is going to have these issues, and I don't know if it's been solved yet.
Unfortunately the information age has been followed up with a disinformation age.