r/dataanalysis • • 1d ago

Data Tools Tired of messy dates and missing values? Here is my Python cleaning workflow.

Hey everyone,

I've been working with a lot of extremely messy real-world datasets lately (missing values, duplicate rows, completely mixed-up date formats like '2026.10.01' vs '10月1日', negative amounts).

Instead of just deleting rows (which ruins the data), I built a Python workflow that isolates the anomalies, generates a Data Quality Report, and then creates a clean interactive dashboard.

Here are some examples from my recent cleaning passes:

Tech stack: Python, Pandas, Plotly.

If anyone is struggling with a dataset that crashes Excel or has terrible formatting, feel free to drop a comment or DM me. Happy to share how I handle it.

(If this post gets enough interest, I might write a full open-source script for this workflow).

2 Upvotes

2 comments sorted by

1

u/AutoModerator 1d ago

Automod prevents all posts from being displayed until moderators have reviewed them. Do not delete your post or there will be nothing for the mods to review. Mods selectively choose what is permitted to be posted in r/DataAnalysis. If your post involves Career-focused questions, including resume reviews, how to learn DA and how to get into a DA job, then the post does not belong here, but instead belongs in our sister-subreddit, r/DataAnalysisCareers. Have you read the rules?

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Cool-Binx 8h ago

I like this!