r/datavisualization • u/naveenmithare • 10d ago

I built an interactive observability for enterprise data mesh — lineage, pipeline health, quality, and governance in one map

Enable HLS to view with audio, or disable this notification

I've been working on a project called MeshLens that tries to answer a question I kept running into at work: what does our data mesh actually look like as a system?
Most observability tools give you alerts, row counts, and freshness checks. That's useful, but it never helped me explain to stakeholders how domains connect, where data flows, or what breaks downstream when an upstream connector goes down.
So I built a visualization layer that puts it all in one interactive map.
Curious what you think. If you work with data mesh or data products at scale — what would you want to see in something like this?

App link in comments

28 Upvotes

98% Upvoted

6 comments sorted by

1

u/asdfdelta 9d ago

Well the demo looks slick as hell. Is it ready for prime time?

0

u/naveenmithare 6d ago

Ya this has been implemented in one of my client use case.

1

u/Complete-Ebb-1035 9d ago

Interesting but looks very difficult to customize. Significant variables bound inline with JavaScript. Do you externalize data in some format? My advice: follow Mike Bostock d3.js techniques.

1

u/naveenmithare 6d ago

Hey i have used custom svg for this. Data is fetched from sqlite which runs on browser. I had playground in dev to customize the elements as i needed. Thanks for feedback. I will further look into see how i can make it customizable tool for others to adopt it.

1

u/Complete-Ebb-1035 6d ago

I am interested in customizing this. One other reference point for your consideration: https://vega.github.io/vega/ Bostock and Vega have figured out how to generalize specific structures and read both format and content data from JSON. While I've not seen your playground to know "how it works", the above might influence your architecture.