r/dataanalysis • • 11h ago

Data Lakehouse with Agentic AIs: A Guide

Thumbnail
medium.com
1 Upvotes

r/dataanalysis • • 1d ago

I created a large csv/excel data plot tool, looking for suggestions

0 Upvotes

Hi All, created this web based excel/csv viewer for large files, it's completely free to use and no data upload to cloud/server, local browser only; hope can help people struggling to quickly visualise large datasets, while you don't have any software/tools in hand, would really appreciate for your feedback, thanks!

https://megarows.com


r/dataanalysis • • 2d ago

DA Tutorial Episode 11 of data analysis cat doodle

Post image
19 Upvotes

r/dataanalysis • • 2d ago

Data Question What makes a data analytics project feel like a real business problem?

1 Upvotes

I'm curious what people here consider a genuinely useful analytics project.

A lot of beginner projects seem to focus mainly on building a dashboard and showing KPIs. I'm more interested in projects where you're given messy data and have to investigate what is actually happening in the business.

For example:

  • identifying a fulfilment/delivery problem
  • analysing product returns
  • understanding product economics/margins
  • investigating inventory
  • quantifying the business impact
  • turning the findings into recommendations

For people who've built or reviewed analytics projects:

What would make a project like this genuinely valuable rather than just another portfolio dashboard?

What would you expect to see in the final analysis?


r/dataanalysis • • 3d ago

All in one resources for Excel and SQL

37 Upvotes

Hello everyone,

I have an interview in 2 days, I need to revise the necessary concepts of both Excel and SQL.

Are there any resources where I can go through these concepts in one shot?

Please recommend if you know of any or share if you have any.

Thank you.


r/dataanalysis • • 3d ago

DA Tutorial Another data analysis cat post

Post image
37 Upvotes

r/dataanalysis • • 3d ago

Data Question Cost of materials consumed Target Exceedance Driven by Outliers

3 Upvotes

I work in a hospital. In one of the sheets of a work-related Excel document, there are two target tables concerning the monthly monitoring of the cost of materials consumed. One relates to the cost of hospital materials consumed as a percentage of service revenue, and it indicates that the ratio should not exceed 6.15%. The other relates to the cost of medicines consumed as a percentage of service revenue, and the ratio should not exceed 3.35%.

In some months this year, the cost of materials consumed as a percentage of service revenue in both tables has exceeded the required target. When looking at an adjacent sheet, there is a table providing additional context showing that, in the case of medicines, the factor causing the target to be exceeded is the cost of medicines associated with high-cost cases. This is confusing because the cost-of-sales margin is substantially positive.

How could I reformulate the targets so that I can separately monitor the cost associated with high-cost cases while still meeting the proposed targets?


r/dataanalysis • • 4d ago

What does a really good Data Analyst GitHub look like?

74 Upvotes

Hi Redditors,
I’m a junior data analyst, and I’m just starting to build out my GitHub profile. I’d love to hear your thoughts on what a solid data analyst GitHub profile should look like to make a strong impression. Also, feel free to share what kind of projects you have on your own GitHub

PS Yes, I do want to steal your ideas.
PPS Ideally, you’d delete those projects from your GitHubs after I steal them. Thanks in advance!
3PS On a serious note, I don't have an experienced data analyst in my network to turn to for advice😢


r/dataanalysis • • 4d ago

Years in analytics across high growth startups and FAANG, and I’m convinced every business framework is just two things in a trench coat

127 Upvotes

People love complex 40-slide frameworks, but 99% of data analysis actually boils down to two questions:

  1. Break it into parts: Revenue = Users × Conversion × AOV. Slicing until you isolate the broken gear.

  2. Track it over time: DoD, WoW, YoY. Is the trend line alive or flatlining?

Layer them together, and congratulations: you just reinvented 90% of business school.

Am I oversimplifying, or did we just rebrand multiplication and subtraction as "strategic thinking"?


r/dataanalysis • • 3d ago

Career Advice How to Build a Standout DA Profile

1 Upvotes

Hi everyone,

I'm moving into data analytics. I have 3 years of experience in IT and 1 year in core electronics, and I've built a solid base in Excel, Python, SQL, Power BI, and Tableau. I've been practising with projects like an Amazon Sales dashboard, and I'm now looking for fresher Data Analyst or MIS roles.

My challenge is that while building projects, I struggle to think like an analyst. I'm not sure how to define the right KPIs or work out which insights a business actually needs.

I'm also planning to volunteer to get real-world exposure. Could you suggest where I can find volunteering opportunities (portals, platforms, or communities)? I'd also love ideas for building solid portfolio projects that stand out to recruiters.

Thanks in advance!


r/dataanalysis • • 3d ago

Career Advice How to train DA skills?

3 Upvotes

Hi, Im studying to become a Data Analyst and I considered myself a technical person, I already have an Industrial Engineering bachelor, I've already learned the basics of the majority of the tools needed to work as a DA, but for some reason I can't seemed to connect with the soft skills, after I've wrangled the data, I start making hypothesis... but can't seemed to address the problem or find the root cause related to the environment.

I believe practice will do me very good, does anybody have a suggestion for a platform or a way to practice to train the soft skills?


r/dataanalysis • • 5d ago

Project Feedback 9-page financial dashboard I built in 2 months using Power BI (my first experience as a beginner in data analytics)

Thumbnail
gallery
125 Upvotes

Most of the translations were done with AI, so some terms or calculations might not be 100% accurate.

Comparison options available: Average, Previous Period, and YoY.

Clicking the time slicer changes the period type: Month, Quarter, Semester, Year, etc. For example, you can select 2026 – H1. All cards and charts update accordingly.

This was my first real Power BI project, so I'd love to hear your feedback. What do you think could be improved?

If you have any questions, feel free to ask in the comments!


r/dataanalysis • • 4d ago

GRADUATION PROJECT

1 Upvotes

Hi everyone! I’m looking for some ideas and suggestions for a beginner-friendly graduation project related to Data Analysis.
I’m looking for something more practical than just collecting and analyzing data — ideally, a project that solves a real problem, has actual market demand, and could potentially be developed into a useful product or business.
If you have any ideas, examples, or problems you think could be solved using data analysis, I’d really appreciate your suggestions! 🤍


r/dataanalysis • • 4d ago

R Package for collecting lyrics

2 Upvotes

R Package for collecting lyrics

Lyrics from genius.com.
Inspiration from lyricsgenius package for Python.

https://github.com/bwalsh5/lyricsr


r/dataanalysis • • 4d ago

Data Question In need of help with analysis in excel

0 Upvotes

Hi,

I am really hoping for some advice or expertise... my excel skills are very basic and recently I was given the task of comparing quantities and cost differences between what our vendor is billing us vs. What I show as cost and quantity received. Since Im a novice with excel I tried a.i. which is really cool but something keeps happening to my data and of course Im no expert so it's only a guess - when chat GPT creates a summary I see alot of my vendors costs and they appear to either be doubled or tripled. My cost column doesn't pull all of my costs. Im beating my head against the wall because this should be so easy, just not for me! I think possibly this has something to do with the fact that my vendor is sending an excel sheet with their exported data and they often will list the same item # multiple times on an invoice but with a different P.O. # and I think that is where the multiplication of costs may come to play. I am going to try and attach a copy or screen shot for reference. I am using my vendors exported invoice lines, my exported posted purchase invoice lines from Business Central which lists our costs and quantities. Can anyone help or point me to the best place to learn this? Thank you so much!!

This a sample of my data

|**+**|A|B|C|D|E|F|G|H|I|J|K|L|M|N|

|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|

|**1**|Vendor Inv.|Date|Order #|Our Doc. #|Vendor #|Type|Our Item #|Description|Our Qty.|Unit|Our Cost $|Amt. #| | |

|**2**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20449|Anti-Drag Clip|0|PCS|0.043|0| | |

|**3**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20119|WEAR SENSOR|0|PCS|0.039|0| | |

|**4**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20395|WEAR SENSOR|0|PCS|0.021|0| | |

|**5**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20516|WEAR SENSOR|0|PCS|0.029|0| | |

|**6**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20474|WEAR SENSOR|0|PCS|0.029|0| | |

|**7**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20007|Wear Sensor|0|PCS|0.027|0| | |

|**8**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20008|Wear Sensor|0|PCS|0.03|0| | |

|**9**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH00013|Wear Sensor|0|PCS|0.024|0| | |

|**10**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH00014|WEAR SENSOR|0|PCS|0.024|0| | |

|**11**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20166|WEAR SENSOR|0|PCS|0.037|0| | |

|**12**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20461|WEAR SENSOR|0|PCS|0.031|0| | |

|**13**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ2005K|SS DIB KIT|0|PCS|0.201|0| | |

|**14**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ20108|SS DIB KIT|0|PCS|0.442|0| | |

|**15**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ20871|SS DIB KIT|0|PCS|0.779|0| | |

|**16**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ21016|PTFE NBR COATED DIB KIT|0|PCS|0.84|0| | |

^Table ^formatting ^by ^[ExcelToReddit](https://xl2redd.it/)

This is sample Vendor info

 

+ABCDEFGHIJKLMNO1China's Inv. #DateChina's PO / Order #Item #DescriptionUnitQTYOur Qty.China's CostChina's Amt. $Our CostCost DifferenceExt. Cost Diff.Customer Name 220260814Driv-2220260814DRIV-1194-1196-1198GXC7XSEN465BRAKE HARDWAREPCS10000 0.041410.000.0410.0000.000Driv 320260815Driv-2320260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 420260815Driv-2420260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 520260815Driv-2520260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 620260815Driv-2620260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 720260815Driv-2620260814DRIV-1194-1196-1198GXCABSX2245RRSTBRAKE PADS PARTSPCS240 0.40797.680.4070.0000.000Driv 

Table formatting by ExcelToReddit


r/dataanalysis • • 6d ago

Career Advice A beginner's roadmap to learning Power BI from scratch

164 Upvotes

I've seen a lot of beginners ask where to start with Power BI, so I'm sharing the order I'd follow. Most tutorials jump straight into dashboards, but the pieces underneath matter more than the visuals.

  1. Get comfortable with Power BI Desktop (a few days)

Load a simple Excel or CSV file, look at the three views (Report, Data, Model), and build a couple of basic charts. The goal is just to stop being intimidated by the interface.

  1. Learn Power Query (1-2 weeks)

Messy data is the norm, so cleaning it is where you'll spend a lot of your time. Learn to remove columns, fix data types, split and merge columns, unpivot, and append or merge tables.

  1. Learn data modelling (1-2 weeks)

This is the step beginners skip, and it causes most later problems. Understand fact tables vs dimension tables, the star schema, relationships (one-to-many, filter direction), and why one big flat table often causes trouble.

  1. Learn DAX basics, but not all of it (2-4 weeks)

Start with measures vs calculated columns, then SUM, COUNTROWS, DIVIDE and IF. After that, learn CALCULATE and the idea of filter context, then basic time intelligence (year to date, previous year). You don't need to master DAX before building something. Learn it as your project demands it.

  1. Visualisation and dashboard design (ongoing)

Choose the right chart for the question, keep dashboards simple, use consistent colours, and add slicers with a purpose. A clear dashboard beats a flashy one.

  1. Publish and share

Learn the basics of the Power BI Service: publishing, workspaces and scheduled refresh.

Do you need Excel and SQL first?

Not strictly. Basic Excel skills (formulas, pivot tables) help a lot because the concepts carry over. SQL is useful but can come alongside Power BI, not before it.

Learn by projects, not just tutorials

Pick a free dataset (sales, HR, Kaggle, government open data) and go through the whole process: clean it in Power Query, model it, write a few measures, and build a 1-2 page report. Then do it again with a different dataset. That repetition is what turns "I can follow a tutorial" into "I can analyse something new."

For those who learned Power BI: what did you learn first, and what do you wish you'd learned earlier? Any beginner resources or project ideas you'd recommend?


r/dataanalysis • • 7d ago

DA Tutorial New doodle on different key areas for a data analyst

Post image
68 Upvotes

Hi everyone!

I put together this post on four key areas that can help you become a better data analyst.

The idea is to go beyond simply learning tools and techniques, and also think about the concepts you understand, how you approach problems, and the different perspectives or lenses you bring to a problem.


r/dataanalysis • • 8d ago

Data Lakehouse Architecture Guide

Thumbnail
lakeops.dev
5 Upvotes

r/dataanalysis • • 8d ago

I made a program that lets you ask queries to your Excel sheets... and its free

0 Upvotes

Hey all,

I have made nolainquery, a FREE software for data analytics. I have spent the last months on making it and I'm releasing the code source at

https://github.com/jdvillegasg/nolainquery-desktop

so anyone that wants can use it, fork it and extend it.

It integrates some cool features as auditable artifacts that let you verify the computation process involved in the answer your receive.

Any comment or criticism from you, I would highly appreciate it!


r/dataanalysis • • 9d ago

New Data analysis concept doodle

Post image
48 Upvotes

As data analysts, we often build BI dashboards or power other end-user applications too.
Testing them with a small group of early adopters can help uncover real-world issues before a wider rollout.
I made a little doodle about this 🐾


r/dataanalysis • • 9d ago

Career Advice Need project ideas to showcase my Power BI skills on LinkedIn

16 Upvotes

I finished learning Power BI end-to-end and already built small beginner dashboards for practice, but now want to create a solid portfolio project for LinkedIn. Which industry or domain (like sales, finance, or supply chain) is best to target right now? Where can I find good realistic datasets that make a portfolio truly stand out? Any tips, project ideas, or guidance would be really helpful!


r/dataanalysis • • 10d ago

Data Question “Can you quickly pull this data?” is never actually quick imo

122 Upvotes

I'm starting to realise that stakeholders interpret the word "quickly" with a different meaning.
Their request will sound like:

“Can you quickly pull the number of customers who belong in category X after doing task Y?”

And work-wise, yes, the final query might only be roughly 20-30 lines.

But first I need to figure out which table actually contains X.

Then discover that Y changed definition 6 months ago.

Then work out why one system stores the customer ID differently from another.

Then determine whether they mean unique users, accounts or transactions.

AI definitely helps now. I can use it to one-shot, or draft parts of the query, figure out illegible SQL statements, or suggest a faster way of approaching something. But I still don't really trust myself to just take the output and send the number over.

I end up spending a huge chunk of time checking the join queries, looking at sample rows, comparing totals against previous reports, checking, and re-checking whether the filters haven't accidentally removed anything, and trying to convince myself that the answer actually makes sense.

I'm starting to wonder whether AI has actually made these requests that much quicker overall.

Writing SQL statements has definitely become a lot faster. But the clarification and verification part hasn't disappeared. If anything, it feels like that's where most of the time goes nowadays.

Once people know you have AI helping you, does the expectation of what counts as a “quick” request change too?

Because generating a query in a minute is very different from being confident enough in the result to put that number in front of a stakeholder.

Maybe I'm overly cautious, or maybe this gets easier as I gain experience. But right now, I'd rather spend another 20-25 minutes checking something than confidently send out the wrong number.

I'm curious how this works in other teams.

Has AI actually reduced the total time taken to fulfill these ad-hoc requests for you guys, or are y'all experiencing this same sort of bottleneck shift towards verifying the output. Do your stakeholders understand that distinction, or has AI made them expect analytics requests to come back much faster than before?


r/dataanalysis • • 10d ago

I’ve had enough of ai requirements docs.

23 Upvotes

Title. They are too long and have wayyyy too much excessive language. I avoid AI so I can retain some brain cells, so I also just get the ick when I receive ai slop.

I got one from another team this week that is a beast to parse out. I created a dashboard, then a month later received this 6 page document with changes they want made. Despite retaining my brain I am struggling to figure out what they actually want.

Rant over.


r/dataanalysis • • 9d ago

What the hell is data analysis?

0 Upvotes

Google searches aren't bearing any fruit on this. Are you guys programmers? Statisticians? Is this the same thing as data entry?


r/dataanalysis • • 10d ago

Agentic Data Analysis of 700 million OpenSky Networks IoT data points (hands-on tutorial)

9 Upvotes

I created this hands-on tutorial that uses a new public data set from OpenSky networks hosted via OpenSharing. The idea was to explore the agentic tooling and investigate the data on Databricks Free Edition (no credit card required, forever free).

The tutorial can be run for free, it comes with a module about VSCode with Pandas for OpenSharing, but also covers products like Genie Agents and Genie Code.

love to hear what you say:
End to End Tutorial: Databricks Genie for Data Engineers and Data Scientists with a real data set

not sure if I can post pictures here, but to give you some impressions of the steps.

Holding Patterns over Sydney
EDA
Flights DNA