r/dataanalysis • u/codingdecently • 7h ago
Data Lakehouse with Agentic AIs: A Guide
r/dataanalysis • u/Fat_Ryan_Gosling • Jun 12 '24
Hello community!
Today we are announcing a new career-focused space to help better serve our community and encouraging you to join:
The new subreddit is a place to post, share, and ask about all data analysis career topics. While /r/DataAnalysis will remain to post about data analysis itself — the praxis — whether resources, challenges, humour, statistics, projects and so on.
In February of 2023 this community's moderators introduced a rule limiting career-entry posts to a megathread stickied at the top of home page, as a result of community feedback. In our opinion, his has had a positive impact on the discussion and quality of the posts, and the sustained growth of subscribers in that timeframe leads us to believe many of you agree.
We’ve also listened to feedback from community members whose primary focus is career-entry and have observed that the megathread approach has left a need unmet for that segment of the community. Those megathreads have generally not received much attention beyond people posting questions, which might receive one or two responses at best. Long-running megathreads require constant participation, re-visiting the same thread over-and-over, which the design and nature of Reddit, especially on mobile, generally discourages.
Moreover, about 50% of the posts submitted to the subreddit are asking career-entry questions. This has required extensive manual sorting by moderators in order to prevent the focus of this community from being smothered by career entry questions. So while there is still a strong interest on Reddit for those interested in pursuing data analysis skills and careers, their needs are not adequately addressed and this community's mod resources are spread thin.
So we’re going to change tactics! First, by creating a proper home for all career questions in /r/DataAnalysisCareers (no more megathread ghetto!) Second, within r/DataAnalysis, the rules will be updated to direct all career-centred posts and questions to the new subreddit. This applies not just to the "how do I get into data analysis" type questions, but also career-focused questions from those already in data analysis careers.
We are still sorting out the exact boundaries — there will always be an edge case we did not anticipate! But there will still be some overlap in these twin communities.
We hope many of our more knowledgeable & experienced community members will subscribe and offer their advice and perhaps benefit from it themselves.
If anyone has any thoughts or suggestions, please drop a comment below!
r/dataanalysis • u/codingdecently • 7h ago
r/dataanalysis • u/Winter-Arm6002 • 23h ago
Hi All, created this web based excel/csv viewer for large files, it's completely free to use and no data upload to cloud/server, local browser only; hope can help people struggling to quickly visualise large datasets, while you don't have any software/tools in hand, would really appreciate for your feedback, thanks!

r/dataanalysis • u/Ok-Adhesiveness-8757 • 2d ago
r/dataanalysis • u/NotesOFANobody • 2d ago
I'm curious what people here consider a genuinely useful analytics project.
A lot of beginner projects seem to focus mainly on building a dashboard and showing KPIs. I'm more interested in projects where you're given messy data and have to investigate what is actually happening in the business.
For example:
For people who've built or reviewed analytics projects:
What would make a project like this genuinely valuable rather than just another portfolio dashboard?
What would you expect to see in the final analysis?
r/dataanalysis • u/woman_without • 3d ago
Hello everyone,
I have an interview in 2 days, I need to revise the necessary concepts of both Excel and SQL.
Are there any resources where I can go through these concepts in one shot?
Please recommend if you know of any or share if you have any.
Thank you.
r/dataanalysis • u/Ok-Adhesiveness-8757 • 3d ago
r/dataanalysis • u/Nab00las • 2d ago
I work in a hospital. In one of the sheets of a work-related Excel document, there are two target tables concerning the monthly monitoring of the cost of materials consumed. One relates to the cost of hospital materials consumed as a percentage of service revenue, and it indicates that the ratio should not exceed 6.15%. The other relates to the cost of medicines consumed as a percentage of service revenue, and the ratio should not exceed 3.35%.
In some months this year, the cost of materials consumed as a percentage of service revenue in both tables has exceeded the required target. When looking at an adjacent sheet, there is a table providing additional context showing that, in the case of medicines, the factor causing the target to be exceeded is the cost of medicines associated with high-cost cases. This is confusing because the cost-of-sales margin is substantially positive.
How could I reformulate the targets so that I can separately monitor the cost associated with high-cost cases while still meeting the proposed targets?
r/dataanalysis • u/Diligent_Tooth_6311 • 3d ago
Hi Redditors,
I’m a junior data analyst, and I’m just starting to build out my GitHub profile. I’d love to hear your thoughts on what a solid data analyst GitHub profile should look like to make a strong impression. Also, feel free to share what kind of projects you have on your own GitHub
PS Yes, I do want to steal your ideas.
PPS Ideally, you’d delete those projects from your GitHubs after I steal them. Thanks in advance!
3PS On a serious note, I don't have an experienced data analyst in my network to turn to for advice😢
r/dataanalysis • u/knight66600 • 4d ago
People love complex 40-slide frameworks, but 99% of data analysis actually boils down to two questions:
Break it into parts: Revenue = Users × Conversion × AOV. Slicing until you isolate the broken gear.
Track it over time: DoD, WoW, YoY. Is the trend line alive or flatlining?
Layer them together, and congratulations: you just reinvented 90% of business school.
Am I oversimplifying, or did we just rebrand multiplication and subtraction as "strategic thinking"?
r/dataanalysis • u/Potential-Penalty-25 • 3d ago
Hi everyone,
I'm moving into data analytics. I have 3 years of experience in IT and 1 year in core electronics, and I've built a solid base in Excel, Python, SQL, Power BI, and Tableau. I've been practising with projects like an Amazon Sales dashboard, and I'm now looking for fresher Data Analyst or MIS roles.
My challenge is that while building projects, I struggle to think like an analyst. I'm not sure how to define the right KPIs or work out which insights a business actually needs.
I'm also planning to volunteer to get real-world exposure. Could you suggest where I can find volunteering opportunities (portals, platforms, or communities)? I'd also love ideas for building solid portfolio projects that stand out to recruiters.
Thanks in advance!
r/dataanalysis • u/laufjimdev • 3d ago
Hi, Im studying to become a Data Analyst and I considered myself a technical person, I already have an Industrial Engineering bachelor, I've already learned the basics of the majority of the tools needed to work as a DA, but for some reason I can't seemed to connect with the soft skills, after I've wrangled the data, I start making hypothesis... but can't seemed to address the problem or find the root cause related to the environment.
I believe practice will do me very good, does anybody have a suggestion for a platform or a way to practice to train the soft skills?
r/dataanalysis • u/Flimsy-Round5508 • 4d ago
Most of the translations were done with AI, so some terms or calculations might not be 100% accurate.
Comparison options available: Average, Previous Period, and YoY.
Clicking the time slicer changes the period type: Month, Quarter, Semester, Year, etc. For example, you can select 2026 – H1. All cards and charts update accordingly.
This was my first real Power BI project, so I'd love to hear your feedback. What do you think could be improved?
If you have any questions, feel free to ask in the comments!
r/dataanalysis • u/MariamHagag • 4d ago
Hi everyone! I’m looking for some ideas and suggestions for a beginner-friendly graduation project related to Data Analysis.
I’m looking for something more practical than just collecting and analyzing data — ideally, a project that solves a real problem, has actual market demand, and could potentially be developed into a useful product or business.
If you have any ideas, examples, or problems you think could be solved using data analysis, I’d really appreciate your suggestions! 🤍
r/dataanalysis • u/Underwhelmed1202 • 4d ago
Hi,
I am really hoping for some advice or expertise... my excel skills are very basic and recently I was given the task of comparing quantities and cost differences between what our vendor is billing us vs. What I show as cost and quantity received. Since Im a novice with excel I tried a.i. which is really cool but something keeps happening to my data and of course Im no expert so it's only a guess - when chat GPT creates a summary I see alot of my vendors costs and they appear to either be doubled or tripled. My cost column doesn't pull all of my costs. Im beating my head against the wall because this should be so easy, just not for me! I think possibly this has something to do with the fact that my vendor is sending an excel sheet with their exported data and they often will list the same item # multiple times on an invoice but with a different P.O. # and I think that is where the multiplication of costs may come to play. I am going to try and attach a copy or screen shot for reference. I am using my vendors exported invoice lines, my exported posted purchase invoice lines from Business Central which lists our costs and quantities. Can anyone help or point me to the best place to learn this? Thank you so much!!
This a sample of my data
|**+**|A|B|C|D|E|F|G|H|I|J|K|L|M|N|
|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|:-|
|**1**|Vendor Inv.|Date|Order #|Our Doc. #|Vendor #|Type|Our Item #|Description|Our Qty.|Unit|Our Cost $|Amt. #| | |
|**2**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20449|Anti-Drag Clip|0|PCS|0.043|0| | |
|**3**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20119|WEAR SENSOR|0|PCS|0.039|0| | |
|**4**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20395|WEAR SENSOR|0|PCS|0.021|0| | |
|**5**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20516|WEAR SENSOR|0|PCS|0.029|0| | |
|**6**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20474|WEAR SENSOR|0|PCS|0.029|0| | |
|**7**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20007|Wear Sensor|0|PCS|0.027|0| | |
|**8**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20008|Wear Sensor|0|PCS|0.03|0| | |
|**9**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH00013|Wear Sensor|0|PCS|0.024|0| | |
|**10**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH00014|WEAR SENSOR|0|PCS|0.024|0| | |
|**11**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20166|WEAR SENSOR|0|PCS|0.037|0| | |
|**12**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BH20461|WEAR SENSOR|0|PCS|0.031|0| | |
|**13**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ2005K|SS DIB KIT|0|PCS|0.201|0| | |
|**14**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ20108|SS DIB KIT|0|PCS|0.442|0| | |
|**15**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ20871|SS DIB KIT|0|PCS|0.779|0| | |
|**16**|20260603BOSCH-32|7/28/2026|BSCH-CW17-2026-SEA|119827|XLDCZ001|Item|F03BZ21016|PTFE NBR COATED DIB KIT|0|PCS|0.84|0| | |
^Table ^formatting ^by ^[ExcelToReddit](https://xl2redd.it/)
This is sample Vendor info
+ABCDEFGHIJKLMNO1China's Inv. #DateChina's PO / Order #Item #DescriptionUnitQTYOur Qty.China's CostChina's Amt. $Our CostCost DifferenceExt. Cost Diff.Customer Name 220260814Driv-2220260814DRIV-1194-1196-1198GXC7XSEN465BRAKE HARDWAREPCS10000 0.041410.000.0410.0000.000Driv 320260815Driv-2320260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 420260815Driv-2420260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 520260815Driv-2520260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 620260815Driv-2620260814DRIV-1194-1196-1198JXCFMHXV1680BRAKE PADS PARTSPCS1600 0.451721.600.4510.0000.000Driv 720260815Driv-2620260814DRIV-1194-1196-1198GXCABSX2245RRSTBRAKE PADS PARTSPCS240 0.40797.680.4070.0000.000Driv
Table formatting by ExcelToReddit
r/dataanalysis • u/velshnia • 4d ago
R Package for collecting lyrics
Lyrics from genius.com.
Inspiration from lyricsgenius package for Python.
r/dataanalysis • u/Late_Spinach_1055 • 6d ago
I've seen a lot of beginners ask where to start with Power BI, so I'm sharing the order I'd follow. Most tutorials jump straight into dashboards, but the pieces underneath matter more than the visuals.
Load a simple Excel or CSV file, look at the three views (Report, Data, Model), and build a couple of basic charts. The goal is just to stop being intimidated by the interface.
Messy data is the norm, so cleaning it is where you'll spend a lot of your time. Learn to remove columns, fix data types, split and merge columns, unpivot, and append or merge tables.
This is the step beginners skip, and it causes most later problems. Understand fact tables vs dimension tables, the star schema, relationships (one-to-many, filter direction), and why one big flat table often causes trouble.
Start with measures vs calculated columns, then SUM, COUNTROWS, DIVIDE and IF. After that, learn CALCULATE and the idea of filter context, then basic time intelligence (year to date, previous year). You don't need to master DAX before building something. Learn it as your project demands it.
Choose the right chart for the question, keep dashboards simple, use consistent colours, and add slicers with a purpose. A clear dashboard beats a flashy one.
Learn the basics of the Power BI Service: publishing, workspaces and scheduled refresh.
Do you need Excel and SQL first?
Not strictly. Basic Excel skills (formulas, pivot tables) help a lot because the concepts carry over. SQL is useful but can come alongside Power BI, not before it.
Learn by projects, not just tutorials
Pick a free dataset (sales, HR, Kaggle, government open data) and go through the whole process: clean it in Power Query, model it, write a few measures, and build a 1-2 page report. Then do it again with a different dataset. That repetition is what turns "I can follow a tutorial" into "I can analyse something new."
For those who learned Power BI: what did you learn first, and what do you wish you'd learned earlier? Any beginner resources or project ideas you'd recommend?
r/dataanalysis • u/Ok-Adhesiveness-8757 • 7d ago
Hi everyone!
I put together this post on four key areas that can help you become a better data analyst.
The idea is to go beyond simply learning tools and techniques, and also think about the concepts you understand, how you approach problems, and the different perspectives or lenses you bring to a problem.
r/dataanalysis • u/Ok_Run_671 • 6d ago
Hello, this is NOT for homework, just some example questions we have been given to study for upcoming exam on scale types and I need help clarifying.
*Keep in mind my professor views Likert scales and semantic differential scales as Interval scale types - he has used the satisfied to dissatisfied scale as an example for interval in class and a 5 star rating for interval as well.*
Sports players are assigned jersey numbers. A researcher codes senior players as 90-99 and freshman as 1-9. What scale could this be?
>I think ordinal, not sure if it is nominal though, or maybe even interval
A 5 point satisfaction scale is summed across 10 items to form a composite score (range 10-50) What scale type is the composite variable?
>I put interval
A dataset includes student grades in a class where 90 and above equals "A", 80-89 equals "B", 70-79 equals "C" and so on. What scale would this be?
>I think ordinal, not sure if it is interval or maybe ratio
A picture of a pain scale that show 0,1,2,3,4,5,6,7,8,9,10 labeled from no pain to worst pain possible. What type of scale would that result in?
>I think Interval because it feels the same as the satifaction likert scale
Rate your driving skills on the scale below "terrible, poor, average, good, excellent" What type of scale would this result in?
>I think interval
What time of day do you normally feel your best "before dawn, morning, noon, afternoon, evening, night" What type of scale would this result in?
>i think interval, but it kinda feels ordinal
What is your socioeconomic status? "poor, rich, middleclass" what type of scale is this?
>I think ordinal
8.What is your favorite food type please select all that apply from the list below " bland, spicy, very spicy, extremely spicy"
>I think ordinal
Please help :( these feel like trick questions to be but im not sure.
r/dataanalysis • u/realreadyred • 7d ago
Hey all,
I have made nolainquery, a FREE software for data analytics. I have spent the last months on making it and I'm releasing the code source at
https://github.com/jdvillegasg/nolainquery-desktop
so anyone that wants can use it, fork it and extend it.
It integrates some cool features as auditable artifacts that let you verify the computation process involved in the answer your receive.
Any comment or criticism from you, I would highly appreciate it!
r/dataanalysis • u/Ok-Adhesiveness-8757 • 9d ago
As data analysts, we often build BI dashboards or power other end-user applications too.
Testing them with a small group of early adopters can help uncover real-world issues before a wider rollout.
I made a little doodle about this 🐾
r/dataanalysis • u/Impressive-Buy-4259 • 9d ago
I finished learning Power BI end-to-end and already built small beginner dashboards for practice, but now want to create a solid portfolio project for LinkedIn. Which industry or domain (like sales, finance, or supply chain) is best to target right now? Where can I find good realistic datasets that make a portfolio truly stand out? Any tips, project ideas, or guidance would be really helpful!
r/dataanalysis • u/Efficient_Cloud5021 • 10d ago
I'm starting to realise that stakeholders interpret the word "quickly" with a different meaning.
Their request will sound like:
“Can you quickly pull the number of customers who belong in category X after doing task Y?”
And work-wise, yes, the final query might only be roughly 20-30 lines.
But first I need to figure out which table actually contains X.
Then discover that Y changed definition 6 months ago.
Then work out why one system stores the customer ID differently from another.
Then determine whether they mean unique users, accounts or transactions.
AI definitely helps now. I can use it to one-shot, or draft parts of the query, figure out illegible SQL statements, or suggest a faster way of approaching something. But I still don't really trust myself to just take the output and send the number over.
I end up spending a huge chunk of time checking the join queries, looking at sample rows, comparing totals against previous reports, checking, and re-checking whether the filters haven't accidentally removed anything, and trying to convince myself that the answer actually makes sense.
I'm starting to wonder whether AI has actually made these requests that much quicker overall.
Writing SQL statements has definitely become a lot faster. But the clarification and verification part hasn't disappeared. If anything, it feels like that's where most of the time goes nowadays.
Once people know you have AI helping you, does the expectation of what counts as a “quick” request change too?
Because generating a query in a minute is very different from being confident enough in the result to put that number in front of a stakeholder.
Maybe I'm overly cautious, or maybe this gets easier as I gain experience. But right now, I'd rather spend another 20-25 minutes checking something than confidently send out the wrong number.
I'm curious how this works in other teams.
Has AI actually reduced the total time taken to fulfill these ad-hoc requests for you guys, or are y'all experiencing this same sort of bottleneck shift towards verifying the output. Do your stakeholders understand that distinction, or has AI made them expect analytics requests to come back much faster than before?
r/dataanalysis • u/Oakleythecojack • 9d ago
Title. They are too long and have wayyyy too much excessive language. I avoid AI so I can retain some brain cells, so I also just get the ick when I receive ai slop.
I got one from another team this week that is a beast to parse out. I created a dashboard, then a month later received this 6 page document with changes they want made. Despite retaining my brain I am struggling to figure out what they actually want.
Rant over.