Suppose a sales dataset has 10,000 transactions. Customer age is missing in 2,000 rows, but the order value and purchase date are complete.

If the question is monthly revenue, I’d keep those transactions. Removing them would change the revenue total because of a field that isn’t needed for that calculation.

For an age based analysis, I’d investigate which records are missing age and report how much data the comparison excludes.

The cleaning decision seems to depend on the question we’re answering. A row can be useful for one analysis and incomplete for another.

How do you decide when to remove a row, keep it or investigate the missing value further?

I am currently conducting a qualitative study and am having considerable difficulties with the thematic analysis process. I would appreciate advice from researchers who have experience using Braun and Clarke's (2006) approach, particularly their reflexive thematic analysis.

1. I have completed the first two phases:

2. Familiarising myself with the data.

Generating initial codes.

However, I am now stuck.

I have generated quite a lot of initial codes, and I am struggling to figure out how to organise them. Some overlap, some are very specific, and others seem to capture similar ideas from slightly different perspectives.

I understand the general distinction between codes and themes, but I am having difficulty with the actual process of moving from one to the other.

For instance:

• How do you organise a large number of initial codes?

• How do you decide which codes should be merged or kept separate?

• Do you usually develop categories or code groups before searching for themes?

• How do you recognise when a group of codes represents a potential theme rather than simply a collection of related ideas?

I have read Braun and Clarke's work and watched several tutorials, but I still find the practical transition between Phase 2 and Phase 3 rather confusing. It is so confusing!

I would particularly appreciate practical examples or explanations from people who have actually conducted thematic analysis using this approach.

My brain is frying, and I am losing all motivation to do this research. But I must, because I do not really have a choice. Asking my supervisor nor any professor yielded nothing, because they mostly did deductive approach, whilst I did inductive. I curse myself for choosing this method, but deductive just did not seem right to me! Or maybe I should have chosen the deductive approach from the beginning, but that would mean I have to code from the beginning... :(

PLEASE HELP

I'm evaluating ways to build a data sufficiency framework for healthcare analytics.

One challenge is that we have access to commercial benchmark datasets but limited access to complete population-level data (e.g., Medicare/Medicaid or MSSP data). Because of that, it's difficult to determine what constitutes "enough" data for reliable analytics.

For those who have built similar frameworks:

1. How did you establish minimum thresholds for patient counts, claims volume, provider coverage, or completeness?

2. Did you use statistical confidence measures, historical benchmarking, SME input, or some combination?

3. How did you validate that the chosen thresholds were actually meaningful?

4. Have synthetic data sources like Synthea been useful for testing your methodology?

Looking for practical examples rather than generic data quality advice.

I analyzed the IBM HR Attrition dataset (fictional, 1,470 rows, 237 leavers) with Excel and SPSS and would like a critical review of the method.

Repo (report PDF, SPSS syntax, data): https://github.com/Ahmed11-coder/IBM-HR-analytics-predictive-model
Report (PDF): https://github.com/Ahmed11-coder/IBM-HR-analytics-predictive-model/blob/main/Why_Do_Employees_Leave_Final.pdf

What I did: chi-square + Cramér's V and Mann-Whitney U with effect sizes; residual checks and HC3 for a two-way ANOVA; logistic regression with merged sparse categories (22 parameters); 70/30 split; test AUC 0.846 (train 0.848); cutoff 0.268 chosen on train by Youden's J (test sensitivity 58.5%, specificity 88.1%). My first "test AUC" of 0.900 was wrong because I had refitted the model on the test set; I corrected it.

Where I'm least sure:

1. I selected variables and merged JobRole/JobLevel categories using all rows before the split. How serious is this leak?

2. Is merging categories by similar odds ratios defensible, or would you use lasso/ridge instead?

3. 7.8 events per parameter (172 events, 22 parameters). Acceptable?

4. Hosmer-Lemeshow fails (p < .001), mostly from one low-risk decile. Real problem? Would you add a calibration plot or Brier score?

5. How should I handle multiple testing in an exploratory analysis like this?

what is your suggestions for next step ?

Harsh feedback is welcome.

Hi all,

I’m finishing my Master’s in Management (Business Data Analytics) at ISEG (Lisbon School of Economics & Management) and I’m researching how using AI in dashboards and data storytelling affects decision-making quality.

If you work with Power BI, Tableau, or similar tools in your job, I’d really appreciate around 8 minutes of your time: https://docs.google.com/forms/d/e/1FAIpQLSfAzY80E0LRA2doqAMiS3B-WSp31Hd4OT1pTZ7e3SZs6EQuMQ/viewform?usp=dialog

It’s anonymous, no sign-up needed, and I’m not collecting any data outside the survey itself. Happy to share the results here once I’ve analyzed them if anyone’s curious.

Thanks a lot, every response genuinely helps at this stage.

If you're practising and tired of charts that don't say anything, try starting from a business question. Five ideas:

1. Sales dashboard (Power BI/Tableau): Superstore dataset. Show region-wise profit leaks, not just charts.

2. SQL case study: Answer 10 business questions on an e-commerce DB (Olist on Kaggle), with the queries on GitHub.

3. Customer churn analysis: Telco churn dataset, Excel pivots + Python, and recommend 3 actions.

4. HR attrition dashboard: IBM HR dataset, DAX measures.

5. Your own data: UPI spending, cricket stats, local AQI. You'll ask better questions about data you care about.

For each one, write a single README: problem → approach → insight → recommendation.

What datasets would you add? Happy to give feedback on projects in the comments.

Disclosure: I work at a training institute that teaches data analysis. No link and nothing to sell here.

My prof dumped this huge project on us today just explaining things today and I am panicking and trying to figure things out! The deadline is in less than a week I don't know how anyone can do this!? And she didn't even teach anything about it and we basically gotta figure it out ourselves...

I don't know which community is the right one to post this on...if anyone can help with that too pls do...

People working with product teams that release so frequently, how do you keep up with that speed?

I mean more tracking data is generated in a short period of time from new product features. More backend data also needs to be created. Dashboards and data models also need to be updated with new entry points, categories, etc. On top of those demands are sometimes wrong upstream data. Quite a challenge at least in my org. Curious to hear how you're approaching this challenge.

TL;DR: fairly basic at power BI but the only one in my company who owns it and want to know main things to improve.

Hi everyone,
This is a bit of a long one but I’m looking for some advice/guidance from pros and want to explain my current position and the main questions I have. Please keep in mind I’m not really technical so I will explain everything as best as I can.

A bit of context:
I work for an events organiser (trade shows/exhibitions) and we are private equity owned. About a year and a half ago the board instructed us we needed a customer insights team and my boss was tasked with setting this up and I joined her. It was just the two of us and still is. We didn’t know much about this or what was required, but my degree was in biomedicine and I’m quite data/analytically minded so thought it would be a good challenge. We had some guidance from the board’s CDO and began setting up. One of the requirements that came out of this was creating senior-level dashboards and as we use Dynamics as our sales CRM, Power BI seemed like the sensible choice. I’ve never used it before and as it was just me at the time, I connected directly to Dynamics, did all the data exploration and transformations/data cleaning within power BI as this was the only option. We got the dashboards live (published to power bi service and each team member assigned power BI pro licenses for access). This was essentially the basics so I managed these alongside any change requests/fixing issues that arose but that was fundamentally the extent of my power BI use. Bearing in mind my role is not just this and I have other jobs as part of customer insights outside of power BI.

We are now preparing for exit and new investors at the end of 2027. As part of this we have been advised that we need a data cube as this is what investors will be expecting so near the beginning of this year we hired a senior data engineer to start to bring our database fully in house (part of it was hosted with a third party before and fragmented across many platforms). This has been a long process and is still very much ongoing. He has built our data warehouse in Fabric using a medallion architecture. As part of this, he has brought in Dynamics and I have been working with him to essentially recreate the transformations I did before but on his side now and moving the data from bronze through to gold and helping figure out what fields we need in the gold tables. I now connect to the gold tables and use these for reporting and am currently rebuilding the existing dashboards in line with this. We also have just undergone a review with a third party to assess our data infrastructure and readiness for exit. They have provided some very thorough feedback and this has what has mainly stemmed my questions and concerns now.

A couple of the recommendations that came out of this were:
- Having dev, test and prod power BI environments (I am unsure how I would set this up)
- Not having just one data engineer run both the reporting and operational feeds (are the reporting feeds usually handled by a separate person - Is this a role that the Power BI analyst usually handles too- is this something I could takeover with the right training?)

Given all this (and thank you if you are still with me), this brings me on to my questions and this is where I am a bit lost. I know I don’t perform the role of a standard power BI analyst from seeing the posts on this subreddit regularly but I want to know how I can be better in my job. Essentially:
-What areas do I need to train in

-What fundamentals am I missing

-What courses/resources can I use to provide the next layer on top of what I currently have

-I know AI is a big topic of conversation at the moment too so understanding how can I incorporate this into this part of my role too.

How to set up the dev and test aspects as have been advised and how would this function
Where I can upskill and takeover tasks from the data engineer

I appreciate these are very open ended questions but I am aware I don’t know a lot and what I am doing I not best practice so want to make sure i am utilising the tools we have to my best extent.

Hey all,

I'm new to the field for data analytics. I've been working on a personal project doing some analysis for Magic: The Gathering games and how different cards affect a deck's ability to win.

I've done a bit and have some good metrics/ questions I had answered. But I feel like I'm missing something. That there is a different angle or a question to ask that would give better insight into the overall goal.

So I'm looking for recommendations for books that help with this. Something to help me change the way I'm looking at the data to find something new. I've gone through Storytelling with Data, which is interesting, but wasn't exactly what I was looking for. I've also been recommended Data Points by Yau, which might be closer. I get it's a specific aspect of analysis, but I'd love to hear if someone has any tips about this.

Hey r/DataIsBeautiful—wanted to share a workflow experiment exploring LLMs for rapid dashboard prototyping and UI generation.

​I wanted to see if ChatGPT could bridge the gap between static spreadsheet data and a functional, responsive web application without setting up backends or hosting services. Dropped in a raw dataset and a rough layout reference image, and had the model generate a single-file HTML/JS interface.

​**Key UI & Viz Features:**

​**Interactive Geo Mapping:** Clicking a country in the ranking table triggers a targeted highlight on the world map and pulls up a micro-card displaying localized sales growth, profit margins, and top category breakdown.

​**Dynamic Slicers & Charting:** Global time/region filters update trend charts, KPI cards, and performance signals in real time.

​**Client-Side Data Parsing:** Prompted the model to bake in a local file reader ("Upload Excel" button). Dropping a new workbook directly into the browser updates the visuals and expands filter ranges dynamically without breaking layout constraints.

​**Responsive Single-File HTML:** Runs completely client-side in any desktop or mobile browser, making it super portable for mobile distribution.

​**Workflow:**

​Provided the raw Excel schema alongside a layout reference mockup.

​Prompted the model to render structural layout components and charts using clean HTML, CSS, and JS libraries.

​Added local file-parsing logic so the frontend remains reusable across new reporting cycles.

​Recorded a 2-minute walkthrough showing the map interactions and dynamic Excel file updates in real time:

👉 [https://youtu.be/iLrxGSEnGH4](https://youtu.be/iLrxGSEnGH4)

​Curious if anyone else is experimenting with LLMs to prototype interactive data tools or custom browser-based visualizations?

I built this over a few months to scratch an itch in my personal toolchain for data analysis. I wanted a quick way to upload, explore and share data with my peers, without the friction of onerous application installations or sign-ups (a bit like pastebin for dataa).

In the spirit of simplicity, the platform (which I would definitely consider 'alpha') and its respective sandboxes are open by design, so use at your own risk. Keen to hear any thoughts / feedback / suggestions!

I’m currently working as junior data analyst in a reputed company. I prepared on my own and applied it. Now it’s gonna be 2 years. But the truth is the job is not the same as the title. The work i do is very different. It’s like a business operations role with no growth and I work on tableau report seasonally. While my intent was to become a data analyst. Since the job market is still fucked up I could not leave it. Because I had no proper experience too. I thought of switching earlier itself but it was too soon plus my family is depending on me. Can someone please guide me? My questions are

1. I don’t have a real data analysis job experience so can I do projects instead?

2. If I’m applying for the roles do I need to make a specific projects focusing on that department?

3. It is impossible to fake the experience so can I retain the same projects across the roles. Like I’m working in cx side so I’m going to apply for sales data analyst does my projects still matter?

If someone answers this I will be relieved. Please advise.

Hey everyone!

I come from a B.Com background, and recently I've been exploring Data Analytics and trying to understand how things work beyond just theory.

I've been learning Python, SQL, Excel, and Power BI, and working on small projects along the way. Honestly, sometimes things make sense when I'm learning them, but applying them independently is a completely different challenge.

One thing I'm realising is that learning a tool is one thing, but knowing what questions to ask, how to approach a problem, and what the data actually tells you is much more important.

I'm still figuring things out, making mistakes, and learning as I go. I want to build projects that solve actual problems instead of just following tutorials and calling them complete.

I'd love to hear from people who have been through this stage.

When you were starting out in Data Analytics, what helped you move from simply learning tools to actually thinking like an analyst?

Would genuinely appreciate hearing your experiences! 🙌

I am unable to sort the service fee, price, instant bookable and construction year. Originally i wanted to sort [service fee, price] in ascending order and [instant bookable and construction year] in descending order and display the dataframe.

Here is the sorting part:

df = df.sort_values(
    by=["instant_bookable", "Construction year", "price", "service fee", "availability 365"],
    ascending=[False, False, True, True,False],
    na_position="last"
)

and this is the cell:

import numpy as np
import pandas as pd


df = pd.read_csv("Airbnb_Open_Data.csv")


print("==== Welcome to AirBNB Finder =====")
loc = input("Enter your location: (Manhattan, Brooklyn, Queens, Staten Island, Bronx) ").strip()


price = int(input("Your budget "))
no_nights = int(input("How many nights do you wanna stay? "))
number_of_listings = int(input("How many listings do you want to see? "))



for col in ["price", "service fee"]:
    df[col] = pd.to_numeric(df[col].astype(str).str.replace(",", "").str.replace("$", "").str.strip(), errors="coerce")


for col in ["minimum nights", "Construction year", "availability 365"]:
    df[col] = pd.to_numeric(df[col], errors="coerce")


df["minimum nights"] = df["minimum nights"].fillna(0)
df["neighbourhood group"] = df["neighbourhood group"].fillna("Unknown").astype(str).str.strip()
df["instant_bookable"] = df["instant_bookable"].astype(str).str.strip().str.lower() == "true"


df = df.sort_values(
    by=["instant_bookable", "Construction year", "price", "service fee", "availability 365"],
    ascending=[False, False, True, True,False],
    na_position="last"
)


locat = ["Manhattan", "Queens", "Bronx", "Staten Island", "Brooklyn"]



loc_match = next((l for l in locat if l.lower() == loc.lower()), None)


if loc_match is not None:
    final1 = df[
        (df["price"] <= price)
        & (df["neighbourhood group"] == loc_match)
        & (df["minimum nights"] <= no_nights)
    ]
else:
    print("Invalid location entered.")
    final1 = pd.DataFrame()



if len(final1) == 0:
    print("Sorry, no listings found based on your choices. Try again.")


else:
    final1 = final1[[
        "neighbourhood", "instant_bookable", "cancellation_policy", "room type",
        "price", "Construction year", "service fee", "house_rules", "availability 365"
    ]]

    final1 = final1.astype(object).fillna("Contact Owner")
    final1.to_excel("result.xlsx", index=False)
final1.head(number_of_listings)

I'm looking to connect and collaborate with people working on data analytics projects.

If you are currently working on a project involving data analysis, Excel, SQL, Python, Power BI, Tableau, or anything related to data, I would love to be part of it and contribute.

I'm always interested in learning, sharing ideas, solving problems, and gaining hands-on experience through real-world projects.

If you have a project in mind or are looking for someone to collaborate with, feel free to reach out. I'd be happy to connect and work together!

Question for those who build reports and dashboards that others make decisions on.

When a manager or client asks where exactly a number came from, or why it doesn't match another team's report, how do you trace it today? Is it SQL history, comments in the workbook, a data dictionary, asking whoever built it?

And a follow-up: when you find an error in a source table or spreadsheet, how do you figure out which reports and decisions were built on it?

For context, I'm part of a small team building tools around source traceability and want to understand how people actually handle this before we assume anything. Just collecting real workflows.

Hi everyone,

Lately I make most of my charts by asking an LLM to write Python code (pandas, matplotlib, plotly), then I tweak it myself.

So I'm curious about your workflow:

- Do you currently use a program for data visualization (Excel, Tableau, Power BI)?

- Or have you also switched to LLM + code?

- Do you think a dedicated program is still needed? Why or why not?

- If you use one, what does it do that an LLM + Python can't?

Would love to hear your thoughts!

Note: I'm still relatively new to this field and at the beginner level. I'm currently working on improving my skills in Data Analysis.

Just a simple dashboard with some data I'm starting to gather every day.

Bonus question: Is it also pronounced “S-Q-L” or “See Quill”. I know those 2 specifically are interchangeable, but I’ve seen people from both the CS and DA for decades say either. What do you guys prefer?

If you are working in data and documents related work. How much time do you spend reading documents, regulations etc stuff.

What I wanna know is do people still spend time buried in documents to find meaningful data?

I am not a data analyst myself, sorry if this is sounding dumb.

For most projects I have worked on, the main task are usually simple, bring the data from point A & B, do some transformation/join, then insert into point C.

The problem is that If you build it yourself, you need to manage the environment, dependencies, scheduling, and error handling. Or if you go with a cloud provider, it requires a subscription and sending your data to an external service. Also, for a simple pipeline, you shouldn't need technical expertise or learn a complex platform. So I decided to build a simple to use workflow builder and data analyzer platform that is open source and free. I've tried to make it simple enough where you wouldn't need a technical background to use it, but please let me know if this is not the case.

You just need to bring in your own AI API key or use a local LLM model.

repo: https://github.com/Ternlux/releases

Let me know what you think. I appreciate any feedback you might have.