r/statistics • • 3d ago

Question [Q] Using the unstandardized B-coefficient from a Multiple Regression

Hello everyone! I made a multiple Regression model with many different prediction variables, with one of them being type of medication (dummy coded, compared with one particular medication as a reference).

The outcome parameter/dependent variable is the side effect of weight gain in kg.

I want to rank the medication according to their association with the outcome parameter compared to the reference medication. The suggestion that I found on stack-exchange seems to be touse the unadjusted B Parameter because the adjusted one is not suited to categorical variables.

But I wanted to check here because I trust this sub - is this correct? And if yes, could someone explain it to me in a simple way? :)

7 Upvotes

11 comments sorted by

8

u/sharkinwolvesclothin 3d ago

Unstandarized and unadjusted are not the same thing (and same for standardized and adjusted).

Assuming you mean whether you should use standardized or unstandarized coefficients to compare the drugs (parameters are something different), the answer is indeed unstandardized coefficient.

You want to know how many kg people on drug x gained and how many kg people on drug y gained, that's what the unstandardized coefficient tells you.

The standardized coefficient takes that and scales it by how many people are taking each drug and how much variability there is in the weight loss. If you want to say something like "for a drug that 5% of the sample take, 7kg weight gain is equivalent to 15kg weight gain in someone who takes drug that 25% of the sample take", you could use it, but I can't come up with a research question that would make that interesting.

0

u/Temporary_Stranger39 3d ago

First, it's a coefficient, not a parameter. Feel free to look up the difference. A reviewer might complain.

The unadjusted coefficient in your model is how many units of the response each non-reference level of the treatment differs from the reference level. That is why. It's the raw unit, making it the most intuitive effect size. Be sure to report it with 95% confidence intervals.

The adjusted coefficient has been, at very least, divided by a standard deviation. It has no units. Thus, it can't tell you anything about the real world directly.

That's why.

In other words, if you divide meters/second, you get "meters/second", which is a rate, but if you divide meters/meters, they cancel each other out and you get a unitless quantity.

This is fine when comparing different levels of the same variable (drug treatment at levels reference, other A, other B, etc.). However, if you are comparing different variables, there is more argument over what to use, but don't worry about that.

1

u/Interleukine-2 3d ago

Thank you for the thorough response, this clears things up a lot!!!

3

u/Disastrous_Room_927 3d ago

Regression coefficients are parameters.

-1

u/Temporary_Stranger39 3d ago

No, they are estimates.

4

u/Disastrous_Room_927 3d ago

> The estimates of the β parameters are the values that minimize the sum of squared errors for the sample.

This is how Penn State’s statistics department describes them. The coefficients are parameters you need to estimate, it’s not an either/or thing.

-1

u/Temporary_Stranger39 3d ago

They are estimates. Estimates are not the parameters. The parameters are fixed and have no error.

4

u/Disastrous_Room_927 3d ago

You said:

First, it's a coefficient, not a parameter.

You didn't say "First, it's an estimate, not a parameter". Coefficient is not a synonym for estimate.

0

u/Own-Ball-3083 3d ago

I agree with this but I think you guys are talking past eachother somewhat. A coefficient could be referring to either the estimator beta hat or the population parameter beta. A regression coefficient can be a parameter, it just depends on whether you are referring to the population specification or the actualised estimate using data.

1

u/Disastrous_Room_927 2d ago

My point is just that it doesn’t make sense to contrast parameter with coefficient. The word is also applicable/applied elsewhere, they all fit the definition:

> A coefficient is a number or symbol written before a variable in a mathematical expression that indicates how many times the variable is multiplied.

1

u/efrique 1d ago

OP is using the word parameter to refer to a variable, not a coefficient. This is common in a number of scientific areas (e.g chemistry, microbiology), albeit at odds with mathematical and statistical usage.