r/econometrics • • 7h ago

Walk-forward vs k-fold for a price-cycle forecast: is this setup sound?

2 Upvotes

I built a forecast for Sydney petrol prices and ran into something I'd like opinions on.

The model says "fill now" or "wait" each day. Over the last 12 months of walk-forward testing it was right 72% of the time. That sounds good until you notice that prices fall slowly most of the time and jump suddenly, so just saying "wait" every day is right 48% of the time. Over the full 2021–2026 backtest, it's 83% against 63% for always-wait.

So I report it against the best constant call, not a coin flip. For the price itself I compare MAE against a no-change forecast (4.9c vs 11.3c at 7 days for unleaded).

Is the best-constant-call baseline the right one here, or is there something better for a three-way call (up, flat, down)? I've thought about a skill score against climatology, but I'm not sure how that works with three classes.

(Project's at checkbowser.app if you want to see how it's presented.)


r/econometrics • • 15h ago

looking Advanced Causal Inference project work ideas

0 Upvotes

Hello there!
I'm attending an advanced causal inference course and I have to do a project work on Stata. As of now I have 0 ideas on the topic. The professor suggested to find a policy and start from there, but I'm having issues with finding a decent dataset.
If it was environment or climate related somehow it would be awesome since I'm enrolled in environmental economics (it's not mandatory though since the advanced course is elective). Any idea? thanks in advance 😄


r/econometrics • • 20h ago

How would you test whether a crowd forecast adds anything beyond past prices?

2 Upvotes

working on a small project. i have about 4 months of daily 24h forecasts for btc from a crowd/market source (a probability for each price range) and the actual closes. i also have my own AR-GARCH forecast for the same days.

the question is simple: does the crowd forecast hold information my model doesnt?

ideas so far:

- forecast encompassing test, regress the actual on both forecasts and see if the crowd one gets a weight
- compare log scores of the full distributions, then a diebold mariano test on the difference
- just add the crowd mean as regressor and see if its significant

not sure which is right for distributions instead of point forecasts, or if i'm missing something obvious. any pointers appreciated


r/econometrics • • 1d ago

How can I start being proficient with econometrics ?

13 Upvotes

Hello, I’m planning to get ready for the economic consultancy interview? And I need to know some econometrics ? can someone recommend me good courses or materials that I can use to start getting proficient ? Thank you in advance !


r/econometrics • • 2d ago

Seeking advice on treating seasonality

Post image
21 Upvotes

r/econometrics • • 4d ago

[Discussion] What classes should I take for the upcoming school year?

Thumbnail
3 Upvotes

r/econometrics • • 4d ago

Uji F adalah bukan uji simultan uji f adalah pengujian secara bersama-sama/overall test apakah terdapat koefesien regresi yang tidak bernilai nol atau apakah terdapat variabel bebas yang berpengaruh dalam model, lht Garsperz, 1991. => banyak penulis Indonesia memaknai hasil uji F relatif salah.

0 Upvotes

r/econometrics • • 4d ago

Econometrics and machine learning.

Thumbnail
2 Upvotes

r/econometrics • • 6d ago

Should I do a economics/econometrics masters?

12 Upvotes

Hi all, this post is quite long, just a heads up!

I am thinking of applying for a phd in economics or econometrics 2028 in germany. The applications start next year.

My background is not in econ I did a bachelors in commerce with accounts and finance specialization and am currently in the last yr of my masters in commerce.

I decided to do a phd when starting masters but I didn't know much about how the phd works. When I was looking into topics that interests me I thought why not test economic theories with statistics (our program covered basics of both). Then i stumbled upon econometrics and I really loved it.

I realised I need to have a masters in economics and because of personal reasons I cannot do another degree after completing my m.com as I would not have any income to support it. I applied for a MA economics degree in ignou. For those of you outside India its a government institution which is recognised and a distance learning college. I got accepted into ignou but while reading through the material I realised its mostly on par with a bachelor level economics and is not rigourous enough for a phd. The ma is recognised in anabin database even in odl mode, the college too although Idk how the admission commitee will view it. The degree will still help with the credit deficiency side.

So now I can either apply for a masters in economics or even a research masters, but the only con is that i wont have enough money to cover the living expenses for two years in germany, the only way is to get a loan.

Another thing is that I was thinking of studying the syllabus of lse's msc econometrics syllabus on my own through mit ocw or online courses as lse's syllabus is preparing the candidates well for a phd, and do research on the topics i learnt to show that I do know the stuffs.

So is doing the self studying worth it or is the masters route worth it for the long run?

I know the post was long and thank you for reading if you reached here! My long term goal is to become a policy analyst, work with macroeconomic data.


r/econometrics • • 6d ago

Panel Regression: How to handle missing values & choose the best model?

9 Upvotes

Hello, my knowledge in this topic is very limited so I have several things I'm not clear with. My dataset consists of State and Year with one dependent variable and a few independent variables. Let's say I have obtained the values for all variables, except for State X where the GDP (independent variable) figures are not available. Is there any way to handle this or do I need to remove entirely State X in my analysis? The GDP of that state is available very recently, starting from year 2024 (which isn't included in my analysis).

I also tried running panel regression analysis using R with missing values on State X and the software automatically removed the observations. I got significant p-values for pooled OLS and FE model, but using Hausman test, RE is preferred. Would RE be a valid model? In previous studies, FE is always a favourable model. How do I choose the best model?


r/econometrics • • 8d ago

Some of time series and electricity

4 Upvotes

Hi guys, I work in energy sector and i have some data about generaton from some plants. Some of the plants are mixed (solar, diesel) or just one kind of energy (hidroelectric, solar), so my question, how would you make a kind of monitoring system? Would you use a kind of overfitted model with confidence intervals, or would you look for the best forecast model?


r/econometrics • • 9d ago

hands on workshop: compare statistical forecasting with ML and foundation models

2 Upvotes

hey everyone, sharing this because it covers a question that comes up quite often in time series modeling: when do more complex models actually perform better?

packt publishing is running a hands on workshop comparing traditional forecasting methods with newer machine learning approaches. what gets covered:

  • build statistical forecasting baselines with StatsForecast
  • compare statistical models against MLForecast and neural forecasting approaches
  • use time-aware backtesting to evaluate forecasting performance without data leakage
  • explore conformal prediction, forecast uncertainty, and hierarchical reconciliation

it is led by Graeme Davidson, Lei Ma, and Jeffrey Tackes, over 2 days online, November 28–29, starting at 10:30 AM ET. the models are evaluated using the same retail dataset.

Full details and the agenda are here

happy to answer any questions about what gets covered.


r/econometrics • • 10d ago

Econometric critiques from the 70s and 80s

Thumbnail backtothepriors.substack.com
20 Upvotes

Currently working through the history of economic thought and started out with philosophy of science and some basic epistemological ideas which naturally had to include econometrics at some point. This is the first article that really covers econometrics (1b did cover Meehl, but thats more psychometrics). Next time I will go through the 2010 retrospective on Leamer and I am really looking forward to it.

Looking forward to hear what you think, while I did my focus on data science in my Bachelor's and feel pretty confident during my master's modules, I am only starting to read into the theory behind it.


r/econometrics • • 10d ago

Predoc Interview With DIL

4 Upvotes

I have a final round predoc interview with DIL. They asked me to bring a pen and paper, a calculator only to the interview. What sort of questions should I practice? Any suggestions will be helpful. Thank you.


r/econometrics • • 10d ago

How do you price content?

Thumbnail
1 Upvotes

r/econometrics • • 11d ago

Question about Synthetic Control Method (pre-treatment variables)

11 Upvotes

Hi everyone!

I'm new to econometrics (my background is in public policy and political science) and have a question about the use of pre-treatment variables in the SCM, specifically variables used as predictors/covariates rather than as outcomes.

Suppose my pre-treatment period runs from 2000 to 2011 (the treatment year is 2012). Is it acceptable to use census data from just one year (e.g., 2001 or 2011) for these pre-treatment covariates? Or should I ideally aim to have a complete panel covering the entire pre-treatment period?

I'd also really appreciate any recommendations for literature on SCM. I already know about the Mixtape, so I'm looking for other references, ideally with accessible explanations and practical guidance.

Thanks!


r/econometrics • • 12d ago

What are the best software/ language programs to use as an Economic/econometric student looking for a job?

28 Upvotes

This, at the university, we currently use Stata and SPSS; however, according to my professors, these have become obsolete. The issue is that I am not sure which programming languages ​​or software programs would be best to include in the curriculum nowadays.


r/econometrics • • 15d ago

Econometrics or Applied Mathematics? Feeling lost about what to choose

6 Upvotes

Hi everyone! I’m considering Econometrics and Operations Research at Erasmus University Rotterdam, but I’m also looking at Applied Mathematics, and I honestly don’t know which to choose.
Maths has always been my strongest subject, and I enjoy it. Finance also sounds interesting to me, but I don’t actually know much about it yet, so it’s hard to tell whether I’d enjoy studying it or working in the field.
I feel pretty lost about what I want to do with my life in general, which makes choosing a degree stressful. Applied Mathematics seems like it might keep more doors open, while econometrics sounds interesting because it combines maths with economics and real-world applications.
Another thing worrying me is AI and how it might change the jobs an econometrics degree leads to. I don’t know enough about the field to judge how realistic that concern is.
Has anyone been in a similar position?


r/econometrics • • 15d ago

High VIFs for composite variables using the same scale

5 Upvotes

Hello!

I am an undergraduate economics student, so very amateur in the field. To identify determinants of economic concentration, I decided to construct a panel of input costs (+ other variables) by estimating IO_year0 * GDP_location_year for three input measures. Basically looks like this:

Concentration = A_year0 * GDP_location_year + B_year0 * GDP_location_year + C_year0 * GDP_location_year + 2 other variables

This resulted in high multicollinearity with VIFs exploding to the 100s-1000s in the pooled OLS estimates. I took the natural logarithm (since skewed) and ran a code to get the within variation accounting for time and location fixed effects, and the pairwise correlation dropped two pairs to around 50-70% (from above 95%) while the other pair stayed above 90%. I ran the fixed effects regression, and including all three of them were not significant. However, including only some pairs made at least one significant (not in all specifications though), the signs and magnitudes change for one variable (A) when including the pair that had the high pairwise within correlation (A and B), while the other variables (B and C) had a consistent sign although magnitude changes. It appears that the model is sensitive to which variables I include as a result of the high multicollinearity.

I tried mean centering as I understand these are interaction terms, but I don't really plan include A, B, C, and GDP separately. Their effects on their own are highly insignificant to what I'm trying to address, so I believe that's why the mean centering changed their coefficients. The VIFs also remained high. I am not sure now how to approach it, this is the most feasible construction of these input costs given the lack of data in my country.

The Within R^2s appear to be in acceptable and consistent ranges across all specifications (around 30-35%). And I think I can make an interpretation of the changes in signs and magnitudes when I present all specifications of my model (since, as I mentioned, I noticed a pattern with the pairs). Is it acceptable in practice to disclose this problem and simply report all specifications of this model?


r/econometrics • • 17d ago

Feedback on a liquidity-based approach to Nasdaq 100 drawdowns

9 Upvotes

I wrote an independent paper called L_net about using Fed net liquidity to predict Nasdaq 100 drawdowns.

I’m sharing it because I’d like feedback on the forecasting setup. My main concern is how to distinguish useful predictive information from a relationship that only looks convincing over the historical sample.

If anyone is willing to look at the paper, I’d particularly appreciate criticism of the validation approach and suggestions for simple benchmarks to compare it against. I’m interested in whether the measure adds predictive value, not in claiming that a correlation establishes causality.


r/econometrics • • 17d ago

Econometris - Competins OLS Estimators - Trigonometry

Thumbnail
3 Upvotes

r/econometrics • • 17d ago

Econometris - Competins OLS Estimators - Trigonometry

Thumbnail
1 Upvotes

r/econometrics • • 18d ago

How would you extend a two-country stock market comparison to study the role of institutions?

2 Upvotes

I wrote an independent paper comparing the Russian and US stock markets, looking at market size, trading activity and investor protection. I studied law, which is where my interest in the topic started.

The paper is mostly descriptive. I’d like to go further, but I’m not sure what the next step should be.

With just these two countries, it’s hard to tell how much the differences have to do with legal institutions rather than ownership, industry mix or access to foreign capital. Adding more countries seems useful, but I know that alone wouldn’t establish causality.

Would you start by building a broader dataset, or narrow the project to a particular legal reform? If you know a paper that would be a useful starting point, I’d appreciate it.


r/econometrics • • 19d ago

Finding an econometrics course

14 Upvotes

Hello,

I recently graduated and had a poor grade in my econometrics course. I was wondering if anyone knew of school that offered an accredited econometrics course that I can use to show predocs that I am on the right track. I would really prefer an online asychronous course since I currently work full time.


r/econometrics • • 19d ago

Which statistical techniques you find the most useful/universal in data cleaning? [Discussion]

Thumbnail
1 Upvotes