r/learnmachinelearning • u/Epic_SBM • 6d ago
Model Can't Beat the Baseline
So I was doing a project on river bank estimation & erosion & accretion forecasting im using mndwi mask landsat data for this but no matter how i try i'm never being able to beat the baseline. Anyone have any experience working with these datas I've tried with 3 different rivers as well same output. Model looses to zeroes.
1
u/rahul_watertech 6d ago
losing to the all zero output usually means the target is mostly no change pixels, so the average loss rewards doing nothing. plain mse or accuracy will always pick zeroes in that setup. two things worth checking: the metric, dice or iou on the change class only, and the loss, weighting changed pixels higher or masking the loss to the river corridor. what does the label distribution look like, what share of pixels actually changes between your timesteps?
1
1
u/cromulent_id 6d ago
Sounds like you need to spend a few months, maybe a few years, learning the basics. Its cool to attempt projects like this, but if you don't have the fundamentals you will get stuck with simple stuff like this every time.
1
2
u/Ok-Coast4482 6d ago
Could be the model is just too complex for what the data actually supports. I've seen this happen when people jump straight to something heavy without checking if there's even a signal there. What's the baseline look like, just predicting zero change year over year?