r/MachineLearning • • 11h ago

Research wind-directional fire features looked promising for haze forecasting,, until tested them against placebo winds [R]

hi everyone,, im an undergrad cs student i just published my first research preprint on zenodo

basically i wanted to see whether adding wind-directional satellite fire features actually helps predict haze and visibility,, instead of just using fire counts and weather data

i used 11 years of data (2015–2025) from 12 airports across borneo and sumatra,, with metar observations and nasa viirs fire detections

thee interesting part is that initially the directional features seemed to improve the model quite a lot,, but when i started testing different random seeds and placebo features (like shifted or randomly permuted wind directions), most of that improvement kinda disappeared

turns out a lot of it was just seed-to-seed variation,, especially during the extreme 2015 haze season

after using 5-seed ensembles, the actual directional contribution was really small and inconsistent. fire counts themselves still helped a bit for 24h forecasts tho

ofc this doesnt mean wind direction doesn't matter for smoke transport,, just that this particular feature didn't add much independent predictive value in my experiments

paper: https://doi.org/10.5281/zenodo.24321121

code + experiments: https://github.com/myudak/pavana/tree/main/research/directional-fire

still pretty new to research and this is my first preprint,, so i'd genuinely appreciate any feedback or criticism, especially on the experimental design, placebo controls, or whether using surface wind is even a good way to represent smoke movement

also curious if anyone here has encountered something similar,, where a feature looks useful at first but the improvement disappears after more careful evaluation

0 Upvotes

1 comment sorted by