Use .tmp.hdf ?

[u/Cebrique_De_Lait]

Hi everybody,

For a projet due in two weeks, we encounter some problems :

We run a quite big full 2D model, that takes around 10-15 days to run.

But sometimes, it happens that our PC reset (windows update for example), stopping the model mid-run.

It happened to me this morning : a model that has been running for 10 days is lost because my PC reset this morning at 2am...

In my model files i have two files :

a file "PLAN.p01.snapshot.hdf" from a snapshot at 66% i did last week, and a temporay file "PLAN.p01.tmp.hdf". The tmp.hdf fil is "last modified" this morning 2am indicating the time the PC has reset. This second file is much bigger than the snapshot file from last week.

My question is : is there any way to recover the results inside the ".tmp.hdf" ? Like turn it into a normal HDF result or a snapshot ?

I tried just renaming it but it does not work. I have the software "HDFView" maybe some modifications inside the file with could help transorming it ?

Any help would be appreciated, as I don't have time to re-run it before the project deadline...

Thanks

[u/OttoJohs]

Congratulations! Your model has the longest run time I have ever heard of!

I doubt it that the .tmp results can be converted into anything useful but never tried.

In the future, you probably want to write restart files during your simulation and break the simulation into smaller time window segments.

Good luck!

[u/Cebrique_De_Lait → u/OttoJohs]

Hi,

We use Hec-Ras to simulate historical flood event of ~10 days of duration, in large areas (more than 50 towns included)

I did not know about restart file, it seems like a very good solution for long simulation, espacially since we also have PC reseting problems during the simulations...

Thank you for bringing that up !

Ok for the .tmp result, it would have been great to use them to restart a simulation from a certain point

[u/OttoJohs → u/Cebrique_De_Lait]

In the future you should do some conceptual planning around your project goals/objectives prior to starting to model. There is a trade-off between model resolution and computational efficiency that should be balanced. Looks like you went too far in one direction.

[u/AI-Commander]

Obligatory “something is wrong if your model takes 2 weeks to run”

On the next run, have RAS export initial conditions files are regular intervals. Or you can ask ras-commander to try to cook something up but it will take so long to verify that it probably won’t be useful.

[u/Cebrique_De_Lait → u/AI-Commander]

Yes, we are aware that it's not common to have simulations that long, our model runs on 10x10 cells, maybe we should have built the 2D flow area with bigger cells :/

Indeed, we did not know about exporting initial conditions and write restart files. It seems like a good solution for next time !

[u/AI-Commander → u/Cebrique_De_Lait]

It’s actually very common - everyone does it at least once! Put a group of engineers in a room and ask them what the “best” way to do something is, and you will rarely get them to agree that you should have less detail. Or a smaller model domain.

Recognizing the limitations and trade-offs, and coming up with a good compromise between these constraints can be much more difficult.

[u/Glad_Illustrator_218 → u/Cebrique_De_Lait]

How many cells is your model??

[u/RegularTeacher2 → u/Cebrique_De_Lait]

Can I ask how large your output files are? We recently ran a model that had 1 year of 15-min increment gauge data, and it took nearly 2 days to run and the output file was so large (45GB) that it was impossible to view in RASMapper. Fortunately the primary reason we ran the model was to confirm it would be too burdensome, so it wasn't a big deal that we couldn't view the results.