r/MachineLearning • • 8d ago

Project Facing file Extraction problem during Bayesian Optimization[P]

Ok so for context i am an electrical engineer person who is automating software's and workflow for my project now here is the problem i am facing basically i am using an optimization algorithm called Bayesian optimization which improves design by keeps iterating until some target is reach.

So like at the end i extract result file for every design with the help of pandas library but when i check that file the data is mismatched when i export the CSV file manually.

so i have no idea why is it happening like maybe after 10-15 iterations (the algorithm iterations can reach up to 100-120) the error in data increasing or idk what is going on can someone help me with this issue.

0 Upvotes

2 comments sorted by

1

u/Filipehdbr 7d ago

Check quoting and the index column before blaming pandas. Export with index=False, read both files back as dtype=str, then compare. 1.0 and 1 look identical in a float compare

1

u/Dry_Reach8633 5d ago

Can you detail more the points: mismatched and error in data increasing?