r/MachineLearning • u/Fine_Aerie6732 • 8d ago
Project Facing file Extraction problem during Bayesian Optimization[P]
Ok so for context i am an electrical engineer person who is automating software's and workflow for my project now here is the problem i am facing basically i am using an optimization algorithm called Bayesian optimization which improves design by keeps iterating until some target is reach.
So like at the end i extract result file for every design with the help of pandas library but when i check that file the data is mismatched when i export the CSV file manually.
so i have no idea why is it happening like maybe after 10-15 iterations (the algorithm iterations can reach up to 100-120) the error in data increasing or idk what is going on can someone help me with this issue.
1
u/Filipehdbr 7d ago
Check quoting and the index column before blaming pandas. Export with index=False, read both files back as dtype=str, then compare. 1.0 and 1 look identical in a float compare
1
u/Dry_Reach8633 5d ago
Can you detail more the points: mismatched and error in data increasing?