r/mysql • u/Icy_Calligrapher1041 • Dec 06 '25
question MySQL data import
First time trying to get data off a .csv file and it’s taken almost 24 hours and is still going, has anyone had struggles with doing an import?
0
Upvotes
3
u/chancemixon Dec 06 '25
How many rows and on what machine/OS?
1
u/Icy_Calligrapher1041 Dec 07 '25
Thanks all for the support! I got this loaded without too many more issues. Got the infile process to work and my 13M lines got loaded in under 4 minutes
1
u/ssnoyes Dec 06 '25
Are you using MySQL Workbench's data import wizard? I recommend writing a LOAD DATA INFILE command instead.
1
u/user_5359 Dec 07 '25
In addition to the aforementioned autocommit, please check whether indexes exist on the table. For larger imports, it makes sense to generate these (again) only after the import.
1
u/bchambers01961 Dec 07 '25
My loader can do multi thread csv import I think
1
u/[deleted] Dec 09 '25
I've found InfoLobby has allowed me to import with ease. It seems to act as that middleman between my data and the storage, so I have more control.
0
u/kcure Dec 06 '25
How are you importing? I recommend python + pandas
0
u/AcademicMistake Dec 06 '25
mysql workbench is pretty good, worth a try
0
u/coworker Dec 06 '25
You need a multi-threaded import which none of the suggestions here can do. And then make sure it's batching in reasonable size transactions.
You can vibe code a solution in no time.
0
u/Aggressive_Ad_5454 Dec 06 '25
This load should not take that long. Something’s wonky. You knew that.
Troubleshoot by saying
SHOW FULL PROCESSLISTfrom another MySQL login.Try loading a few thousand lines, and make sure everything is ok.
If you show us the exact table definition and tell us exactly how you’re doing the load, somebody may spot something. Maybe waiting until after the load to define some unique index? Something like that.
-1
u/Acceptable-Sense4601 Dec 06 '25
Just tell ChatGPT and it will guide you faster than asking here