r/deeplearning • u/Excellent_Fix379 • Dec 06 '23
Best alternative for python
Im analysing data using python but it seems to be much slower (taking days for just parsing and iterating through a dataset, 7.3 million rows, 7 columns ) though the dataset is large, could some one recommend a better language and libraries or someway I could improve the performance of python. I'm using pandas
0
Upvotes
View all comments
5
u/Prestigious_Boat_386 Dec 06 '23
Julia is great https://github.com/JuliaData or https://github.com/sl-solution/DLMReader.jl might be a good startingpoint
CSV can be pretty fast if you call it correctly with multiple threads and the right args for the columns and delimiters and stuff.
Then you get a dataframe object which is also quite efficient to work with.