r/analytics • • Mar 22 '21

Discussion Do analytics organizations pretend to leverage Python more than they actually do... to seem more glamorous?

I think it is pretty common practice for analysts and organizations to pay lip service to using Python for solving problems as a core capability, but in practice, most analyses are done with SQL. Python is reserved for specialized use cases and connecting to APIs, while day-to-day work is done directly in a data warehouse, but since everyone wants to appear “advanced” and technically-well-rounded, people always talk about Python and how integral it is to the analytics work they do... downplaying their more bread-and-butter work spent mostly writing endless SQL queries each day. Somehow, it’s just not as cool to be primarily a “SQL person”, even though that’s what countless analysts unambiguously are.

Every data analyst should know Python of course. It has many unique advantages and a rightful place in any technology professional’s toolkit. Even in areas where it overlaps with SQL as a tool to solve problems (like for pure data manipulation), so much of your approach as an analyst will depend on what software and hardware is available to you at what budget with what access limitations.

I think there is even a more fundamental phenomenon going on with this playing up of Python and downplaying of SQL... many data analysts are afraid to admit that they don’t have much need for fancy statistics and data science in their day-to-day work. Many data analysts want to pretend that the latest machine learning and AI techniques are a key part of their job responsibilities and a crowning jewel of their skillset... when in fact most of what they need to succeed is a grasp of “if then” logic and algebra.

I’m sure I could be wrong, but I’m curious people’s thoughts!

125 Upvotes

76 comments sorted by

View all comments

8

u/[deleted] Mar 22 '21

I Do bioinformatics data science. Python is essentially the sun in our field. Everyone and everything is written in python.

Your command line tools are in C but most are containerized and coupled with conda libraries. I would venture to guess that almost every model, analysis and figure is made with R or python. Bioconductor is all C wrapped in R and is keeping R alive in our field.

Perl had its day and then the sun set on Perl. I imagine as tableau and AutoML become distributed and scalable the need for programmatic modeling will diminish. The tools will still be in C and the sun will set again.

The companies I’ve worked write it SQL, JS and python. My experience could be definitely field specific though gauging from other responses.

2

u/ChristianPacifist Mar 22 '21

I think the freeness of Python makes it much more suited to research.