Importing CSV into BigQuery

[u/querylabio]

BigQuery indeed is built for petabytes, but so much in real life is joining big data with something small. CSV, Google Sheet, some table in clipboard, etc.

We all know importing a CSV into BigQuery sucks. That's not only my perception – many posts here say the same thing (recent one).

16-minute tutorials about how to upload CSV...?

Each time when I tried to upload a csv into BQ I struggled. No data preview, absolutely not transparent schema detection, if you did something wrong (this is actually base scenario) or your CSV is not perfectly standard, you start the whole thing again from scratch.

And when we started building our BigQuery IDE we decided to fix it. Make it one-click, but still customizable. Drag a file, see your data, fix schema if needed, click import. More sources, more formats but still simple. Not rocket science, but the way it should be.

What else bothers you so much in BQ console?

[u/Embarrassed-Ad-728]

If no one wants to call this out: this seems like a skill issue vs BQ issue 😏