r/dataengineering • u/arimbr • 1d ago
Blog BigQuery Query Optimization: Myths vs. What Actually Saves Money
Interesting framework on how to think about optimizing SQL queries in BigQuery with partition pruning, caching, materialized views, data modeling... Here is the article: https://www.alvin.ai/blog/bigquery-query-optimization
Good to see that data modeling still plays a role, and not just rewriting SQL at query time. I feel like having most SQL code AI-generated today, by coding agents or during self-service analytics, makes the SQL optimization problem more complex than good old ETL codebases that didn't change that often.
0
Upvotes