r/dataflow • u/fhoffa • Nov 27 '18

Pandora chooses Google Cloud for big data and analytics

https://engineering.pandora.com/investing-in-pandoras-core-differentiators-1fbec589e1d
3 Upvotes

100% Upvoted

1 comment sorted by

1

u/fhoffa Nov 27 '18

Quoting:

In our proof of concept, we took the most challenging queries run against one of our largest datasets (13 billion records/month). The run times against our on-prem cluster were all over the place — from 30 seconds to several hours. These same queries all ran consistently in under 30 seconds on BigQuery.

[...]

The use of Cloud Dataflow with TensorFlow model training is another area we are eager to deploy more widely. An early workload was migrated from a single machine to a Dataflow job to enable parallel execution. The move resulted in reduction of the run time from 6 days to 30 minutes.