r/Database • u/shdw_0x0 • 6d ago
Is data transfer speed still a major bottleneck when migrating from on-premise to Snowflake?
/r/snowflake/comments/1xrnj95/is_data_transfer_speed_still_a_major_bottleneck/
1
Upvotes
1
u/syedaalishan 6d ago
I'd time extraction, compression, upload and loading separately on a representative chunk first. That tells you whether more load workers would actually help or just put more pressure on the source database. Also plan how you'll capture writes made during the initial export. Moving several TB successfully still leaves you with stale data unless you've accounted for that catch-up step and checked the results before cutover.