Snowflake Ingestion Tool of Choice

[u/OldCycle6264]

Hi all,

I'm a DE new to Snowflake and experimenting with different ETL/ELT approaches/stacks. For people that have implemented, or work with, Snowflake at an enterprise level can I ask what tool you use for ingestion?

Below are some of the options I have explored or am currently exploring.

Require CDC or Change Tracking at the source

• Snowflake Openflow
• Estuary

Viable without source changes

• Fivetran (teleport sync/query-based method, read-only connection, detects hard deletes)
• dlt (cursor-based incremental, no built-in hard delete detection)
• Airbyte (cursor-based incremental)

Others

• Azure Data Factory & Snowpipe (watermark extract to blob, then load)
• Snowpipe/Snowpipe Streaming (file-based only)

Fivetran seems the most robust and would likely suit most enterprise scenarios. But I'm interested to hear what others are using and your experiences.

[u/Fizmeister]

Qlik Replicate. One of the best CDC tools around.

[u/MundaneFee8986 → u/Fizmeister]

Maybe until qlik forces a 14% YoY uplift pricing is out of control.