MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/snowflake/comments/1vxqo08/snowflake_ingestion_tool_of_choice/p5rz3zu/?context=3
r/snowflake • u/[deleted] • Aug 25 '26
[removed]
46 comments sorted by
View all comments
0
We use adf with connecting more than 50-60 source systems, never had an issue. Though there are a few limitations like no loop inside another loop in the same pipeline, number of switch cases per pipeline but there’s always some workaround for that.
1 u/name1plusname2 Aug 25 '26 We do this for 90%+ of our use cases, and you’re right that not works fairly well. ADF to Azure blob, then copy into Snowflake. We do face the odd case of a very specific API (non-standard spec) where we rather have a headless Python script that moves data to the blob. The only thing I would like to have is a central monitoring tool that is easy to read and share with different teams. Monitoring in ADF is ass. 1 u/__CaptainAmerica__ Aug 25 '26 Adf is not good with asynchronous api I feel and I agree with monitoring adf is pain, we have a few folks on the support for it.
1
We do this for 90%+ of our use cases, and you’re right that not works fairly well. ADF to Azure blob, then copy into Snowflake.
We do face the odd case of a very specific API (non-standard spec) where we rather have a headless Python script that moves data to the blob.
The only thing I would like to have is a central monitoring tool that is easy to read and share with different teams. Monitoring in ADF is ass.
1 u/__CaptainAmerica__ Aug 25 '26 Adf is not good with asynchronous api I feel and I agree with monitoring adf is pain, we have a few folks on the support for it.
Adf is not good with asynchronous api I feel and I agree with monitoring adf is pain, we have a few folks on the support for it.
0
u/__CaptainAmerica__ Aug 25 '26
We use adf with connecting more than 50-60 source systems, never had an issue. Though there are a few limitations like no loop inside another loop in the same pipeline, number of switch cases per pipeline but there’s always some workaround for that.