Azure Data Lake - Extract Files Like

Question

I would like to connect to Azure Data Lake and extract all of the JSON files within that directory similar to a Dynamic Input Tool.  All of the files in the directory have the same schema within them.   Each week it could be 500 or 5000 files. What are my best options?

Thanks in advance community!

IraWatt · Answer

Hey @MatthewBr,

My first port of call would be to try the Azure Data Lake Tools - Alteryx Community. I also found an interesting article on downloading using using precog: Precog + Alteryx: A Slam-Dunk Analytics Partnershi... - Alteryx Community. If nether of these are the answer there is always the download tool.

As you may need to look through directories to download different files I would recommend a batch macro, with the links to the different files being the control parameter.

If you want clarification or have any issues feel free to ask :)

All the best,

Ira