We are celebrating the 10-year anniversary of the Alteryx Community! Learn more and join in on the fun here.
Start Free Trial

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Azure Data Lake Connector upload speed

hftrc001
5 - Atom

I'm having trouble with the amount of time it takes for the ADL connector to upload a file.  When I run my workflow and output the 50MB CSV file to a local file it only takes about 30 seconds to run.  However, when I swap out the Output Data tool for the Azure Data Lake File Output Connector and try to rerun it, it takes over 20 minutes to run the same workflow. Needless to say, I can't afford to lose that much time due to changing the connector. Has anyone else run across the same issues or know of a solve?  

2 REPLIES 2
JakeS
Alteryx Alumni (Retired)

@hftrc001 

 

Writing to Azure will be slower than writing to a local file, but I wouldn't expect this to take 20 minutes for this small of a file. Would you be able to enable "performance profiling" from the Workflow > Runtime window in Designer and share the result for the workflow with the ADL tool?

 

 

Jake Samuels

Principal Support Engineer
Alteryx, Inc.
JakubSt
Alteryx Alumni (Retired)

@hftrc001 

We've released new version of ADLS connector, with improved write performance. You can download it here: https://community.alteryx.com/t5/Community-Gallery/Azure-Data-Lake-Tools/ta-p/852262 

Jakub S., Technical Product Manager, Data Connectors
Labels
Top Solution Authors