I'm having trouble with the amount of time it takes for the ADL connector to upload a file. When I run my workflow and output the 50MB CSV file to a local file it only takes about 30 seconds to run. However, when I swap out the Output Data tool for the Azure Data Lake File Output Connector and try to rerun it, it takes over 20 minutes to run the same workflow. Needless to say, I can't afford to lose that much time due to changing the connector. Has anyone else run across the same issues or know of a solve?
Writing to Azure will be slower than writing to a local file, but I wouldn't expect this to take 20 minutes for this small of a file. Would you be able to enable "performance profiling" from the Workflow > Runtime window in Designer and share the result for the workflow with the ADL tool?
@hftrc001
We've released new version of ADLS connector, with improved write performance. You can download it here: https://community.alteryx.com/t5/Community-Gallery/Azure-Data-Lake-Tools/ta-p/852262