Azure Data Lake Tools

[#1]

Microsoft Azure Data Lake Help Page

Use the Azure Data Lake Store (ADLS) Input to read data from files located in your ADLS to your Alteryx workflow and Azure Data Lake Store (ADLS) Output to write data to files in your ADLS. The supported file formats are CSV, Excel, JSON, and Avro.

Current version

Azure Data Lake Tools v2.4.0 (November 30, 2022)

• Improved write performance and stability.

• Added option to tweak memory consumption and performance by modifying variable upload chunk size.

• Fixed issue where XLSX data were truncated when cells contained more than 255 characters.

• Fixed issue with non-Unicode characters in SSL certificates.

Previous versions 

Azure Data Lake Tools v2.3.0

• Compatible with Designer and Server 2021.4.2 Patch 4, 2022.1 Patch 2 and later.

• Compatible with AMP engine only.

• Added support for DCM.
  • DCM is required for running this connector in Alteryx Server.

• FIPS capable.

• SSL/TLS validation is now performed against Windows Certificate Store.

Azure Data Lake Tools v2.2.0

• Allows user to specify custom CSV delimiter in Output.

• Fixed potential XXE vulnerability.

Azure Data Lake Tools v2.1.0

• Compatible with Alteryx Designer and Server version 2021.2 and later.

• New and improved user interface.

• Fixed minor issues.

Azure Data Lake Tools v1.1.0

• Fixed end user authentication errors.

• Allows users to specify redirect URI for end user authentication.

Azure Data Lake Tools v1.0.2

• Updated Code Page options.

• Distinguished between encodings with same language (e.g., ‘Language’ -> ‘Language (specific code)’) and ordered encodings alphabetically.

• Allowed user to specify encoding for CSV files on output tool.

• Improved error message to indicate when an invalid store name is provided.

• Improved data conversion handling to not throw a warning instead of an error when a field is missing a value.

• Fixed error where the files/folders displayed are not refreshed after user changes store name.

• Fixed issue where default value settings were occasionally not respected.

• Disabled production logging to prevent permissions issues for different installations/configurations of Designer and support scheduled workflow functionality.

Azure Data Lake Tools v1.0.1

• Fixed issue preventing packages from being installed successfully.

Azure Data Lake Tools v1.0.0

• Initial release for Azure Data Lake File Input and Azure Data Lake File Output.

This tool uses a .yxi file format. A .yxi file is a package that includes an Alteryx Tool and all of its dependencies zipped into a single file. When this file is imported into Alteryx, the tool is added to the tool palette in the category specified by the tool.

When sharing a workflow that uses a .yxi tool, the tool is not included and must be installed by the recipient.

[akspande]

This keeps failing on Alteryx 2021.2 x64. :(

[sergeyr]

Experiencing the same issue on Designer x64  version 2021.3.5.03604

[abstractk]

I experienced the same issue with version 2022.1.1.25127. 

Would love to know if there is an open discussion on this issue & the solution.

[AlteryxNewbie]

The current version(2.2.0) of the tool is not working well with Event based trigger in ADF.

The tool creates a trigger upon file ceation (0 bytes) instead of waiting till the file is written completely on to ADLS. 

After analyzing the logs with Microsoft support, we came to know that the tool is not setting the parameter 'close' to 'true' and hence not sending the signal to event grid for the file write completion. - Path - Update - REST API (Azure Storage Services) | Microsoft Docs

Request you to please fix this issue in the next version of the tool. We spoke to Alteryx support but did not get any timeline regarding the fix.

[akhodjaev]

Any updates on this?

[kennet82]

Any update?

[fernandoantequera]

Hi all,

I've installed Azure Data Lake Tools for the first time today and I have this issue where the tool is blank and doesn't let me configure it.

I posted a thread discussing the issue here, just in case someone can help or has the same issue: https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Azure-Data-Lake-Input-Tool-is-blank/m-...

Thanks!

[rajparulekar1]

Hello,

Whenever I try installing this tool, I get the following error. Can anyone help. Thanks!

[Rodrigo_Amaral]

Hi All and @rajparulekar1,

I had the same problem here at my company. We analyzed that the server we were trying to install this package there was no connectivity to the internet. Solution: The Server must have Internet output to download the python background packages. Thank you

[rachelkurtz]

Hello! I am having some issues with this. Even when I put in the information and select a file to connect to, I get the error that it is "missing incoming connection". Any help would be much appreciated! 

[Franz]

Hi everyone,

I can confirm that the ADLS connector ver. 2.3.0 works for us on the Designer (ver. 2022.1.1.30961 - which I believe is the latest as at OCT 2022);

There 's some fiddling needed in the Azure storage side to enable the Gen2 connectivity from our corporate network (Container, storage account, networking etc). We had to work directly with our Microsoft account person to get the configuration done. 

[Hamder83]

Can I use wildcard to search for files? 

or enable subdirectories?

[jacekDziuba]

Is there documentation on ADLS xml configuration?

I want to limit the number of rows to download from my resource, but I couldn't find this option anywhere.
Perhaps by adding an xml line in configuration could help?

[lotto009]

Thank you for sharing

[akhodjaev]

Does anyone have issues with this tool with Alteryx 2022.3.1.430 version?

I am unable to push data to Azure, although it seams I am connected and I can navigate to different path.

but receiving this cryptic message: Error: Azure Data Lake File Output (1): Error in existing file operations.- Failed to connect to platform

Connected to Gen 2 with S2S authentication.

[Hamder83]

Anyone knows how to use filename from stream as FilePath on Azure Data Lake File Output ?

[Ham]

@Hamder83 - I am having same issue.  Can someone help on how to get dynamic file naming for bulk insert activity?