How to connect to Azure Data Lake (ADLS) Gen 2

[MarkelioH]

Prerequisites 

• Alteryx Designer
  • All Versions
• Azure Data Lake
• Admin access to Microsoft Azure Portal

 

Procedure in Azure Portal

1. Register an application with Azure AD​

2. Set the Redirect URIs in the Application​ (Default Redirect URI: https://login.live.com/oauth20_desktop.srf)

3. Create the client secret and save it in a safe place for later use.
Note: You will need to have a client secret only if using End-User (Advanced) or Service-Service authentication type.


You can find more information about the Authentication types in the Help guide.

4. Create the Data Lake Storage 2.
Note: You can skip this step if you already have a Storage Account.​

5. You might need to work with your Azure Admin to decide which Azure RBAC the application/user(s) need to have to access the Data Store in Azure Data Lake. You can find more information about the Authentication types in the Azure Data Lake API.


Note:

• If using the "Service to Service" authentication type, the application created on Step 1 will need to have permissions to the Storage.​

 



 

• If using the "End-User Advanced" authentication type, the user(s) will need to have access to the Storage. 

 

• If using the "Shared-Key" option, use one of the Access Keys from Azure Portal to authenticate to the Storage within Designer. 

 



 

Connect to Azure Data Lake Storage in Designer 

 

1. Add Azure Data Lake File Input or Azure Data Lake File Output on the Designer canvas.
2. Select the tool to see the Configuration panel on the right.
3. Fill in the authentication data with the ones available. 

• If selecting End-User Basic, once you hit the "Connect" button, you will be redirected to a web browser window to authenticate to Azure. 
• If selecting End-User Advanced, Copy Directory ID (tenant) and Application ID (client) to the Designer.
• Paste Client Secret if connecting in Service-to-Service mode. 
• If using the "Shared-Key" option, copy the Storage name and one of the Access Keys from Azure Portal and paste them into the tool configuration.

 

4. You will be prompted to specify the Storage name and select the File System name you want to read or write.
You can find more information about File formats and configuration on the Help guide

[Treyson]

I have been trying to connect directly using the Apache Spark drivers (Apache Spark ODBC and Apache Spark on Databricks), both bringing up their own issues. They work, then they don't on certain things. 

Have you heard of anyone doing IN-DB on ADLS with Alteryx? If so, do you know what drivers they are using?

Thank you,

[MarkelioH]

Hey @Treyson , 

Thank you for reaching out. 

The only tested and validated way to connect to ADLS is by using the ADLS connector .