Downloading data from webpage

[susukavi]

Team,

Need your help in solving my requirements using Alteryx.

1.Connect to a webpage

2.Apply date filter

3.Download the data and Process it in Designer.

Your help is much appreciated.

Regards,

S

[jmgross72 · Accepted solution]

I have not seen any features similar to "Get Data from Web" in Alteryx. 
One approach I might try is to create a program outside of Alteryx that can connect to, filter, and download the data, then use a run command tool in Alteryx thereafter.  

Probably not the easiest or best answer, but I hope this helps.  

[alexnajm · Accepted solution]

@susukavi sounds like you should look for an RPA tool! UI Path, Automation Anywhere, etc.

Connecting to the webpage and downloading the data can be done with the Download tool in Alteryx, but not the "apply date filter" part (unless you can introduce it as part of the API in the download tool)

[lwolfie]

I've been able to calculate the web address for different dates before.  I'm not sure if that's an option or not.  Or there might be another site that is better for downloading data the same data that doesn't look as pretty.  I'm not sure the site you are trying for.

[jrlindem · Accepted solution]

I would recommend using Python tool to code a simple web-scraper. 

1.  Use the static URL for the website, and have the code look for files that match the format of the link/file you're searching for on that page

2.  Pass the found, new URL of the file(s) into your workflow

3.  Use the download tool and that URL