We are celebrating the 10-year anniversary of the Alteryx Community! Learn more and join in on the fun here.
Start Free Trial

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Web Scraping Data With Inputs

Timothy_Leber
7 - Meteor

Hi,

 

I am trying to get data out of a government website.  The base page takes three inputs to get what I want.  A drop down for airport / terminal, a start date, and an end date, the dates have default values in them.

 

I am trying to use the download tool, but don't see a way to feed it the parameters with a text input tool.  The website doesn't redirect to a new page when you enter the parameters, it just dumps the output to the page.  Honestly I could live with the default dates and just filter my data against my final output.

 

The web page I am trying to scrape is http://awt.cbp.gov

 

I have Intelligence Suite if that helps.

 

Tim

2 REPLIES 2
chuckleswk
11 - Bolide

I don't think that Alteryx would be the right tool for this.

 

You would have better luck doing this in Python using Selenium. I don't believe that Alteryx would be able to input the filters that you would like... though I could be wrong.

 

Alternatively, you could use the python tool in Alteryx to run the Selenium script and pull back the data.

Timothy_Leber
7 - Meteor

We are using Selenium right now and it seems extremely fragile and prone to breaking.  Right now it is getting the data, but not bringing it down.

Labels
Top Solution Authors