Web Scraping Data With Inputs

Question

Hi,

I am trying to get data out of a government website.  The base page takes three inputs to get what I want.  A drop down for airport / terminal, a start date, and an end date, the dates have default values in them.

I am trying to use the download tool, but don't see a way to feed it the parameters with a text input tool.  The website doesn't redirect to a new page when you enter the parameters, it just dumps the output to the page.  Honestly I could live with the default dates and just filter my data against my final output.

The web page I am trying to scrape is http://awt.cbp.gov

I have Intelligence Suite if that helps.

Tim

1 CBP Base Page.png

2 CBP Page With Param.png

3 CBP Page with output.png

Timothy_Leber · Answer

We are using Selenium right now and it seems extremely fragile and prone to breaking.  Right now it is getting the data, but not bringing it down.

chuckleswk · Answer

I don't think that Alteryx would be the right tool for this.

You would have better luck doing this in Python using Selenium. I don't believe that Alteryx would be able to input the filters that you would like... though I could be wrong.

Alternatively, you could use the python tool in Alteryx to run the Selenium script and pull back the data.