Start Free Trial

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Do not find tabulated data in downloaded data, webscraping

Roche
8 - Asteroid

Hi everyone, 

 

On the website F5 platform lifecycle support policy  the some of the tables' dates are displayed as links.  I give the output for the links of table 1 in the attached flow input.  I am trying to get the tables for each of these links but the flow that I have built does not display the tabulated data as I request in the filters.  Can someone perhaps help me understand what I should be doing to get the tabulated data?

 

Thank you for helping!

 

Rouche

5 REPLIES 5
IraWatt
17 - Castor
17 - Castor

Hey @Roche,

The tables your looking at are added after the page is loaded by JavaScript, you will need to use a web scraper for dynamic websites. You can tell this by looking at the page source view-source:https://support.f5.com/csp/article/K11373239 this shows the static information the page comes with and the table is not part of that.

If you need more info feel free to ask. 

All the best,

Ira 

Roche
8 - Asteroid

Hi @IraWatt, thank you for mentioning that.  I am still new to webscraping, but have done some work on it.  Have not come across static sites yet and how to deal with a case as you mention.  So would like to ask if you can help on this one.  I see the code in the page code so thought that it is HTML, but understand what you say.  How can I then get the tables?  Thank you, appreciate your help

IraWatt
17 - Castor
17 - Castor

No worries, this article here explains the problem and how to get round it Scraping dynamic HTML in Python with Selenium | by zhang wei | Medium. Essentially using the python tool in Alteryx you can do it.  

IraWatt
17 - Castor
17 - Castor

Other people on the community have also tried this: Solved: Re: Dynamic Web scraping - Alteryx - Alteryx Community

IraWatt
17 - Castor
17 - Castor

If Dynamic web scraping was the answer in this case feel free to give a green tick to the answer ;)  

Labels
Top Solution Authors