Webscraping data from a link that opens in another webpage

Question

Hi everyone,

I have to webscrape data from the following website:

https://appsource.microsoft.com/en-nl/marketplace/partner-dir?filter=sort%3D0%3BpageSize%3D18%3Bonly...

Looking at the code there is certain information that can be webscraped from the partner details on the current webpage.  After having this information, if you click on a partner it will take you to another webpage - this is the information that I am looking to webscrape.  However, I do not see any link in the code that leads to this webpage.  Can someone please help me on this one?

Would appreciate your assistance!

Thank you,

Rouche

markcurry · Answer

@Roche , while not ideal, you could use the links from the workflow to display the various page results from the API in a browser, then copy the results for each page into a text file, then use Alteryx to process the text files.   Hopefully someone else has a more elegant solution.

Roche · Answer

Hi @markcurry .  Thank you for helping, appreciate it.  Since it looks like it will be somewhat of a struggle etc. I will put this project aside for a while or perhaps not continue with it.

DavidSta · Answer

Just as an idea we don't do the work twice, can we focus on one thread for this topic?

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Webscraping-data-that-does-not-provide-a-link-needed-for-further/td-p/956111