Web Scraping

[zaina1498]

Hi, I am trying to extract all the lines which have say "You'll learn how to" or "You'll Learn How to" or "You'll learn to". Would appreciate any help! Workflow is attached below. Thanks!

[AngelosPachis]

Hey @zaina1498 ,

Your macro is not included in the yxmd file, you should create a packaged workflow and then share it

[zaina1498]

Hi @AngelosPachis 

Oh I wasn't aware of that, my bad! Are you able to access it now?

[AngelosPachis]

Yeap, thank you

[AngelosPachis]

So I've managed to get 69 records that contain the string you asked for. You don't necessarily need a batch macro for that, but let me know if that was what you are looking for.

Also, please make sure that you aware of the ethics behind web-scrapping and you might want to check with Alteryx if it's ok to webscrape their pages.

https://towardsdatascience.com/ethics-in-web-scraping-b96b18136f01

[zaina1498]

@AngelosPachis 

Okay sounds good. So I see that you have extracted the lines with "You'll learn how to" but I also needed the bullet points under each one, which is why when I parsed it I used the delimiter, <P>&nbsp;</P> to split it so that the bullet points under You'll learn how to don't get split up. Since you split it up line by line, the information under the You'll learn how to, doesn't carry forward. Do you see what I mean? So is there a way for me to extract the You'll learn how to: and the points under it as well? Thanks again for you help!

[AngelosPachis]

Yes I think that's doable, but in your question above you mentioned nothing about the bullet points. 

Let me have a look 🙂

[zaina1498]

@AngelosPachis 

Okay sorry about that! Thank you!

[AngelosPachis · Accepted solution]

Hey @zaina1498 ,

I have also included the bullets in the workflow, hopefully this is good enough do you mind checking?

[zaina1498]

@AngelosPachis 

That's perfect!! Thank you so much for your help! Have an amazing day!:)