HTML webscrapping

[Tanai_Goncalves]

Hello all,

I`m having a headache to parse this page: https://www.cmegroup.com/market-data/cme-group-benchmark-administration/term-sofr.html

I`m trying to reach the SOFR table, but the results I`m getting from the download tool are very different from the html elements page from browser.

<div class="main-table-wrapper" role="presentation">

Any thoughts on how to overtake this?

regards,

Tanai

[JimmyV]

Tanai,

Tried to dig into this one to help out. The table with the rates don't quite load right away as it's being called by some function later on sometime after the page is loaded. So the Download Tool doesn't have any of the rates table data in the html file to pull from because the data hasn't been loaded to the page yet.

Thought I'd add this in there as a tip, but while I'm testing I will put a Browse Tool at the end of the Download Tool so I can copy out the DownloadData field data into Notepad or something to see the full value of the field.

Best,
JimmyV

[apathetichell]

Pretty sure this is a violation of their terms of usage... If you check the direct link to the table out - https://www.cmegroup.com/market-data/cme-group-benchmark-administration/term-sofr.html#:~:text=DATE,...you will notice that they go to great lengths to prevent web scraping.

[sparksun · Accepted solution]

Is this what you are looking for? If it is, then the rest work is just to transform those data into an easy-to-read table, which is not difficult in Alteryx. 

[Tanai_Goncalves]

Thanks @sparksun !

That is really helpfull! and does solve my problem.

How did you came up with that link?

Regards,

Tanai