Web Scraping -

Hello,

I am trying to retrieve "Current Monthly COFI" and "Current Semiannual Indices" rates from website - http://www.fhlbsf.com/resource-center/cofi/. I created attached workflow to pull Monthly COFI rates from the website using the download complete monthly history link "http://www.fhlbsf.com/resource-center/cofi/monthlyhistory_file.asp".

My question is

1 - Can I scrape the data with out using the link by directly looking for data on website?

2. Can I use the same workflow and add another link to pull Semiannual Indics (http://www.fhlbsf.com/resource-center/cofi/semimonthlyhistory_file.asp)

Cofi Rates.yxmd

Workflow

Connectors

Best Practices

Accepted answers

JordyMicheal

Hey there MSVE!

So yes, it is possible!!

Little bit of work to rework the data, but here you go - I've done it for you.

Text to columns a few times...

First to split on the new rows all the way down the second to split them on the tabs and get them into separate columns.
Little data cleanse to remove some white-space, drop the fields we don't need, and a dynamic rename to get the headers.

I've gone ahead and done both examples you've asked for (the only difference is the number of columns to split into).

Might I suggest you try to make a MACRO that asks for how many columns to split into and package this up for yourself?

Give it a shot!

WebScrape.yxzp

estherb47

Here is a tip for downgrading yxzp files.

Change the .yxzp extension to .zip. Ignore the warnings

Open the zip files. Open each .yxmc and .yxmd within in notepad, and change the version per @danilang 's instructions above. Save each file and update the zip with the new files.

Close the zip file. Change the extension back to .yxzp. Ignore the warnings.

Now you can open in your version of Alteryx!!

Cheers,

Esther

All comments

JordyMicheal

Hey there MSVE!

So yes, it is possible!!

Little bit of work to rework the data, but here you go - I've done it for you.

Text to columns a few times...

I've gone ahead and done both examples you've asked for (the only difference is the number of columns to split into).

Might I suggest you try to make a MACRO that asks for how many columns to split into and package this up for yourself?

Give it a shot!

WebScrape.yxzp

msve

Hi Jordy,

Thank you so much for your response. Looks like the version I am using is the older one and I am unable to open the file you attached.

estherb47

Here is a tip for downgrading yxzp files.

Change the .yxzp extension to .zip. Ignore the warnings

Open the zip files. Open each .yxmc and .yxmd within in notepad, and change the version per @danilang 's instructions above. Save each file and update the zip with the new files.

Close the zip file. Change the extension back to .yxzp. Ignore the warnings.

Now you can open in your version of Alteryx!!

Cheers,

Esther

msve

Thank you @JordyMicheal - Your instructions were to the point. Also, I am able to access the file by following @estherb47 instructions.

Thank you @estherb47 and @danilang for your trick, that was really helpful.I am able to open the file 🙂

Love this community 🙂

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703