Getting Info from Website

[KamenRider]

Hi,

Is there a way we can get the info from website and save it in the excel file? The website is "https://www.mba.org/news-and-research" and then from there we locate the percentage either increase or decrease in this topic "Mortgage Applications Increase in Latest MBA Weekly Survey" or "Mortgage Applications Decrease in Latest MBA Weekly Survey" There are only two figures (in red font) we are going to capture:

1. Washington, D.C. (May 8, 2024) - Mortgage applications increases 2.6 percent. (note that it is taken from May 8 and will be posted as May 10 in the excel file (every Friday).

2. The refinance share of mortgage activity to 30.6 percent

Data is being appended weekly and should look like this:

 

Hoping to share your expertise and assistance. Thanks,

Kamen

 

[cmcclellan]

No need to turn AMP off, I've had it on the whole time.  I don't know how AMP can affect connectivity to a website though.

[KamenRider]

HI @cmcclellan ; @apathetichell  and ALL

I can't understand why the workflow is not working. May it be because it is looking for API?

Why is this happening?

Kamen

[cmcclellan]

It doesn't need an API, it's just Alteryx reading the URL.

Did you try on a different internet connection?

[Hsandness]

CharltonFranklin had the same issue with the download tool back in 2022 Download Data Tool - Error Transferring Data: Fail... - Alteryx Community. He was able to pull the URL data when he removed the https://www from the URL or changed https to http.

[KamenRider]

HI @Hsandness 

Thanks for the response. Tried removinig the "https:/www" and change https to http, got same error, "error transferring". I hope there is a way we can configure this.

Looking for everyone's assistance

Kamen

[Hsandness]

@KamenRider , sorry for the back and forth but it's tough to find a solution without knowing the details of the network you're using. I don't believe this is an Alteryx specific issue, but it might be worth your time to check if you can access this information in Postman. If you receive "Status: 200 Ok" (Attached screenshot) in Postman, then this could be isolated to Alteryx.

You should also try running the workflow with a different internet connection like @cmcclellan mentioned.

If it is isolated to Alteryx, then I'd recommend opening a ticket with them. If it's not isolated to Alteryx, then I'm at a loss for a solution.

[apathetichell]

https://knowledge.alteryx.com/index/s/article/How-To-Capture-a-Fiddler-Trace

get a fiddler trace. I think this is a your machine/internet issue.

[KamenRider]

Hi @apathetichell @Hsandness 

Thanks for your response. Sad to say I can't just download and install because it is being block. And I think the reason why I am not able to connect using Alteryx is that the connection might be blocking external sites although I am able to view the site when I open it.

I am not quite really sure about this but some says this is the reason.

Thanks All for your help

Kamen

[cmcclellan]

Have you tried it on a different connection though ?

Can you try on your home computer, not hooked up to the work intranet, or hotspot to your phone or something.

I'm 99.5% sure it's your work connection that is the issue here, not Alteryx

[apathetichell]

@cmcclellan re: AMP - the reason why the 'turn off amp' advice often works is because if there is another issue in the workflow - AMP can stall, misdirect and prevent diagnosising the overall issue. Turning it off allows for better error identification.