Advent of Code is back! Unwrap daily challenges to sharpen your Alteryx skills and earn badges along the way! Learn more now.

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.
SOLVED

Download Data from URL

messi007
15 - Aurora
15 - Aurora

Dear Alteryx Comunity,

 

I want to download the table from the URL below:

 

https://www.boursier.com/indices/composition/cac-40-FR0003500008,FR.html?tri=dcapi

 

However in the data column from the dynamique read I get the message below: 

 

 

</style>
</head>
<body>
<div id="header"><h1>Server Error</h1></div>
<div id="content">
 <div class="content-container"><fieldset>
  <h2>403 - Forbidden: Access is denied.</h2>
  <h3>You do not have permission to view this directory or page using the credentials that you supplied.</h3>
 </fieldset></div>
</div>
</body>
</html>

 

Is it abouT access to the web site or I need to do some manipulations in Alteryx.

 

Attached my simple workflow.

 

Many thanks in advance for help!

 

Regards,

 

 

 

 

 

 

 

8 REPLIES 8
atcodedog05
22 - Nova
22 - Nova

Hi @messi007 

 

This is from the website. They might be having scraper blocker. Which stops from fetching webpage through tool.

TheOC
15 - Aurora
15 - Aurora

Hi @messi007 

I managed to get this working by adding a user-agent to the header of the request, requiring this is usually the most basic step sites take against scrapers.

I have attached a workflow of this working, with a 200 response in the DownloadHeader, and the content of the site within the DownloadData.


 

 

Have a great day!


Bulien
atcodedog05
22 - Nova
22 - Nova

@TheOC  Sweet 😎

mceleavey
17 - Castor
17 - Castor

Nicely done @TheOC 



Bulien

messi007
15 - Aurora
15 - Aurora

Dear @TheOC ,

 

Well done.

You have been really helpful.

 

 

Many thanks,

TheOC
15 - Aurora
15 - Aurora

Hey @messi007 

So glad i could be of assistance, have a great week!


Bulien
Oussaio
7 - Meteor

Worked amazingly ! Thanks very much :) !

TheOC
15 - Aurora
15 - Aurora

Happy to help @Oussaio !


Bulien
Labels