Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.
SOLVED

Download file wont extract URL's inputed in text file

zaina1498
7 - Meteor

Hi, I'm unsure why the download tool won't download the URL's properly and extract them and output them. Is there anything I can do to fix this? Why might this issue be occurring? I've attached the workflow below, any help would be greatly appreciated!

21 REPLIES 21
atcodedog05
22 - Nova
22 - Nova

Hi @zaina1498 

 

I tried you workflow. It seems to work.

atcodedog05_0-1602173242810.png

What exactly is the issue?

 

TheOC
15 - Aurora
15 - Aurora

Hi @zaina1498 

I had a look at it looked like some of your request headers were coming back as wrong.

I have added a user-agent to the headers field of the request, and this seems to have fixed the issue on my side. Does it fix it for you too?

Attached below is the workflow


Bulien
atcodedog05
22 - Nova
22 - Nova

Hi @TheOC ,

 

Thats powerful tool you have got there can you explain more about adding a user-agent to the headers field of the request

TheOC
15 - Aurora
15 - Aurora

hi @atcodedog05 

Yeah ofcourse - As far as I understand certain webpages try to stop scrapers by requiring certain information/formats of the request. By adding this header, from what I understand it is telling the site that it is requesting from, that the request is coming from a webpage. This gets past a lot of 'firewalls', as many sites will try to stop requests from python scripts for example. 

So as far as the site is concerned, someone has viewed the page from a browser, and so delivers the information.

Hope this helps!


Bulien
zaina1498
7 - Meteor

Hi, @TheOC  thank you for getting back to me! However it still wouldn't run for me. It stops after a while of it running and gives me an error when I run the workflow you attached. 

zaina1498_1-1602174272550.png

 

 

TheOC
15 - Aurora
15 - Aurora

very interesting, my workflow works with no problem at all, i'm curious as to why it wouldn't for yourself!


Bulien
zaina1498
7 - Meteor

Do you think it could be a difference in Alteryx settings or versions?

atcodedog05
22 - Nova
22 - Nova

Hi @TheOC 

 

You are speaking about this part right. Neat

atcodedog05_0-1602174806835.png

Its working for me too.

TheOC
15 - Aurora
15 - Aurora

Hi @zaina1498 ,
Very potentially, What version are you on with Alteryx? I'm not quite on the newest so ill try updating to your version and seeing if I get the same issue!


Bulien
Labels