PDF download from website (some files are with error and cannot be open)

Hi all,

I have already created a topic where BrandonB helped me a lot when teaching me how to download several PDF file from a website.

However, I am currently facing with an issue that when I download multiple PDF files simultaneously, not all of them are actually fully downloaded.

Some of the downloaded files are corrupted and cannot be opened (they only have 1 KB size).

Can anybody advise why is that?

I attach the workflow. You can just change the output address from my rive to yours and you will be able to run the workflow yourselves.

All the best,

Radek

Justice document download.yxwz

Download

Accepted answers

grossal

Hi @Ray_Pospisil,

I think there is a simple fix for this by simply changing the configuration of the Download-Tool. I am not sure if both are needed, but I'd change the following:

1) Change the Connection-Settings

I'd downsized it to only 1 Connection but a higher timeout. This was simply trial-and-error. I first tried to only upsize the timeout but it started working when I also changed the connection to 1.

2) Add user-agent

This is probably optional the current point, but if you download more pages, the page might detect you as a bot and block you. Therefore it's a good idea to add a user-agent. I simply added the one from Google Chrome.

Result:

Let me know if this helped or if we need to dig further into it.

Best

Alex

Ray_Pospisil

Hi Alex,

The solution seems to be working.

Thanks very much for your support.