Hey all, trying to web scrape data from a web page:
First, I was getting the error "Failure when receiving data from the peer".
So, I created a text file in C:\ProgramData\Alteryx - called it PeerValidationBypass.txt
Entry: www.fs.usda.gov
Workflow: Text input, then download tool, then browse
When I run the WF, it shows the Warning: Download (3): TLS Peer Validation bypassed for https connection to host www.fs.usda.gov.
But, the WF runs forever, seems to be stuck - I have to cancel it.
Anyone else have this issue?
Solved! Go to Solution.
What exactly are you trying to scrape from this page?
Not sure if you got my first message I sent back:
I can see in the HTML code:
var fireLevel2= {"dangerLevelAt":"forest","fwLevel":"Moderate","ifplLevel":"N/A","fdlz":[],"ur":[]}
If I can scrape the website, then I can find the text above, then substring the fwLevel (this case the text is 'Moderate'), can be several values though.
The server unfortunately probably just doesn't support the request... Error: Failure when receiving data from the peer (... - Alteryx Community
So, if I understand correctly, the server (https://www.fs.usda.gov)
This server above doesn't support the request? If so, are there any alternatives?
are you trying to get a single specific element from that?
@Gfreeman I don't know of any other options besides finding another url to find that same information!
I understand. Thanks for the information!!!
Hi Gfreeman,
I could execute the download tool, but i didn't know how get the HML, maybe someone can help you from this point.
Ok, right to the bat,
1. Open the web page that you want make a request (https://www.fs.usda.gov/mtnf)
2. Right clik an choose "Inspect"
3. Go to tab network
4. Reload the page
5. Do as describe bellow
6. Go to https://curlconverter.com/ and paste (as bellow)
Now you know the headers and paylod of you request for this page.
Put that in download tool (include the cookies), the URL will be (https://www.fs.usda.gov/s/mtnf)
That way the download tool wa executed, but i dont know how to get the HML, it looks like the page arent load yet.
If someone could help, i would like to know the asnwer too :-D
User | Count |
---|---|
107 | |
82 | |
69 | |
54 | |
40 |