Web scraping

[nischalvadari]

How can I scrape the data shown in the below screenshot, from the web site https://lebaneselira.org/#Historical ? 

The historical exchange rates are all available on the index page it self, there is also a trend chart. I wish to download the historical data either by web scraping or if there is a possibility, from the trend chart.

Thanks in advance!

[Maskell_Rascal]

Hey @nischalvadari 

I believe I just answered another post you had about something similar to this issue. 

Please check out this post by @DavidM on webscrapping using Python and Selenium. 

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Python-Code-Tool-Web-Scraping-Dynamic-...

Thanks!

Phil

[Hollingsworth]

By inspecting the web traffic when browsing that page, I found that the data is actually stored in Google Sheets.

You might get there faster by using the Google Sheets Tools that Alteryx created which are found in the Alteryx Public Gallery.

URL for the lebaneselira.org data: https://docs.google.com/spreadsheets/d/e/2PACX-1vQKxp7P4c5bbgJf403C4r51yQDeDljC6-ETLLBPYEXX9q64iGSRo...

URL for the Google Sheets tools in the Alteryx Gallery: https://gallery.alteryx.com/#!app/Google-Sheets-Tools/5952d212a18e9e0e48a0cafe

Hope this helps.

[nischalvadari]

Thanks @Hollingsworth .

I looked in to the Alteryx gallery with the google sheets tool. But was a bit confused about how I could implement it within the workflow that I currently have. I have attached the workflow I have which pulls the Fx data from Yahoo finance. Because Lebanese Lira Fx has been quite volatile off late, it separately needs to be pulled from a different portal (lebaneselira.org)

From the Google sheets data from lebaneselira.org, I see that it is the trend chart that it shows. Can we pull the data points from it? If not, will we be able to scrape from the table on the lebaneselira.org portal above the trend chart?

Can you help me integrate both and be able to append LBP Fx rates to the other countries' Fx rates that I am pulling from Yahoo finance?

Also, Can you help how I can adjust the start and end dates in the URL within the formula tool of the attached workflow?

'https://query1.finance.yahoo.com/v7/finance/download/'+[Pair]+'=X?period1=1587301521&period2=1618837...'

Thanks in advance.