Web Scrapping Bloomberg

rohithannole

Please help!

I am trying to do web scrapping on Bloomberg site to get companies data but the webpage is identifying Alteryx download tool as robot and it is redirecting to "are you a robot" page.

Please help me out on how I can get the required page details into download to by bypassing the captcha page.

danilang

Hi @rohithannole 

Bloomberg is an information company.  They make money by selling information.  As such they have very strict rules about how you can access their data.  This clause from there terms of service is the relevant one in section "4. Restrictions on Use"

You shall not use or attempt to use any “scraper,” “robot,” “bot,” “spider,” “data mining,” “computer code,” or any other automate device, program, tool, algorithm, process or methodology to access, acquire, copy, or monitor any portion of the Service, any data or content found on or accessed through the Service, or any other Service information without the prior express written consent of BLP

They do have an API that you can call, but they'll probably charge for that as well.

Dan