BLS - API Connection for Labor Statistics in the US

Question

thanks to this prior post (https://community.alteryx.com/t5/Alteryx-Designer-Desktop-Discussions/API-for-BLS-Occupational-Employment-and-Wage-Estimates/td-p/539569) I had built a workflow that was FANTASTIC and allowed me to fetch exactly what I needed for my manager to incorporate data requested by our board of directors.

unfortunately, it seems that the BLS is cracking down on these connections and my connection to the API is failing with a message stating the following:

"The BLS is committed to providing data promptly and according to established schedules. Automated retrieval programs (commonly called "robots" or "bots") can cause delays and interfere with other customers' timely access to information. Therefore, bot activity that doesn't conform to BLS usage policy is prohibited."

Curious if there is a workaround before i start digging in and reading about all of their API changes and getting registered with them.

sample of built API Connection.yxmd

severhart · Answer

@danilang  thank you! will have to investigate that registration option. We don't need a ton of data - just updating one slide for the board each quarter. i try to automate as much as i can but if registering is the only way to automate...guess we have to go down that path. appreciate the guidance/input!

danilang · Answer

Hi @severhart

It looks like the BLS is making it more difficult to access their ftp site using automated methods.  It may be possible for you to circumvent this by making the download tool appear to be a browser, but that would specifically violate the terms of service.  You're best option is to put in the effort to build a workflow that can call their API.  You can find a good intro to this here.

Depending on the volume of data that you need to pull, it might be worthwhile for your company to register to use the v2 API as well.

Dan