Alteryx Designer Desktop Discussions

hellyars · ‎08-12-2018

Hi,

I am trying to pull in some data from FedBizOpps (FBO). I am trying to download a given day's list of solicitations. In this example, I am trying to access the solicitations for July 12, 2018. They have an FTP site. You only need to change the date to get the solicitations for any given day (e.g., ftp://ftp.fbo.gov/FBOFeed20180712).

In Safari, it downloads as a webarchive that I copy and paste to Sublime Text. (Yes, I use Alteryx on a Mac via Parallels.) The sample below represents one record. (There are 82,000 plus lines for this day.)

How do I pull this into Alteryx?

P.S. Is there a better way to access FBO data (this appears to be only the synopsis)?

<PRESOL>
<DATE>0712
<YEAR>18
<AGENCY>Department of Agriculture
<OFFICE>Agricultural Marketing Service
<LOCATION>Commodity Procurement Staff
<ZIP>20250
<CLASSCOD>89
<NAICS>311911
<OFFADD>1400 Independence Ave., SW
Washington, DC  20250 Washington DC 20250
<SUBJECT>Peanut Butter Products for use in Domestic Food Assistance Programs
<SOLNBR>                                                                                                                                
<RESPDATE>071918
<CONTACT>Cheryl Davis, Contract Specialist, Phone 816-926-3377, Fax 816-823-2303, Email Cheryla.Davis@ams.usda.gov - Jeffrey Jackson, Contracting Officer, Phone 816-926-2530, Fax 816-823-2303, Email Jeffrey.Jackson@ams.usda.gov
<DESC>USDA's Agricultural Marketing Service - Commodity Procurement Staff - Dairy, Grain &amp; Multifood Branch, intends to issue solicitation<br />12-3J14-18-B-0374 for procurement of Peanut Butter Products for domestic food assistance programs. Deliveries are to various locations in the United States on an FOB destination basis. The solicitation may include various small business set asides pursuant to the Small Business Act (15 U.S.C. 631, et seq.). This may include partial or total small business set-asides, service-disabled veteran-owned (SDVO) set-asides, quantities reserved for 8(a) and AbilityOne firms, and price evaluation preferences for qualified HUBZone small businesses. Quantities reserved for 8(a) and SDVO firms where only one of those firms meets AMS qualification requirements will be awarded on a sole source basis through issuance of a letter RFP issued directly to those companies.
<p><br />The solicitation is expected to be available on or after July 11, 2018, and will be available electronically through USDA Web Based Supply Chain Management (WBSCM) system located at https://portal.wbscm.usda.gov/publicprocurement and also through a link to the aforementioned website in the document package attached to the solicitation notice on the Federal Business Opportunities website. A hard copy of the solicitation will not be available for the acquisition. All future information regarding this acquisition, including solicitation amendments and award notices, will be published through WBSCM and the Federal Business Opportunities website (http://www.fbo.gov). Interested parties shall be responsible for ensuring that they have the most up-to-date information about this acquisition. The anticipated date of receipt for offers will be on or near July 19, 2018. The contract type will be firm-fixed price.<br /><br /><br />Pursuant to Agricultural Acquisition Regulation 470.103(b), commodities and the products of agricultural commodities acquired under this contract must be a product of the United States, and shall be considered to be such a product if it is grown, processed, and otherwise prepared for sale or distribution exclusively in the United States. Packaging and container components under this acquisition will be the only portion subject to the World Trade Organization Government Procurement Agreement and Free Trade Agreements, as addressed by FAR clause 52.225-5. Complete details of the commodity and packaging requirements are available in USDA's commodity requirements document available through the attached document package. AMS's solicitation (when published) will specify the pack sizes, quantities, and required delivery schedules.<br /><br /><br />To be eligible to submit offers, potential contractors must meet the AMS vendor qualification requirements established in accordance with FAR Subpart 9.2. The AMS main contact for vendor qualification requirements is Andrea Lang who can be reached by phone at (202) 720-4237 or by email to Andrea.Lang@ams.usda.gov. Details of these requirements and contact information are available online at: http://www.ams.usda.gov/selling-food</p>
<p>Once qualification requirements have been met, access to WBSCM will be provided. Bids, modifications, withdrawals of bids, and price adjustments shall be submitted using this system. Submission of the above by any means other than WBSCM will be determined nonresponsive.</p>
<p>&nbsp;</p>
<LINK>
<URL>https://www.fbo.gov/notices/bb0d8aebeb94345b4b26273ca9b09223
<DESC>Link To Document
<SETASIDE>N/A
</PRESOL>

BenMoss · ‎08-12-2018

Hi @hellyars,

To read in files of an unspecified filetype I always follow the process outlined in this blog post for reading in a. twb file, it's all the same!

https://benjnmoss.wordpress.com/2016/10/24/how-to-import-a-twb-in-alteryx/

You can then parse it accordingly to get the data you need!

But actually, I recommend using the download tool in Alteryx to pull down your data then you don't have to write it to a file. Sample workflow attached!

You can even use the generate rows tool to get all possible weblinks by incriminating the date. Alteryx will perform the download for each line in your data. So if you have two lines with different links Alteryx will download each of them.

Ben

BenMoss · ‎08-12-2018