Append tables that come from periodic API calls, to a master table

Question

Hello and Happy Friday!

I am having trouble figuring out how to append records on to a master table.  The additional tables come in once per hour through an API call that I setup in Alteryx automation.  Once it pulls the data, I need it to check to see if any of the data that it called is already in the master (sometimes it pulls a record or two because of the time stamp), then append it to the master table.  I would setup this workflow to run in the automation tool every hour.  Thanks for any help you can provide.  I have attached an alteryx file that contains the master table and then two "API Call" tables that represent what will come from the API feed.

Append_API_Calls_to_MasterTable.yxmd

Luke_C · Accepted Answer

Hi @GIS_User01

How are you saving the master table? Is it an excel file? YXDB? SQL Database? That will slightly change the answer.

The general approach I would take is:

* Set the master table as an input
* Use a join to figure out if any records are already in the master table
* Take any records from the API that fall out of the join and append them to the master table in an output tool