Append tables that come from periodic API calls, to a master table

[GIS_User01]

Hello and Happy Friday!

I am having trouble figuring out how to append records on to a master table.  The additional tables come in once per hour through an API call that I setup in Alteryx automation.  Once it pulls the data, I need it to check to see if any of the data that it called is already in the master (sometimes it pulls a record or two because of the time stamp), then append it to the master table.  I would setup this workflow to run in the automation tool every hour.  Thanks for any help you can provide.  I have attached an alteryx file that contains the master table and then two "API Call" tables that represent what will come from the API feed.

[Luke_C · Accepted solution]

Hi @GIS_User01 

How are you saving the master table? Is it an excel file? YXDB? SQL Database? That will slightly change the answer. 

The general approach I would take is:

1. Set the master table as an input
2. Use a join to figure out if any records are already in the master table
3. Take any records from the API that fall out of the join and append them to the master table in an output tool