Best way to update new table daily

Hi -

I am trying to create a process that would update a cross-reference table daily. I have a query that finds the initial set of IDs and a few dimensions and creates a table. Next day, I would like to retrieve the IDs that have not been retrieved previously and append it to the same table that was created. What are some options that follows best practices?

Thanks for your help

Workflow

Datasets

Tips and Tricks

Best Practices

Accepted answers

JessieC

@jmhutbay ,

"Update: Insert if new" option is only available if you are connecting to a database.

If you wanted to find new records, you could Join the previous day's results to compare to today's and records from L or R would be the net new records that you would Append to an Excel file.

Here's a mock-up

All comments

PeterA1

@jmhutbay

It depends on how the workflow is configured. But I think if what you mean is you want to add records from new data to an existing table that were not previously there, you would use an output data tool and configure the output options to: "Update: Insert if new"

This is one way to accomplish what you want if I understand correctly.

jmhutbay

@PeterA1

I want to ultimately write this to a table in a database but I was testing writing this to an excel sheet. I don't have the "Update: Insert if new" option. See below for the options I have

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15878

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703