Check if there's dupe in output file vs input file before appending data to output file

[JCTAN]

Hi,

I have a input file (Tradeblotter_) which consist of trade details, the tradeblotter file is generated hourly and each new trade will be consolidated in the same tradeblotter file. I would like Alteryx to only append the new trades in the tradeblotter file to output file (June 2024 Affirm Confirm) and not duplicate the trades in the output whenever there is a new trade generated.

I've managed to configure in Alteryx to append the trades in the tradeblotter file to output file but i am not sure how to go about removing the dupes.

If anyone can advise, thanks!

[Raj]

@JCTAN 
unique tool is proper fit for the situation.

[JCTAN]

Hi Raj,

How do i use unique tool after my output? The reason i'm asking this is at 10am i have 3 trades A, B, C loaded from input to my output file. At 11am, i have 4 trades in my input, A, B, C, D. But i do not want A, B, C to be loaded to my output file as they were already loaded at 10am and it would cause duplicates. How do i only load D into my output when my input file consist of A, B, C, D at 11am?

[Raj · Accepted solution]

@JCTAN 
find workflow attached
Another way of achieving this.

[JCTAN]

Thanks Raj! it works!