Check for IDs from set of files and load IDs that are not present in them from new file

[TheOne1]

I have set of csv excels which are generated every week (one file per week). I need to check all those csv files for the field - ID and load only those IDs that are not present in them from a new file. This step is crucial to avoid duplicate IDs from being processed in my long workflow. This de-duping and loading of IDs should be my Step 1. How do I do this?

[binuacs]

@TheOne1 use batch macro to combine the csv files, using unique tool find the unique IDS, then using the join tool , join the combined file ID with the new file ID field, take the L- Anchor output where you will get the IDs which are not present in the new file

https://community.alteryx.com/t5/Alteryx-Designer-Desktop-Discussions/Combine-Many-csv-into-a-single...

[dheerajasia]

.

[TheOne1]

Hi @binuacs , thank you for the response. I need to compare IDs present in the combined csv files and the new file and output those IDs that are not present in the combined csv files. I think you got it the other way around. 

I did this and get incorrect list of IDs

 

[flying008]

Hi, @TheOne1 

Maybe you can upload sample workflow and want output data for explain.

[binuacs]

@TheOne1 Get the output from the L-anchor of the Join tool not from the J-Anchor, The L-anchor has the records which are not present in the combined output file because you connected the new file Left of the join tool and combined in the Right input of the join tool