Run multiple duplicate conditions

[msantoso]

Dear All,

I am preparing a file containing Accounts names and addresses in order to migrate them into a CRM system. 

I need to verify a list of conditions to remove duplicate records. 

A record is considered as duplicate if it obeys one of these rules:

Account name AND billing street name 

OR

Account name AND City AND State

OR

Account Name AND Zip code

OR 

Account Name AND Phone

OR

Website AND Phone

OR

Website AND billing street name

I created 6 new columns in which I concatenated the  two columns of each condition.  

then I run the Unique tool. 

At the Unique output, I added another Unique tool and specified the 2nd condition, 

and so forth.

When I run the upload process into the CRM system, I got an error message saying that I still have duplicates in my file. 

I do not know whether I did it the right way, and I cannot explain why I still have duplicates. 

Any help would be very much appreciated. 

Myraim 

[ponraj]

possible to share sample data and desired output in excel format ?

[msantoso]

Hi Ponraj

thank you for your help

[msantoso]

Hi Ponraj

thank you for your help

[msantoso]

Hi Ponraj

thank you for your help

[msantoso]

Hi Ponraj,

in terms of output I'd like to have all the uniques into the main file, and the duplicates in another one.

and if possible, the name of the condition that has verified that the record is a duplicate. 

thanks again

myriam

[ponraj]

possible to share the workflow you developed ?

[ponraj]

I am attaching the workflow and its output.  

[msantoso]

hi Ponraj, 

thank you so much for this workflow. I could figure it out this way. 

could you explain how you proceed? 

I do not understand why you take the duplicate output of each Unique tool, instead of the unique output? 

[ponraj · Accepted solution]

Explanation for my workflow as below.

i)Finding duplicate records which obeys following condition

Account name AND billing street name
OR
Account name AND City AND State
OR
Account Name AND Zip code
OR
Account Name AND Phone
OR
Website AND Phone
OR
Website AND billing street name

ii)Eliminating duplicate records(results of step1) from the source file and outputing remaining records as unique records.

iii)uniting all the duplicate records(results of step1) and outputing them as duplicate records

Hope it is clear now. Also, I am curious to know if your crm system is accepting the results you received from my workflow.