Hi there, is there any formulas or workflow we can use to identify and mark out (but not delete) duplicates? Sample data set and output on excel is shown below. Unique IDDuplicate?226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes226Yes218Yes218Yes178Yes178Yes178Yes178Yes178Yes177No

Identify and Mark out Duplicates

Hi there, is there any formulas or workflow we can use to identify and mark out (but not delete) duplicates?

Sample data set and output on excel is shown below.

Unique ID	Duplicate?
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
226	Yes
218	Yes
218	Yes
178	Yes
178	Yes
178	Yes
178	Yes
178	Yes
177	No

Tips and Tricks

Common Use Cases

Accepted answers

Qiu

@jonathanyeo
What you ask for can be done by Summarize and Formula tools.
If this is what you need, appreciate if you could mark it as accepted

1016-jonathanyeo.yxmd

atcodedog05

Hi @jonathanyeo

Here is a workflow for the task. It is pretty much same as @Qiu in addition it maintains the sort order.

Join tool randomizes your sort apparently.

Output:

Workflow:

Hope this helps 🙂

If this post helps you please mark it as solution. And give a like if you dont mind 😀👍

Duplicate.yxmd

All comments

Qiu

@jonathanyeo
What you ask for can be done by Summarize and Formula tools.
If this is what you need, appreciate if you could mark it as accepted

1016-jonathanyeo.yxmd

atcodedog05

Hi @jonathanyeo

Here is a workflow for the task. It is pretty much same as @Qiu in addition it maintains the sort order.

Join tool randomizes your sort apparently.

Output:

Workflow:

Hope this helps 🙂

If this post helps you please mark it as solution. And give a like if you dont mind 😀👍

Duplicate.yxmd

atcodedog05

Happy to help 🙂 @jonathanyeo

Cheers and Happy Analyzing 😀

Suryachoppakatla

Hello,

I was searching for a solution and I found this replies which are little closed to what I expect. However, my issue is that am building an analytical app and I get different data from various clients.

I am looking for a solution where I can use formula tool and write a condition that identifies all duplicates and should FLAG them in my output report, without disturbing the input data. This will help me to reach out the client and seek more clarification on duplicate data provided is legitimate or not

All this should be within the APP and should include in my output report

Regards,

Surya

Identify Duplicates and Flag.JPG

qiaoqiao77

What if the source data that I have has multiple fields, and I need to use several of them to judge if there are duplicates?

Can you kindly advise how can I achieve the same result? (add a comment to the source data saying if it is a duplicate), thank you in advance!

Quick Links

This months top contributors

AkimasaKajitani 388

mceleavey 388

mbarone 337

Hollingsworth 335

LanisC 335