Remove duplicate within the same month

[beatrizmguerreiro]

Hello,

I have the dataset bellow.

Month	Doc. Number
1	123456
1	456789
1	123456
2	987456
2	321456

I need to find any duplicate document number within the same period. 

Based on my requirements, The rows highlighted, should be filtered as duplicates.

Thank you.

[AngelosPachis]

Hi @beatrizmguerreiro ,

You can use a summarize tool to achieve that, grouping by both fields (months and document no.)

That will return you the unique value for each combination of your fields.

Hope that helps,

Angelos

[AngelosPachis]

and I think I might have got that wrong slightly. If you indeed want to exclude them totally from your dataset, then you can use a filter tool, to filter them out.

[AkimasaKajitani]

Hi @beatrizmguerreiro 

You can use Unique tool.

Duplicate records will output to "D" output.

Summarize tools are also available as @AngelosPachis  presents it.