Hello, I'm trying to filter out any duplicates based on specific criteria. Example below - most records in my data set don't have duplicates but I need to weed out the ones that do. All the duplicate Policy Numbers with an Event Name of "COVID" I need to filter out. Thank you, Kim Current DesiredPolicy #Event Name Policy #Event Name1234567COVID 123456790 Day Suspend123456790 Day Suspend 7654321EFT Lapse Pending7654321EFT Lapse Pending 3456789Grace Hold7645321COVID 3456789Grace Hold 3456789COVID

Filtering out duplicates based on criteria

Hello,

I'm trying to filter out any duplicates based on specific criteria. Example below - most records in my data set don't have duplicates but I need to weed out the ones that do. All the duplicate Policy Numbers with an Event Name of "COVID" I need to filter out.

Thank you,

Kim

Current		Desired
Policy #	Event Name		Policy #	Event Name
1234567	COVID		1234567	90 Day Suspend
1234567	90 Day Suspend		7654321	EFT Lapse Pending
7654321	EFT Lapse Pending		3456789	Grace Hold
7645321	COVID
3456789	Grace Hold
3456789	COVID

Preparation

Accepted answers

fmvizcaino

Hi @kas ,

You can achieve that by first counting the number of occurrences, then using a filter to eliminate those with duplicates policy numbers and event='Covid'.

I got a different result than yours but I think it was due to a mistyping in your example.

Best,

Fernando Vizcaino

2020-06-30 Filtering out duplicates based on criteria.yxmd

All comments

fmvizcaino

Hi @kas ,

You can achieve that by first counting the number of occurrences, then using a filter to eliminate those with duplicates policy numbers and event='Covid'.

I got a different result than yours but I think it was due to a mistyping in your example.

Best,

Fernando Vizcaino

2020-06-30 Filtering out duplicates based on criteria.yxmd

AbhilashR

Hi @kas, I might be oversimplifying your question, but just using a Filter tool should help you remove policy numbers with an Event Name of 'COVID', no? Unless you want to identify those Policy# that have COVID in Event Name, and then de-duplicate the remaining corresponding non-COVID records for each of those Policy#'s. Please ignore my question if @fmvizcaino's solution already addresses your ask.

kas

This works perfectly...thank you kindly!

Kim

kas

Thanks so much for your time @AbhilashR ...and yes, @fmvizcaino solution is a perfect fix.

Quick Links

This months top contributors

mceleavey 383

mbarone 337

Hollingsworth 335

LanisC 335

AdamR 335