Exclude Row based on same value in different columns

kw7669

Hello. I have the below data. And I'm trying to remove rows that are essentially the same. I've created RowIdentifier and RowIdentifier1 columns to show which rows are matching. I need a way to compare RowIdentifier and RowIdentifier1 and then remove one of the rows and end up with the second table. 

CompCode	CompTP	Total	TradingPartner	Variance	RowIdentifier	RowIdentifier1
2140	T2140	8241.39	8241.39	16482.78	21402140	21402140
2140	T7320	-5416902.92	5994587.81	577684.89	73202140	21407320
2140	T7980	-6553589.67	7828176.68	1274587.01	79802140	21407980
7320	T2140	5994587.81	-5416902.92	577684.89	21407320	73202140
7320	T7320	0	0	0	73207320	73207320
7980	T2140	7828176.68	-6553589.67	1274587.01	21407980	79802140

CompCode	CompTP	Total	TradingPartner	Variance	RowIdentifier	RowIdentifier1
2140	T2140	8241.39	8241.39	16482.78	21402140	21402140
2140	T7320	-5416902.92	5994587.81	577684.89	73202140	21407320
2140	T7980	-6553589.67	7828176.68	1274587.01	79802140	21407980
7320	T7320	0	0	0	73207320	73207320

Jonathan-Sherman

Hi @kw7669,

There may well be more of an elegant way to solve this but this was the first approach that came to mind and gets us to the correct result I believe! Transposing so we have both Row Identifiers so we can concatenate them before joining back and ordering before uniquing on the concatenated ID field.

I've attached my workflow for you to download if needed!

Kind regards,

Jonathan

20210527 - DeduplicateRecords.yxmd