Removing Duplicates

Hi all,

I joined two files together, then I created a formula to change a fee to zero. Now I'm "union-ing" the new data set with the original data (which contains more records) but I want to filter out the duplicates. I know that the fees with zero have to stay, but how do I take out the other ones?

The data is confidential so I can't share the files.

Thank you in advance!!

Custom Tools

Accepted answers

danilang

Hi @Kristie_Pires

If you change your workflow to look like this, you avoid getting duplicates in the first place.

The items that match from both lists come out the J input. The L input contains the records from the first file with no matches in the second. Simply Union the two outputs and you'll have the output you're looking for.

Note: This assumes that each of the input lists has no duplicates internally.

Dan

NoDups.yxmd

All comments

Adarsh_R3

You can use this tool "Unique Tool" to filter out any duplicated in the data.

Select the fields you want and this tool filters out the duplicates based on that combination.

Let me know if this works

atcodedog05

Hi @Kristie_Pires

Additionally, if you always want fee = 0 to be selected over you can sort the data ascending on fees and then use unique. Refer the below workflow.

Workflow:

Hope this helps : )

fees.yxmd

danilang

Hi @Kristie_Pires

If you change your workflow to look like this, you avoid getting duplicates in the first place.

Note: This assumes that each of the input lists has no duplicates internally.

Dan

NoDups.yxmd

Kristie_Pires

Thank you @amadar, @atcodedog05 and @danilang for showing me different solutions! I am new to Alteryx and having this community makes things so much easier 😊

Have a great day!

atcodedog05

Happy to help : ) @Kristie_Pires

If you do face with duplicates issues later you would know what to do 🙂

Cheers and have a nice day!

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15878

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703