Tool Mastery
Explore a diverse compilation of articles that take an in-depth look at Designer tools.Tool Mastery | Unique
Unlike a snowflake, it is actually possible for duplicates to exist when it comes to data. To distinguish whether or not a record in your data is unique or a duplicate we have an awesome tool called the UniqueTool that will actually turn your data into a unique snowflake.
The Unique Tool at its core is very simple to understand. In the configuration, you select for which columns you want the records to be uniquely distinguished. If only one field is selected it will only look for the instance of unique records in that particular field. If two or more columns are selected, the uniqueness of the data set will be distinguished by the combination of records. The U output will show a list of records that are unique depending upon the fields you selected, while the D output will give you the list of duplicates. It’s also helpful to know that the first record in each unique group is sent to the U output stream while the remaining records are sent to the Duplicate output stream.
For example, let’s say you have a dataset with two fields: First Name and Last Name. And you have two records: where one is John Smith and the other is John Johnson. If you selected just First Name in the configuration, Depending on which record came first you would have that record come into that U output stream while the other would come out of the D stream. If you selected both first name and last name both John Smith and John Johnson would appear in the unique output stream.
A good sample to reference and learn from is the sample provided within Alteryx itself. Click on the Unique tool in the Preparation palette and click on “Open Example” to access this workflow.
Here are some common ways to use a Unique Tool:
- Using before a join to ensure you don’t get duplicate records
-
Checking uniqueness before assigning primary keys to insert records into a database table with constraints
- Obtaining the first instance of a unique record similar to a Summarize Tool "First" action. Because the order of the records matter, you can use this to your advantage to sort records in any way you desire before performing a unique to obtain the first record in any group of duplicates.
Now that you have seen what the Unique Tool is all about, you can finally journey on to discover all the duplicates hidden in your data. And remember:
By now, you should have expert-level proficiency with the Unique Tool! If you can think of a use case we left out, feel free to use the comments section below! Consider yourself a Tool Master already? Let us know at Community@alteryx.com if you’d like your creative tool uses to be featured in the Tool Mastery Series.”
Stay tuned with our latest posts every Tool Tuesday by following Alteryx on Twitter! If you want to master all the Designer tools, consider subscribing for email notifications.
Additional Information
Click on the corresponding language link below to access this article in another language -
Portuguese
Spanish
French
German
Japanese
Hi serendipitytech,
We can accomplish this by following the below method.
We can use a combination of Tile, Sample, and, Filter Tool.
Below is the approach.
I took below data as an example: in this, I ensured duplicates are scattered around the data and at the same place.
Below is the complete workflow.
Tile Tool - Helps give the sequence number generation based on the group, when the max number of any group is 1 means it is a truly unique value.
Sample Tool - We are picking up the last value of the group, so if the value is duplicated then it will have a number higher than 1, so we can catch there.
Filter Tool: splits truly unique and others
