Remove duplicate line

Question

Hi community,

I have the data pattern as per example below which one data , it will replicate 3 times . For example , if it has one line, it will have 3 row of data. If it has five line, it will have 15 row of data. Can i know how to get output listed below ? i try to use unique tool but it may not applicable in this case.

Input

1.a

2.a

3.a

4.b

5.b

6.b

7.b

8.b

9.b

10.b

11.b

12.b

13.b

14.b

15.b

16.b

17.b

18.b

Output

1.a

4.b

5.b

6.b

7.b

8.b

Thank you

ShankerV · Answer

Hi @SH_94

The solution shared works dynamically for any other inputs also.

Testing huge dataset:

1.a
2.a
3.a
4.b
5.b
6.b
7.b
8.b
9.b
10.b
11.b
12.b
13.b
14.b
15.b
16.b
17.b
18.b
19.c
20.c
21.c
22.d
23.d
24.d
25.d
26.d
27.d

Output:

For a, 3/1

For b, 15/5

For c, 3/1

For d, 6/2

Note: The workflow used to achieve the solution is attached which can be downloaded to see how the solution works.

If you believe your problem has been resolved. Please mark helpful answers as a solution so that future users with the same problem can find them more easily!!!!

Many thanks

Shanker V

ShankerV · Answer

Hi @SH_94

Please find the below expected output.

Note: The workflow used to achieve the solution is attached which can be downloaded to see how the solution works.

If you believe your problem has been resolved. Please mark helpful answers as a solution so that future users with the same problem can find them more easily!!!!

Many thanks

Shanker V

Remove duplicate line.yxmd

Felipe_Ribeir0 · Answer

Hi @SH_94

One way of doing this

duplicate.yxmd