Summarizing similar rows

[Agarwal_Yash91]

Hi,

I am trying to summarize count of workflow's failed because of similar error messages.

Example:

Wf ID	Error Message
1	Error - toolId 19: Record #1: Tool #16: Error transferring data: Couldn't connect to server
2	Error - toolId 19: Record #2: Tool #16: Error transferring data: Couldn't connect to server
3	Error - toolId 19: Record #3: Tool #16: Error transferring data: Couldn't connect to server
4	Error - toolId -1: Unable to allocate memory
5	Error - toolId -1: User Canceled

Expected Output:

Error	Count
Error - toolId 19: Record #1: Tool #16: Error transferring data: Couldn't connect to server	3
Error - toolId -1: Unable to allocate memory	1
Error - toolId -1: User Canceled	1

I tried using Fuzzy match and able to get 80% matching records but when i try to get unique values and summarize the data i am not still getting 3 rows and count as 1.

Any suggestions?

Regards,

Yash

[mbarone]

How are you getting the list of WFs and errors?  From Mongo, or log files?

[Agarwal_Yash91]

@mbarone we are storing in MYSQL database and extracting the error from logs written in MYSql database table.

[mbarone]

This is the best I could do (attached).  The filter should hold up.