Data Cleanse Pro Tool

Question

Super cool, this new tool!

There are many differences compared to the older version:

It can remove invisible characters.
It can remove letters, except for those in a specified list (e.g., A, Y, X).
It can remove numbers, except for those in a specified list (e.g., 1, 2, 3).
It can remove punctuation and special characters, except for those in a specified list (e.g., ñ, |, #).

kwieto · Answer

I attached a workflow in that thread which recreates the issue. You may look into that, as it is really strange.

DavidP · Answer

Hi @mauromorales , I agree some really cool features in the new Data Cleanse Pro tool. I also like the fact that it can remove html tags.

It's also worth noting that the new Data Cleanse Pro tool is natively written in Python instead of as a macro. There is therefore a big improvement in performance with large data sets.

@kwieto I noted your post about potential bugs. I'd be keen to see the outcome of the investigation.

kwieto · Answer

I think I found a bug in this tool - I have a case when it doesn't remove duplicated spaces from the records (the former Data Cleansing tool manages that just fine).