I am ingesting a number of different input files, and the filename is one field that is created and is therefore never empty/null. If I use the data cleanse tool, it doesn't have the configuration to select the fields to be considered. There are two many fields to write a formula.
What is the best way to remove/filter out the empty rows?
I have created a sample file. The first two columns highlighted in light green contain data derived from the input file, and therefore will never be null/empty. If all other fields are null/empty, however, the rows should be deleted or filtered out. The rows highlighted in light orange are the ones that should be dropped/filtered out.
I've considered a few options for achieving this, but I am hoping someone has an idea for the fastest, most efficient way of achieving this as this is a pretty common scenario. Thank you in advance for helping with this!
