Dynamically skip junk rows/headers from data

Question

Hi All,

How to skip junk rows/headers coming at regular intervals in the data as rows dynamically.

In this, I would like remove the rows -,ID,- from this file whereas in the other file instead of -,ID,- it might be -,cocd,-. It has to be dynamic, I should hardcode.

Basically remove there junk rows where first column/row has hyphen, columnheader and hyphen.

I should get below output.

IraWatt · Answer

@Shaaz the most dynamic approach I can think of is this:

Take the field names using the field info tool then join that onto the data, the right join wont contain any headers. The "-" I have to be done manually.

Filter.yxmd

Shaaz · Answer

Hi All,

The above solutions are manual.

I’m looking for a dynamic solution where each file will have different column name, it need not be ID always.

if a new file has Year as first column, then in data it will hyphen, Year, hyphen.

binu_acs · Answer

@Shaaz you can also try with the Data Cleansing tool

Data_Cleansing_10_05.yxmd