Dynamically skip junk rows/headers from data

[Shaaz]

Hi All,

How to skip junk rows/headers coming at regular intervals in the data as rows dynamically.

In this, I would like remove the rows -,ID,- from this file whereas in the other file instead of -,ID,- it might be -,cocd,-. It has to be dynamic, I should hardcode.

Basically remove there junk rows where first column/row has hyphen, columnheader and hyphen.

I should get below output.

[IraWatt]

Hey @Shaaz,

You could add a filter like this:

!Contains([ID], "-") AND !Contains([ID], "ID") 

It checks the ID column does not contain "-" or "ID". Any questions make sure to ask :)

HTH,

Ira

[DataNath]

Do your 'junk' records always start with '-,'? If so, the following should do the trick. If not, let me know and I'll take another look!

[binuacs]

@Shaaz you can also try with the Data Cleansing tool

[Shaaz]

Hi All,

The above solutions are manual.

I’m looking for a dynamic solution where each file will have different column name, it need not be ID always.

if a new file has Year as first column, then in data it will hyphen, Year, hyphen.

[IraWatt]

@Shaaz the most dynamic approach I can think of is this:

Take the field names using the field info tool then join that onto the data, the right join wont contain any headers. The "-" I have to be done manually.