Dynamic Select Tool

erin_kotch

Hello community!  How can I dynamically set the number of records to keep in the Select Records tool? (or completely do this another way!)

Every week new CSV files are generated and I do not have control over the format/layout of these files - they are what they are - but they always have the same fields and types in the same order.  These CSV files usually come with 9 rows of info that I want to throw out.  But sometimes they don't have these extra rows at the top.  (actually 8 rows of strings, then 1 row of [null]).

Here is an example of the first 10 records when it includes the extra rows:

And then I do this:

How do I error-trap for those times where the CSV file doesn't have the extra rows?  Is there a way to change the select records config to 1+ if they aren't there? Or can I skip the select records tool entirely if they aren't there?

Appreciate your ideas!

Erin

dataMack

You say that it always has the same fields in the same order, so what you really care about finding is what is on row 10 ('RPT_SHORT_DESC, ITM_SCN...), but you don't know what row it will appear on.  Here's how I might approach it:

1. If you have multiple CSV files (unknown quantity of files), you'll likey want to use a Dynamic input or make this into a macro

2. For the part of finding what to throw out- since the fields or order doesn't change, just what row it appears on, why not use a multi-row formula tool to look for that string specifically, flagging all rows before as 0 and rows after it as 1.  Then pass it through a filter to keep the rows you want.  Parse to columns and dynamic rename to get the column names correct.