Ignore wrong records

Hi everyone,

I have so many .txt and .csv files. In some of them, there are records that they have more than specific delimiters and I got this message:

"Record #1219: Tool #2: Too many fields in record #57"

How to ignore the wrong records and read all the file to end?

Workflow

Tips and Tricks

Parse

Common Use Cases

Preparation

Accepted answers

All comments

@Saraabdi955 Change the Field length to 999999 and try again

@binu_acs
No consider:

Col1,Col2
22@22.com,qwerre
44@234.com,loplopl
11@11.com,123$,%()
78@78.com,98/*-+

there is a delimiter , and col2 consists of another ,

While running the file, I got that message.

No consider attached file:

there is a delimiter , and col2 consists of another ,

While running the file, I got that message.

@Saraabdi955 use \0 as the delimiter instead of , also uncheck first row contains field names (6th option in input tool configuration). Then use text-column tool to split the records

it's not correct.

please watch the attached dataset.

what should we do when we have more than delimiters determined?

Hi @Saraabdi955

Is it because you have a comma in the password section? Using @binu_acs solution you can get it to work - just restrict the Text to Columns tool to 2 columns only, leaving the extra in last column:

Your output is this:

If this isn't right i'd provide detail on how you expect the output to look

Thanks @davidskaife
it's ok but not exactly.

If there was another column after password, we couldn't do it.

Hi @Saraabdi955

Try this Regex Parse, i've tested it with an additional column after the password:

Here is the setting for the Regex:

Delimiter Parse.yxmd

@Saraabdi955read all the records at once then filter out unwanted records

Quick Links

Tags

This months top contributors

atcodedog05 19598

Qiu 15867

MarqueeCrew 13708

apathetichell 13703