TSV file 4GB

[MZ900605]

Hello guys I need help with reading and editing a tsv file, It is a chemical file in the pictures there is a sample of the data and the error am getting any help?

Error: Input Data (9): Error reading "C:\Users\wolve\Desktop\BindingDB_All.tsv": Too many fields in record #1013457

[mceleavey]

Hi @MZ900605 ,

This is usually due to the delimiter being present in a cell in a single row.

If you can post the data we can build it for you, but if you want to have a crack, try opening it with a \0 delimiter and then parsing it manually with text to columns.

M.

[MZ900605]

@mceleavey 

I have almost 49 columns, \0 delimiter will only show the first couple of tabs merged all in a row!

[mceleavey]

Correct.

You then manually parse them out by whichever delimiter the file uses, or indeed by the number of characters in a fixed width file.

The problem you're having is that in the row that has the error, the format is broken, so it can't split it into the same number of columns. 

That means it can't auto parse it into columns.

When you have corrupt data, you need to address it manually.

M.

[mceleavey · Accepted solution]

@MZ900605 ,

Simply apply a text to columns tool to the single column and use \t as the delimiter.

I've attached the following example:

You will probably then need to fix that broken row, but it will process and allow you to sort that out after the fact.

M.