how to get input around 6 GB in WF

Question

Hi,

I have 100 plus (.txt) files in common share.. File name is same except last 2 digits.. I have got the input tool and gave the path..

(filename_*.txt).. it is taking files

but after some files, I got error message stating ,Too many fields in record.

Is there any way to fix it

afv2688 · Answer

Hello @Karthick461 ,

this error sometimes appears with some csv or txt files given a faulty field in a record.

Try chainging how you read the input file:

Change the delimiter to "\0", remove the first row contains field names or leave it (up to you) and increase the field lenght to accomodate all the data on the same column "5000" or more, depending on your needs.

Regards