how to get input around 6 GB in WF
Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Karthick461
8 - Asteroid
‎11-22-2021
03:10 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi,
I have 100 plus (.txt) files in common share.. File name is same except last 2 digits.. I have got the input tool and gave the path..
(filename_*.txt).. it is taking files
but after some files, I got error message stating ,Too many fields in record.
Is there any way to fix it
Labels:
- Labels:
- Datasets
- Developer Tools
1 REPLY 1
16 - Nebula
‎11-22-2021
03:22 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello @Karthick461 ,
this error sometimes appears with some csv or txt files given a faulty field in a record.
Try chainging how you read the input file:
Change the delimiter to "\0", remove the first row contains field names or leave it (up to you) and increase the field lenght to accomodate all the data on the same column "5000" or more, depending on your needs.
Regards
