Limited Field Length - CSV document
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello everyone,
I am parsing a CSV document, which has a 254 field length. The document has no delimiters, all characters are all together without spaces.
I am using the formula tool to parse the data, using the Substring function. After reaching the 254 field length in the formula, Alteryx does not show any more values/characters.
To solve this problem I have tried the following:
1) In the input tool I have set the field length to a very high number (let´s say 1.000.000), it hasn´t work the result remains the same.
2) I have inserted a select tool after the input tool and change the size to a very high number (let´s say 1.000.000), it hasn´t work the result remains the same.
3) I have inserted a formula tool and use the Length formula and the result has been 254.
Let me know if there are any ways to solve this problem.
Thank you in advance.
- Labels:
- Data Investigation
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
if 1,000,000 not enough, just extend it to 1,073,741,823. (Max size the alteryx have.)
if still not enough, you may need to try to either change your data source or change tool to use.
beside, i saw you manual split the data, you can try this way. (if the data is split by fixed length)
regex formula : (.{10}|.{0,10}$)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
In your Input tool, trying changing the Delimiters to \n
Also, update the Field Length in the Input Tool to 254000000
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello,
I have tried to extend it to 1,073,741,823. (Max size the alteryx have.), but is still not working.
The data is not split by fixed length unfortunately.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hello Tony,
I used your suggestion and although I do not see all the fields in the formula tool I can see there are all fields in formula output.
Your solution may have partially solved the problem.
Thank you.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@AlbertoALRM If you could share a sample of what the file has (# of columns, record values, etc), then we can help unwind further.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
just realise if it pure number, the text length is double up to 2147483647 (2,147,483,647)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I have a text file that contains 1000 lines with long strings. I read in with no delimiter and field length 16777216. Setting this field length is max you can read from CSV.
