How to output a "text"(flat) file that is larger than 64k?
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
IT in their infinite wisdom decided to change upwards of 70+ column names in a table we use in many workflows. So, I have to repeat the find/replace in the workflow 70+ times for multiple workflows(so hundreds of times).
I tried to do this programmatically using Alteryx and I got close by doing the following
- Save workflow to desktop
- Change .yxmd extension to .txt
- Use the .txt file as an input in a different workflow
- Use the Find/replace tool with the values mapped from a text tool with the mapping connected to it
- Export results to some sort of text file
- Rename text file extension back to .yxmd
In the output tool in Step 5 I get error "Error: Output Data (14): The field "Field1" is too big (2147483647 bytes) for a flat file". The limit is 64K." when trying to write to a flat file. I can't use any other file format because I need to be able to write to a non-formatted so I can change the file extension back to .yxmd.
How can I output to a text file without data size limitations?
Thanks,
Craig
Solved! Go to Solution.
- Labels:
- Error Message
- Help
- Output
- Parse
- Preparation
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi @csh8428
edit: As always be extremely careful when editing xml, and make sure to keep a copy before you start....
I would treat the yxmd files as undelimited csvs.
You can read them in and out as a csv with \0 as the delimiter, and no headers (untick first row contains field names).
However, your error comes from the data type of Field_1 being the maximum size string. I'd be surprised if a single line of xml was 2gb. You may be able to keep your current setup, as long as you change the size of your Field_1 to be 64,000
Hope that helps,
Ollie
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@OllieClarke Thanks!
