How to output a "text"(flat) file that is larger than 64k?

csh8428

IT in their infinite wisdom decided to change upwards of 70+ column names in a table we use in many workflows. So, I have to repeat the find/replace in the workflow 70+ times for multiple workflows(so hundreds of times).

I tried to do this programmatically using Alteryx and I got close by doing the following

1. Save workflow to desktop
2. Change .yxmd extension to .txt
3. Use the .txt file as an input in a different workflow
4. Use the Find/replace tool with the values mapped from a text tool with the mapping connected to it
5. Export results to some sort of text file
6. Rename text file extension back to .yxmd

In the output tool in Step 5 I get error "Error: Output Data (14): The field "Field1" is too big (2147483647 bytes) for a flat file". The limit is 64K." when trying to write to a flat file. I can't use any other file format because I need to be able to write to a non-formatted so I can change the file extension back to .yxmd. 

How can I output to a text file without data size limitations?

Thanks,

Craig

OllieClarke

Hi @csh8428

edit: As always be extremely careful when editing xml, and make sure to keep a copy before you start....

I would treat the yxmd files as undelimited csvs. 
You can read them in and out as a csv with \0 as the delimiter, and no headers (untick first row contains field names).

However, your error comes from the data type of Field_1 being the maximum size string. I'd be surprised if a single line of xml was 2gb. You may be able to keep your current setup, as long as you change the size of your Field_1 to be 64,000 

Hope that helps,

Ollie