179KB file is too large to save to a flat file?

[adm510]

I'm trying to save some data that was downloaded to a flat file using Alteryx.  The input to the data output component is 179KB, but Alteryx keeps giving me errors saying my file is over 1GB in size.  If I save it as a CSV the file is only 88KB, so I don't know where the 1073741823 bytes are coming from. Any thoughts?  Ideally I would like to save the ASCII file as-is, so I can keep a copy of the original data.

[MarqueeCrew]

@adm510,

I would suggest that you put an "Auto Field" tool in just prior to the output.  My guess is that the V_WString (Size 1073741823) is the issue.  The data may be small, but when you output to a FLAT file, it will expand each field to it's maximum size.

Cheers,

Mark

[adm510]

@MarqueeCrew

That helped a bit, but it still won't allow me to save the file due to size issues.

[MarqueeCrew]

Please PM me with your email and I'll setup a webex now with you.

Cheers,

Mark

[MarqueeCrew · Accepted solution]

Solution was:

Use CSV format with \0 as the delimiter.

Cheers,

Mark

[Hiblet]

This post really helped me out.  I had to output a single field to a file.  The field was a very, very long XML string that I had munged together.  It was important to output the field value "as is", so using a null separator, and dropping the headers, and not quoting values.  Very helpful of you to post the solution, thanks!

[JamesMalyk]

Thanks so much for the solution on this, it's been bugging me for a while... great output tool/method.

[amitios]

Thank you for solution

[ColinG]

Thanks for this. I am trying to write out an XML file I have manually created with Alteryx formulas, and I was getting really frustrated at this exact error. Alteryx has lots of weird bugs and UI inconsistencies that you have to stumble around figuring out, or luck out finding the answer quickly on the Alteryx forums.