179KB file is too large to save to a flat file?
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I'm trying to save some data that was downloaded to a flat file using Alteryx. The input to the data output component is 179KB, but Alteryx keeps giving me errors saying my file is over 1GB in size. If I save it as a CSV the file is only 88KB, so I don't know where the 1073741823 bytes are coming from. Any thoughts? Ideally I would like to save the ASCII file as-is, so I can keep a copy of the original data.
Solved! Go to Solution.
- Labels:
- API
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I would suggest that you put an "Auto Field" tool in just prior to the output. My guess is that the V_WString (Size 1073741823) is the issue. The data may be small, but when you output to a FLAT file, it will expand each field to it's maximum size.
Cheers,
Mark
Chaos reigns within. Repent, reflect and restart. Order shall return.
Please Subscribe to my youTube channel.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@MarqueeCrew
That helped a bit, but it still won't allow me to save the file due to size issues.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Please PM me with your email and I'll setup a webex now with you.
Cheers,
Mark
Chaos reigns within. Repent, reflect and restart. Order shall return.
Please Subscribe to my youTube channel.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Solution was:
Use CSV format with \0 as the delimiter.
Cheers,
Mark
Chaos reigns within. Repent, reflect and restart. Order shall return.
Please Subscribe to my youTube channel.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
This post really helped me out. I had to output a single field to a file. The field was a very, very long XML string that I had munged together. It was important to output the field value "as is", so using a null separator, and dropping the headers, and not quoting values. Very helpful of you to post the solution, thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Thanks so much for the solution on this, it's been bugging me for a while... great output tool/method.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Thank you for solution
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Thanks for this. I am trying to write out an XML file I have manually created with Alteryx formulas, and I was getting really frustrated at this exact error. Alteryx has lots of weird bugs and UI inconsistencies that you have to stumble around figuring out, or luck out finding the answer quickly on the Alteryx forums.