topic Re: Why does my output get broken into two or more documents? in Alteryx Designer Desktop Discussions

Why does my output get broken into two or more documents?

Archaeopteryx — Thu, 28 Jan 2021 16:33:55 GMT

I'm running a workflow that performs an API request. I do the JSON parse, then send the output to a document to be used by another process later.

The output will sometime, but not always, break the data into two or more .csv documents. Why? Also, this behavior is inconsistent. I may get the output in two documents, or on another run, I may get three. Each document, 14 of them, is less than 10M in size with the exception of one.

I'm testing the same data as I'm building the workflow, so I'm using the same date interval against the same table using the same API call. I've provided a screen shot of most of the workflow in case it provides a clue.

The Union of all docs does not break up - - it saves as one doc.

thanks,

Chris

Re: Why does my output get broken into two or more documents?

clmc9601 — Fri, 29 Jan 2021 02:29:14 GMT

Hi @Archaeopteryx,

There is a configuration setting of the output data tool that will break data into multiple files based on a field. If this setting is enabled in your workflow, that's why-- it's breaking your data into groups based on the listed field and outputting as many files as there are unique values. Hope this helps!

output data configuration window

Re: Why does my output get broken into two or more documents?

Archaeopteryx — Fri, 29 Jan 2021 15:40:58 GMT

CLMC9601,

I was using Date Time Now as the prefix to the file name. I changed it to Date Time Today. The file breakup occurred due to seconds in the time of day. I get it now.

Thank you,

Chris