Alteryx Designer writes all files after workflow completes.

Question

I created one workflow and standard Macro, I am passing start date and end date as input to workflow. I need to extract data from Impala based on provided date. When i am passing multiple dates it works perfectly but writes file all files at on disk after completing entire workflow.

I want files to be written as an when process completes for each month.

Emmanuel_G · Answer

@varmaram1981

If you create a month column and add that month to your file path, much like Data_July or Data_August. Will this solve your problem ?

Amol_Telore · Answer

Hey @varmaram1981

Standard workflow processes entire input data set at the same time. To generate files one by one for each month, you need to use batch macro. By using batch macro, data is processed in chunk of entire data (batches) instead of entire dataset. Attached is one sample workflow to help you understand how batch macro works. This example also demonstrate the solution to your question. Hope I have solved your concern.

You can also refer below interactive sessions in order to better understand different types of macros and its usages.

https://community.alteryx.com/t5/Interactive-Lessons/tkb-p/interactive-lessons/label-name/Macros

New Workflow2.yxzp