Advent of Code is back! Unwrap daily challenges to sharpen your Alteryx skills and earn badges along the way! Learn more now.

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Alteryx Designer writes all files after workflow completes.

varmaram1981
5 - Atom

I created one workflow and standard Macro, I am passing start date and end date as input to workflow. I need to extract data from Impala based on provided date. When i am passing multiple dates it works perfectly but writes file all files at on disk after completing entire workflow.

 

I want files to be written as an when process completes for each month.

2 REPLIES 2
Amol_Telore
11 - Bolide

Hey @varmaram1981 

 

Standard workflow processes entire input data set at the same time. To generate files one by one for each month, you need to use batch macro. By using batch macro, data is processed in chunk of entire data (batches) instead of entire dataset. Attached is one sample workflow to help you understand how batch macro works. This example also demonstrate the solution to your question. Hope I have solved your concern.

 

You can also refer below interactive sessions in order to better understand different types of macros and its usages.

https://community.alteryx.com/t5/Interactive-Lessons/tkb-p/interactive-lessons/label-name/Macros

 

Emmanuel_G
13 - Pulsar

@varmaram1981 

 

If you create a month column and add that month to your file path, much like Data_July or Data_August. Will this solve your problem ?

Labels