How to combine 400 workflows into one data set

[MariaSmor]

I have 400 identical workflows (one workflow per quarter), and I need to aggregate the data from all of them in one excel spreadsheet. How to connect each workflow with "Union" icon without drawing lines connecting every workflow with "Union" icon? Thank you!

[morr-co]

Hi @MariaSmor : can you clarify what you mean by 400 workflows? What is the input for your workflows? Is it a data file? If so, you could use a Batch Macro to read all of the inputs (files) and combine them into a common output. 

[Qiu]

@MariaSmor 
If the workflow are really "identical" except for input, then instead of 400 flows, maybe a batch marco can do the same.

Then the output of macro can be a union.

[MariaSmor]

Hi! The input for a workflow is an excel spreadsheet. I collect certain data from a spreadsheet (80 fields) and I have already collected data form 400 files. I need to use "Union" icon to combine data form each of the workflow, but then I need to create a link between each workflow and "Union" icon 400 times.

[MariaSmor]

Thank you! I'll try to learn about batch macro.

[BrandonB]

@MariaSmor you may benefit from taking a look at this link: https://community.alteryx.com/t5/Engine-Works/The-Ultimate-Alteryx-Holiday-gift-of-2015-Read-ALL-Exc...

It covers the concept of a macro being used to read in an entire directory of files all at the same time AND it provides the macro for your use! Take a look and let me know what you think. 

[aghani006]

Agree with others. Its better to use batch macros with conditions.

[MariaSmor]

Hi BrandonB! I understand that I can use the macro to collect data from multiple excel spreadsheet, but if the data is already collected (as I said I have 400 individual workflows), can I connect 400 workflows without drawing connecting lines 400 times? Thank you! 

[Qiu]

@MariaSmor
Maybe the  Chained Analytic Applications can help.
I read somewhere that CReW Macros having this "List Runner", which allow you run workflows in order.

[aghani006]

The chained app will have to be configured 400 times. Probably the crew macros.