Run Several (semi) Independent Processes in One Workflow Sequentially

Question

I have several processes in one workflow that are somewhat independent of each other but related.  They each start with a different input file but they all export to separate tabs within the same excel workbook.  This is mostly not an issue but occasionally there will be a collision where a process attempts to access the output file while another one still has it opened causing that process to fail.  How can I insure that each independent process executes sequentially so that two aren't attempting to access the output file at the same time.

Raw File Exporter.yxmd

Thableaus · Answer

Nice way to think about it @danilang

Basically creating a way to connect the data through.

danilang · Answer

Hi @SaleemB

If you can't use the CReWs macros because of IT restrictions or some other reason, you can use the following group of tools to synchronize Independent data streams

The BlockUntilDone/Summarize/Union triplet act as a hard block to ensure that the previous dataset has been completely written before passing any records further.  The Union tool adds the one row of data generated by the Summarize to your next incoming dataset, so the next Filter removes that row and the next Select removes the column.  Another Block Until Done writes the data before moving on to the next synchronizer block

In practice you use one Synchronizer block between each independent stream of data

Dan

Raw File Exporter(w. Synch).yxmd

Thableaus · Answer

Hi @SaleemB

You could try to use a bunch of Parallel Block Until Done tools.

This tool is downloaded from the CREW Macro Pack. Give it a try and let us know.

Download the Macro Pack here

Cheers,