Keep running workflow even if 1 input absent

Question

Hello,

So I have 7 inputs and 7 flows corresponding to each input, wherein pivot tables are being created for each dataset.

The tables and the corresponding headers are being consolidated in 1 single excel in vertical orientation.

Now there can be days when 1 input is not present or 2, then also I want my workflow to run and create output without error.

If I am switching off the container holding that flow with missing input file, the output is getting generated with rest of the reports but if not switching off, then error comes in that input data tool and nothing gets generated.

I want to schedule this thing and don't want the container on and off thing, is there any way to generate the output even if some inputs are missing?

Thanks

Kenda · Answer

Hi @Isha_Gupta

I'm glad you were able to dynamically read in all of your files.

Rather than using a macro to add the totals, you could consider using a Transpose tool followed by a Summarize then a Join to add that back to your data set. You likely will want to group by your file name, based on your description above. This way, if you have a dynamic set of files, the workflow won't error. It would look something like this:

Would this work? If not, please share a sample of your data so we can see more specifically what issue you're having.

jrgo · Answer

@Isha_Gupta if you need ensure that a data stream always has a record, you can use the "Count Records" tool and blend with your data stream. Below is an example using the Join Multiple tool that's configured to join by record position. You can also use the normal JOIN but you'll need to add a union tool afterwards.

You can also use an Append Fields tool, but you'll need to make sure that the Count Records is connected into the T input and also configure the append tool to allow all appends.

Isha_Gupta · Answer

@Kenda The dynamic input tool was able to input data with absent input file 0 records, but down the workflow there is usage of Add totals macro to count total of 1 column in pivot table which is eliminating the column headers completely for that absent input file with 0 records so nothing is flowing down to the union tool which is now giving error of no input 5.