I’m setting up a workflow to validate data from a pension scheme.
The data file is based on the real data but has been anonymised, either removing, or adjusting personal data and therefore can be treated as generalised data.
The idea of the workflow is to create an output file containing the model points with 2 additional columns containing the validation run date, and a comment giving the validation failure.
The initial container should create (by overwrite any existing file) a new excel spreadsheet containing the headers. This section ends in tool Output Data (6).
The second container tests that the data of birth is between 2 dates, usually 100 years ago to 20 years, but this has been adjusted to 50 and 40 years to force some failures. The end of this section is tool Output Data (12) which should append the data to the already created file.
The third container tests whether there is a “joined the scheme” date. This section ends in tool Output Data (25), which should append the data to the file already created.
There will be many other containers looking at different fields within the data, but this cut down shows the problem I’m having.
I’ve used a Block Until Done tool to try and force the processes to run in the correct order, and added Message tools for ease. These messages seem to appear in the correct order… However, the output is being created in the wrong order with Output Data (12) and Output Data (25) both being run BEFORE Output Data (6).
How do I get the workflow to run the steps in the order I want? i.e. create the file BEFORE appending the data.