Help Input Data Not Flowing Through!

Question

Hi All,

This is a similar issue to my previous post.

I am consistently running into an issue which is slowing me down and increasing a risk of providing incorrect data.

Currently in the morning I am running the attached workflow with the three data sources, BI, NPNS & SNI these are updated a few minutes before I run this workflow. When I run the workflow is fine, apart from a few warnings which I need to configure but they shouldn't change the outcome, I check the output table and I can see that the output is not matching the input when they should. So to investigate where this data is being lost I attach and run another output to try investigate where this data is being lost but all the points I check I can see that there aren't any issues, when I get to the final check, output point, I can see that it's ran perfectly and all the data has flowed correctly.

Can I please have some help with this issue as I need to find a work around to stop this being a regular occurrence as doing all these checks is incredibly time consuming and they are essentially redundant as there isn't any error in the work flow its self.

Any suggestions to the potential  issue will be greatly appreciated

Project.yxmd

jdminton · Answer

@CBoardy98 sorry, you mentioned warnings. What are the warnings?

It is difficult to know anything happening in the workflow since there is no provided data, but I would start with the completed workflow and trace the record counts as you go through to see what is dropping out and when. If you can provide screenshots of the workflow after running showing the record counts in the connection progress, we may be able to help direct where to look.

CBoardy98 · Answer

Hi @jdminton ,

That's not the issue, I don't get any error messages when running the workflow which is why I'm struggling.

I'm checking all the joins when it doesn't flow through correctly and no data is being lost.

jdminton · Answer

@CBoardy98 , thanks for including the workflow, but there is no data coming in to validate. I'm wondering if you could share the error messages you are receiving and other messages from the results pane to see what might be happening or providing data to help diagnose.