Be sure to review our Idea Submission Guidelines for more information!
Submission GuidelinesCreation of a gradient based background which correspond to where records drop throughout the workflow to identify issues or potential anomalies based on the initial dataflow. It could also certain tools flash when the record counts are 0 for example filter tools, joins, unions etc.
Sometimes there are hundreds or even thousands of tools in very complex workflows so it would be helpful to track the data lineage.
It would also be nice to have a tool that summarizes the number of records per each input and how many make their way in to the final tool/output or browse.
Input # | Start of workflow | Dropped in Workflow | Total in final dataflow |
Database 1 | 10000 | 8000 | 2000 |
Excel file 1 | 10000 | 1000 | 9000 |
Download Tool 1 | 10000 | 5000 | 5000 |
Total | 30000 | 14000 | 16000 |
The gradient can be adjusted based on the threshold and it could be added to connections in this case the red indicates there's been 0 records and the filter tool could flash or glow
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.