Be sure to review our Idea Submission Guidelines for more information!
Submission GuidelinesThe idea is the ability to skip tools in a workflow. Check the attached example:
Input (TRX_TABLE): Contains transactional raw data (unstructured & uncleaned data)
Filter (TRX_DATE <= 90 days from TODAY): It only filters the data 90 days old from today. Works as an incremental data loader
If the filter tool is NOT SKIPPED the workflow loads the filtered data (incremental behavior)
If the filter tool is SKIPPED the workflow loads all the data (full behavior)
This way I can quickly switch between both modes for testing & production environments
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.