Be sure to review our Idea Submission Guidelines for more information!
Submission GuidelinesPlease ignore this post! I just discovered the amazing dynamic input tool can accomplish exactly this 🙂
This is no longer a "good future idea" but simply a solution already provided by AlterYX! Thanks AlterYX!
Hello everyone. I think it would be incredibly helpful if all input tools (database / csv files / etc..) had an input stream for data processing.
This input stream would cause the tool to fire if and only if at least 1 row of "data" was passed into it. This would work similar to the Email tool, as the input would simply not fire if no records in the workflow were passed into it.
By making this change, AlterYX could then control the flow of execution when reading / writing to database tables and files without having to bring in Macros or chained applications.
The problem with having to use batch macros and block until done to solve this problem is that it obfuscates your workflow logic, making it much harder for another developer to look at the workflow and understand what is happening. Below is an extremely simply example of where this is necessary.
Example: any time you are doing a standard dimentional warehouse ETL.
Step #1: Write data to a table with an auto-incremented Key
Step #2: Read back from that table to get the Key that you just generated
Step #3: use that key as a foreign key in your primary Fact table.
Without this enhancment you need at least 2 different workflows (chained apps or marco's) to accomplish the task above, however with this simple enhancement the above task could be accomplished in 3 tools.
This task is the basic building block of almost all ETL's so this enhancement would be very useful in my opinion.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.