We need a solution to be able to sequence workflow runs in Alteryx SERVER.
We normally need to split data processing projects into various workflows, which run sequentially (workflow1 runs and produces outputs1, which are used by workflow2 as inputs to produce ouptuts3, etc.).
A typical project will consist of 3 to maybe 20 workflows, some of them taking minutes or even a few hours to run.
So far we were able to run these sequences in Alteryx DESIGNER using CReW macros, but as our projects grow in size and complexity, we really need a way to move them to Alteryx Server. Some options we’ve considered/tried unsuccessfuly:
- Install CReW macros in Alteryx Server: not possible, CReW macros only supported for Designer
- Set up a workflow even to run another workflow after successful completion: we get an Error
“Failed to run external program C:\Program Files\Alteryx\bin\AlteryxEngineCmd.exe: The system cannot find the file specified” - Chained macros: this would imply converting each workflow to a macro, and create a “main” workflow to run them all. Problem is this main workflow would sometimes take really long to run, and if it failed at some intermediate step it’s not simple to re-launch it from wherever it got to, you’ve almost always have to re-start again
- Chained apps: we’ve read about this but haven’t tried, as I see it very similar (having the same disadvantages) as the chained macros option
- Equivalent to CReW macros for Alteryx server (see https://community.alteryx.com/t5/Engine-Works/Workflow-Orchestration-with-Alteryx-Server-2021-4-and-...).
I haven’t been able to build a working test for this yet – any experience in the community? - Scheduler: this is possible but doesn't really help, as we don't know upfront how long workflows will take to run, so we'd need to allow for long and unneccesary waiting-times between consecutive workflow runs
Do you have any advice / suggestions?
Thanks
