We are trying to optimize our work flow process on our Alteryx server. Breaking down processing jobs into smaller groups. Is seems that opening multiple instances of Alteryx and running one individual work flow on each instance (10 instances) seems to be performing better than one instance of alteryx running the 10 workflows.
Can someone shed some light on which case would be more optimal. More importantly, how is Alteryx going to manage system resources in both cases.
Memory and CPU are the biggest concerns.
Thanks
The Periodic Table of Alteryx tools will shed some light on how many processes are limited to single threaded operation:
https://community.alteryx.com/t5/Engine-Works-Blog/The-Periodic-Table-of-Alteryx-tools/ba-p/64120
If you use the Performance Profiling option (Workflow Configuration > Runtime > Enable Performance Profiling), you can see the tools in your process that are taking the most time to complete. In many cases, breaking your workflow into multiple engine instances can improve processing throughput on machines that have sufficient resources. Alteryx has mentioned they are working on a new engine, but we don't have any information on that development timeline.
If you are running that many workflows simultaneously to optimize machine resources, I highly recommend you do this using Command Line execution so that you don't waste resources on 10 instance of the Designer GUI (in case you weren't already doing this).
User | Count |
---|---|
5 | |
1 | |
1 | |
1 | |
1 |