Hi All,
I'd like to use a non-gallery approach for our ETL use-case given the more flexibility it provides, but I'm curious on how to set the scheduling up in a distributed server environment with multiple workers. If we have a shared location (EFS) across the controller and workers and we fire off batch commands on the Controller that triggers workflows, will the Controller node then instruct individual workers to run those workflows?
Would love to hear any use-cases that have already been implemented in a similar fashion.
Best,
dK