Running SQL Calls in Parallel - AMP Engine

[AlterRexRyan]

Hi All,

I have a workflow where I have to run multiple SQL calls. Instead of passing them through a Dynamic Input tool sequentially one at a time, I would like to run them in parallel in order to expedite the process.

I grouped my 25 calls into groups of 5 and am running them through 5 dynamic input tools using the AMP engine. My hope was that the AMP engine would allow the calls to run in parallel, but it looks like the workflow is still feeding the calls into one dynamic input at a time.

Has anyone encountered something similar and figured out a solution?

[mceleavey]

Hi @AlterRexRyan ,

the AMP engine will only allow a single tool to run multiple data "batches" in parallel, but does not facilitate the tool running multiple times for different streams simultaneously. The only way to run the calls simultaneously would be to have multiple connectors and stream the data into each connector for each call.

M.

[AlterRexRyan]

Hi @mceleavey - is the below not what you're referring to?

I have 25 calls that I'm splitting into five groups and running through five separate dynamic input tools. The workflow still processes all the calls for one dynamic input at a time before moving onto the next.

My hope was that with the AMP engine, all five streams would process simultaneously.

[apathetichell]

I do not believe this is how ODBC works. I do not believe you can do what you are trying to do.

[AlterRexRyan]

@apathetichell if this isn't possible as I've strictly designed it, are there any creative workarounds to accomplish something of this sort, short of separating into different workflows and running those in parallel?

[apathetichell]

I do not think what you are seeing is an Alteryx issue but a windows/odbc archicture issue issue. You would need to have multiple sessions/logins on your machine to execute multiple queries at the same time.