We are in the final days to enter our Data and Analytics - "What's your why?" raffle with SparkED!

Reply with your "why" in text/video format to our forum post by January 28 to be entered! 

Alteryx Designer Ideas

Share your Designer product ideas - we're listening!
Submitting an Idea?

Be sure to review our Idea Submission Guidelines for more information!

Submission Guidelines

Multi-threaded batch macros

It would be very powerful to be able to multi-thread batch macros. Since the data for each batch is known and unrelated between batches, it seems like the processing of each batch could be distibuted to multiple processors without issue. This could dramatically increase performance in certain situations.
3 Comments
leif_engdell
6 - Meteoroid
How would you handle row-1 then?

//Leif
cgoodman3
13 - Pulsar
13 - Pulsar

Hi @DanH 

 

when you say multi-thread batch macros do you mean being able to run multiple macros at the same time? 

I notice this post is a few years old now, but I recently put this in Designer discussion and I think the two are related?

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Running-multiple-batch-files-at-the-sa...

DanH
Alteryx
Alteryx

@cgoodman3 The impetus for this request was a provide a mechanism to explicitly influence multi-threaded processing. So if I had 10 batch iterations to run through the batch macro, maybe the macro would spin up 5 or 10 threads, and push any resulting record sets out as they come available. However, since this was originally proposed, we have added the new "AMP" engine that provides multi-threaded processing for most tools. In my mind, this original request is now largely being covered by AMP functionality.