Batch Macro - Beginner

[Anudeep_Yalamuru]

Hi Everyone, Happy Friday.

I have a complex situation. Theoretically, I know the answer to it. 

I have a database with up to 2million records. The macro tool i need to send it to has a limit of max, 10000 records for efficient processing. I know theoretically we can use batch macro to limit the records but I'm not aware of practical flow. My data has only 2 columns. A and B where A is an unique ID and B is the data. 

How can I solve this? Also, is there a way around where I can combine all the batch out puts into one?

Please provide your suggestions.

Thanks,

Anudeep

[trevorwightman]

More information is needed to provide useful help. 2M records is not a lot of records and Alteryx can handle this with ease. Which macro tool can only handle 10K records?

Nonetheless, I'll take a stab at it. If you want to only send 10K records into a batch macro at a time you need to create some identifier to group your records into 10K sections. There are many ways to do this but this is how I would do it:

1. Insert a RecordID tool

2. Insert a formula tool and this formula: FLOOR(([RecordID]-1)/10000). This will create a column where every 10K records have a new number.

3. Your control parameter is this value you just created and the data is all of your 2M rows.

Here is a video to get you started on Batch Macros.

https://community.alteryx.com/t5/Videos/Build-Your-First-Batch-Macro/td-p/52900

Good luck!