Dynamically create batch groups

Hello,

Is there any way to dynamically create batch groups?

The record number of input file is different on each project. In order to run the file within the batch macro, I would like to split records into small groups. I would like to assign batch group by every 10,000 record.

Desired output contains "batch" column to specify the batch number.

desired output.png

I used a formula tool to do so, but this is not dynamic at all.
create batch group.png

Is there any way to dynamically assign batch group? I've attached a sample workflow.

Sincerely,

knozawa

dynamically create batch groups.yxzp

Tips and Tricks

Batch Macro

Dynamic Processing

Accepted answers

Thableaus

Hi @knozawa

What about a Multi-Row Formula Tool?

WF appended.

Cheers,

dynamically create batch groups.yxmd

All comments

DavidP

Would you be able to use the Tile tool with Equal Records option to create batches?

Thableaus

Hi @knozawa

What about a Multi-Row Formula Tool?

WF appended.

Cheers,

dynamically create batch groups.yxmd

knozawa

Hi@DavidP ,

Thank you for your reply.

I think equal records option is good when the maximum number of records is the same for all input. However, I might have 100,000,000 records or sometimes 500,000 records. If I would like to separate batches by 10,000 batch records, I'm not sure if we can do that using the tile tool.

Sincerely,

knozawa

Thank you, @Thableaus.

This is my first time seeing the MOD function. Good idea.

Sincerely,

knozawa

CraigG

I noticed you have a RecordID. Below is the formula I would use to create the BatchID for batches of 10,000 records

FLOOR(ToNumber([RecordID])/10000)

Kind Regards

Craig

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703