community
cancel
Showing results for 
Search instead for 
Did you mean: 

Alteryx designer Discussions

Find answers, ask questions, and share expertise about Alteryx Designer.
SOLVED

Dynamically create batch groups

Highlighted
Fireball

Hello,

 

Is there any way to dynamically create batch groups?

 

The record number of input file is different on each project.  In order to run the file within the batch macro, I would like to split records into small groups.  I would like to assign batch group by every 10,000 record.  


Desired output contains "batch" column to specify the batch number.

desired output.png


I used a formula tool to do so, but this is not dynamic at all.
create batch group.png

 

Is there any way to dynamically assign batch group?  I've attached a sample workflow.

 

Sincerely,

knozawa

Pulsar

Would you be able to use the Tile tool with Equal Records option to create batches?

Alteryx Certified Partner

Hi @knozawa 

 

What about a Multi-Row Formula Tool?

 

BatchMulti-Row.PNG

 

WF appended.

 

Cheers,

Fireball

Hi@DavidP ,

 

Thank you for your reply.

 

I think equal records option is good when the maximum number of records is the same for all input.  However, I might have 100,000,000 records or sometimes 500,000 records.  If I would like to separate batches by 10,000 batch records, I'm not sure if we can do that using the tile tool.

 

Sincerely,

knozawa

Fireball

Thank you, @Thableaus

 

This is my first time seeing the MOD function. Good idea.

 

Sincerely,

knozawa

Meteoroid

Hi

 

I noticed you have a RecordID. Below is the formula I would use to create the BatchID for batches of 10,000 records

 

FLOOR(ToNumber([RecordID])/10000)

 

Kind Regards

Craig

Labels