Limited workflow registers

rdusi001

Good afternoon, I would like to develop a workflow, in which it will execute the quantity of records in pieces, that is, that the fuzzy match execute 35,000 records at a time and store the results in a temporary file and after all the records are executed it would unify the data.

The intent is to run the analysis on more than 1 million records but run partitioned for server optimization.

Any idea to carry out this analysis?

danilang

Hi @rdusi001 

Instead of the multirow, you may want to consider something like this. 

Each time the macro loops, the filter will be updated with the current value of the Control Parameter.  

iteration 1 will process record 1 to 20, iteration 2 will process 21 to 40, iteration 3 will process 41 to 60, etc. 

You should move your Record ID tool outside of the loop otherwise, you'll try to add a new RecordID with each iteration.

Dan

Batch Macro(Filter).yxmc