Iterative Reconciliation with Dynamic Filters

Question

Hello everyone,

I have recently done a workflow that reconciles two sources and makes outputs according to the possible mismatch (cf. below).

Both sources have approximately the same structure:

Source 1:

C1C2...C3042200010.42...event1062210029.77...event114900207.19...event14

Source 2:

CaCb...Cz42200010.42...E1062210029.77...E115100107.02...E17

I would like to replicate this reconciliation several times but with different filters (currently hard coded in the three "Filter Elem" that you can see at the beginning of the workflow).
I was thinking to use an Iterative Macro looping through a third input, having the columns to filters and the expected values, but I am struggling a bit with its implementation.

Parameter Input Example:

C1C30CaCb...Cz422000event10,event11NEWUK...special390100 NEWFR,UK...E10,E11,E12510010  FR...E24

The filters would be applied as below:

* The Filter Elem 1 will only consider the column C1.
* The Filter Elem 2 will only consider the column C30.
* The Filter Elem 3 will consider the combination of all the others columns of the second source.

Note1: if the value of a column is empty, it won't apply any filter on it.
Note2: if several values must be filtered on the same column, I split it with commas

The treatment of the workflow itself does not really matter, the idea for me is to get the base of a structure to do the iteration and the filtering, and make one output per iteration.

Also, if you think about any other more elegant solution, please do not hesitate 🤗

Thanks for your help,

Romain

R0M · Answer

Hi everyone,

Any idea/suggestion regarding my post?

Thanks again!

Romain