Iterative Reconciliation with Dynamic Filters

[R0M]

Hello everyone,

I have recently done a workflow that reconciles two sources and makes outputs according to the possible mismatch (cf. below).

Both sources have approximately the same structure:

Source 1:

C1	C2	...	C30
422000	10.42	...	event10
622100	29.77	...	event11
490020	7.19	...	event14

Source 2:

Ca	Cb	...	Cz
422000	10.42	...	E10
622100	29.77	...	E11
510010	7.02	...	E17

I would like to replicate this reconciliation several times but with different filters (currently hard coded in the three "Filter Elem" that you can see at the beginning of the workflow).
I was thinking to use an Iterative Macro looping through a third input, having the columns to filters and the expected values, but I am struggling a bit with its implementation.

 Parameter Input Example:

C1	C30	Ca	Cb	...	Cz
422000	event10,event11	NEW	UK	...	special
390100		NEW	FR,UK	...	E10,E11,E12
510010			FR	...	E24

The filters would be applied as below:

• The Filter Elem 1 will only consider the column C1.
• The Filter Elem 2 will only consider the column C30.
• The Filter Elem 3 will consider the combination of all the others columns of the second source.

Note1: if the value of a column is empty, it won't apply any filter on it.
Note2: if several values must be filtered on the same column, I split it with commas

The treatment of the workflow itself does not really matter, the idea for me is to get the base of a structure to do the iteration and the filtering, and make one output per iteration.

Also, if you think about any other more elegant solution, please do not hesitate 🤗

Thanks for your help,

Romain

[R0M]

Hi everyone,

Any idea/suggestion regarding my post? 

Thanks again!

Romain