Hello everyone,
I have recently done a workflow that reconciles two sources and makes outputs according to the possible mismatch (cf. below).
Both sources have approximately the same structure:
Source 1:
| C1 | C2 | ... | C30 |
| 422000 | 10.42 | ... | event10 |
| 622100 | 29.77 | ... | event11 |
| 490020 | 7.19 | ... | event14 |
Source 2:
| Ca | Cb | ... | Cz |
| 422000 | 10.42 | ... | E10 |
| 622100 | 29.77 | ... | E11 |
| 510010 | 7.02 | ... | E17 |
I would like to replicate this reconciliation several times but with different filters (currently hard coded in the three "Filter Elem" that you can see at the beginning of the workflow).
I was thinking to use an Iterative Macro looping through a third input, having the columns to filters and the expected values, but I am struggling a bit with its implementation. Parameter Input Example:
| C1 | C30 | Ca | Cb | ... | Cz |
| 422000 | event10,event11 | NEW | UK | ... | special |
| 390100 | NEW | FR,UK | ... | E10,E11,E12 | |
| 510010 | FR | ... | E24 |
The filters would be applied as below:
- The Filter Elem 1 will only consider the column C1.
- The Filter Elem 2 will only consider the column C30.
- The Filter Elem 3 will consider the combination of all the others columns of the second source.
Note1: if the value of a column is empty, it won't apply any filter on it.
Note2: if several values must be filtered on the same column, I split it with commas
The treatment of the workflow itself does not really matter, the idea for me is to get the base of a structure to do the iteration and the filtering, and make one output per iteration.
Also, if you think about any other more elegant solution, please do not hesitate 🤗
Thanks for your help,
Romain
