Lineage at Column Level

[Kosi]

Connect currently provides lineage for a datasource at the table level but we would like to be able to have this at a more granular level i.e. the column level so if a specific column changes in the table (e.g. data type change), we are notified of the change and able to identify quickly assets that will be affected.

@SeanAdams @Revathi

[VojtechT]

Hi @Kosi ,

we are currently investigating options how to achieve this goal. It is clear that we cannot get the columns using the current approach, i.e. parsing the workflow definition, but need to get on a lower level. 

This will probably have a significant impact on the whole lineage-making process and the results can be expected in rather long- than short-term.

[Aum]

We can benefit from this too.

[monodera]

My customers also want Lineage at Column Level .