concat problem

[4c278664ee974166e813]

when importing a folder with multiple files it automatically concats the files which is perfect but gives me wrong data set because files are having different number of columns, different column names, only two columns (in all files) are matching, rest is different.

My goal is to union all the files. I have managed this by importing all the files manually from the S3 folder and then do Union as shown in the below image:

Currently, there are two files but in future it will be more. How can I automate importing all the files which are in specific folder and then do the UNION and UNPIVOTING automatically.

[APrasad_Tri]

Hi @Giorgi Gobronidze? ,

Regarding Union @Amit Miller? has explained the process in the below link: https://community.trifacta.com/s/question/0D53j0000839B5BCAU/concat-data

Since the system cannot predict the users' requirement, unpivoting, joining, and pivoting is not set up as an automatic process in Trifacta. Please refer to the documentation regarding Unpivot transform here and Unpivot columns here.

Hope this helps.

Best,

Apeksha