Exporting as array when using Hive as a destination

[4581b17319aaf33d309d]

Hi everyone,

both Trifacta and Hive support the Array type, however when exporting to Hive arrays are always converted into strings (see attached screenshots).

As I intensively use the array type, I have to process all my tables with python to reconvert strings into array (i.e. rewrangle wrangled tables!)

Is there a way to keep this array type ? Otherwise this would be a must-have feature to develop.

I'm using Trifacata enterprise 5.1.

Thanks.

[Trifacta_Alumni]

Hello Mickael, let me look into this and I will let you know the next steps.

[4581b17319aaf33d309d]

Thanks Gina

[Trifacta_Alumni · Accepted solution]

Hello Mickael, this is the intended behavior as mentioned in the following, "NOTE: You cannot append to Hive map and array column types from Trifacta columns of Map and Array type, even if you imported data from this source." https://docs.trifacta.com/display/r051/Hive+Data+Type+Conversions?os_username=tr82r051usr-&os_password=%5E88f2Sl2mG0A2l1239F%5E#HiveDataTypeConversions-Write/Publish

I have filed a feature request #3876363 on your behalf so that the product team understands your requirement.

[4581b17319aaf33d309d]

Thanks Gina!

Let's hope the product team will consider this feature valuable ;-)