Field Size Limitation when connecting to Hive Server

Question

Hey,

We are currently storing our click stream data in Hive Server.

Its a JSON string stored in single column, and hence the width of the column may go up to 1000 Characters.

However, when I connect Alteryx Input Node using ODBC Driver for Hive, the output is truncated to 255 characters.

I also tried the In-DB connection for Hive server. While the data is fully read in this case, as soon as I use data stream out - the column width again gets truncated at 255 characters.

The select, auto field tools etc will not help since the issue is at input node level itself.

Any suggestions on how to deal with this?

If you see the attached screenshot, I am calculating length of each record and then summarizing a max of length.

The above activity is done using In-DB tools, as well as usual tools after exporting the data using Data Stream Out.

The output for in db browse tool is 740, while that for usual browse tool is 255.

Trent_Widrick · Answer

@PaulN - created an account just to say thank you for this.

AmeliaG · Answer

@dmccandless To adjust your ODBC driver configuration:

1. Open 'ODBC Data Sources' on your computer

2. Select your Hive DSN and click 'Configure

3. Follow the screenshots above to edit your driver settings.

Hope this helps!

Amelia

dmccandless · Answer

I'm asking b/c when I pull in some string fields from querying with SQL to an ODBC, a string field is getting truncated ☹