Error using the Data Stream In tool

[bethanyjohnson_dup_416]

Hi,

I'm attempting to use the Data Stream In tool to write a table into a Cloudera Hive environment, yet keep receiving the error "Unable to find field in output record".

I've seen other posts in the community about this where the solution was to remove trailing space from the column headers. I've used a select tool to rename all column headers without any white space, but the error still keeps arising.

Any other suggestions will be greatly appreciated - thanks in advance!

[BrandonB]

Hello @bethanyjohnson_dup_416

Just to clarify, are you just looking to write up to Hive or are you trying to do In-Database processing with the In-DB tool in Alteryx after writing to a table?

If you just need to write the data up to a table you should be able to do so with a standard Output Data tool if the information is coming from a regular workflow or a Write Data In-DB tool if you are writing data to a table using in database processing upstream.

Output Data: https://help.alteryx.com/2019.3/DbFileOutput.htm

Write Data In-DB: https://help.alteryx.com/2019.3/LockInOutput.htm

Data Stream In is generally leveraged if you are looking to use In-DB tools following: https://help.alteryx.com/2019.3/LockInStreamIn.htm

[basilm]

@BrandonB @bethanyjohnson_dup_416 : one of my colleague is also facing the same problem. He is just trying to write a csv file to hive using odbc driver. We tried writing using both Hortonworks as well as Cloudera hive odbc drivers but get the same error Unable to find field "field_name " in output record.

What would be the potential root cause?

[BrandonB · Accepted solution]

@basilm I would try giving the SIMBA driver a try. The link can be found on the data source page: https://help.alteryx.com/current/designer/hive

I would also check the "Append Field Map" section of the Output Data tool to see if it shows the columns that are being mapped.  

I do believe that this will be resolved by switching to the SIMBA driver though

[susan3344]

@BrandonB

after reading your answers, i tried. i used simba hive, and made sure the fields are populated in the by field name. still getting the same error. 

still need help! 

see my setting and error below. 

[BrandonB]

@susan3344 it looks like your RunMonth and CurEciNb fields aren't mapped to the destination fields in the table. Does anything show up when you click on the drop downs in the Destination section? 

[susan3344]

it is not doing anything when the map by name is selected. 

however, when custom mapping is selected, i can select the destination to my table. 

[BrandonB]

Map by Name will only work when your column names are directly mapping to the exact column names in your destination table

[susan3344]

okay.

i tried custom mapping. 

and still get the same error. 

[susan3344]

anyone can help out there? i tired using custom mapping. still could not find the field. ....