This site uses different types of cookies, including analytics and functional cookies (its own and from other sites). To change your cookie settings or find out more, click here. If you continue browsing our website, you accept these cookies.
on 06-22-201704:26 PM - edited on 03-11-201909:39 AM by SydneyF
Hive ODBC can be slow when writing to tables. If you are looking for a faster option to write to Hive and want to create a new table or overwrite an existing table, use the IN-DB tools to output your data.
The IN-DB connections have an option to write directly to HDFS using AVRO:
When using this option to write, the data is first written to HDFS and then a corresponding table reference is created in Hive.
To write out data from a workflow that doesn't already use IN-DB tools, use the Data Stream In tool:
NOTE: This option does not work for updates, only when creating new tables or overwriting existing ones. It also requires the user to have access to write to HDFS.