Write Data into Iceberg Table in Dremio

Question

Hi everyone.

I am trying to append data into an iceberg table in Dremio.
I have the connection to Dremio setup through Arrow Flight SQL ODBC Driver.

However, when I run the workflow it returns error of NullPointerException.

So the question is:

1. Is it possible to write data into Dremio from Alteryx?
2. If not, what are the other methods can be used to output to Dremio?

Really appreciate for your assistance. Thank you.

iceberg-append-error.png

iceberg-append-error2.png

hafizhatta · Answer

Hi @Deano478thanks for the response, really appreciate it! Do you happen to know of any other workarounds or methods to insert data into Dremio, especially considering the limitations of the Arrow Flight SQL ODBC driver for writing? I also discover that we can used python script to insert those records. However, I am just checking if there is any simpler way to do that.

Deano478 · Answer

Hey @hafizhatta from my basic knowledge of Dremio  the Arrow Flight SQL ODBC driver is primarily optimised for reading rather than writing to Dremio. So I imagine this Null Pointer error is because Dremio's SQL engine does not expect ab insert operation through the driver your using