Databricks Data Stream In Tool found bug

[ChristinaFPE]

I'm trying to write to a Databricks table. I've created the In-DB connection, and made a successful connection. I'm able to use the Connect In-DB tool to read the table I want. I can write to the table using the Write Data In-DB tool. However, when I try to write to the table using the Data Stream In tool, I get an error saying I've found a bug. Why can I write with the Write Data In-DB tool but not the Data Stream In tool?

I receive the same "found bug" error no matter what configuration I choose for the Data Stream In tool. I've tried all 3 drop down options: "Create Temporary Table", "Create New Table", and "Overwrite Table (Drop)". And for the "Create New Table" and "Overwrite Table (Drop)", I have tried putting just the table name, the schema.table name, and the database.schema.table name.

[apathetichell]

hey - so a few things:

1) for troubleshooting - I cannot recommend enough that you start by checking that you can pull data FROM your database - not write data TO your database. This is especially true with Databricks where writing data can have a lot of moving parts.

2) the documentation - and my post above is very clear - enable CTAS must be UNCHECKED. you have it checked. I'd also recommend checking enable native query, the unicode box and a few more of those - but start with unchecking the CTAS one.

[Luipiu]

Hi, we need to load a file into Databricks, so our scope is to use Data Stream in Tool, but it doesn't work

We try all the possible options, also with Ctas enabled or not, the previous snapshot is one of the many attempts, the error in the ODBC log file is still the same

[apathetichell]

1) when you hit TEST on your ODBC connection - does it work.

2) reading data in is considerably easier than writing data. I strongly - strongly recommend - you get reading data to work - and then troubleshoot writing data.

3) CTAS must be unchecked. If you are not correctly setting this up - and setting up your SQL endpoint - nothing will work.

There are a lot of moving parts here -> you need a functional internal Databricks team to guide you through the Databricks part to troubleshoot any Alteryx issues.

[Luipiu]

Hi these my answers

1) Test Passed

2)

• Read works
• Write works only with 'Write data in DB' tool
• instead 'Data Stream in' does't work

3) ctas disabled, same error in the log "ERROR 16960 Simba::ODBC::Connection::SQLSetConnectAttr: [Simba][ODBC] (11470) Transactions are not supported."

Is there anyone who managed to use 'Data Stream in' with Databricks ?

[apathetichell]

If you can read/ and write via in-db write - your configuration is correct -> so that's good. My assumption is that for datastream-in you are using the same style output options as you use for write in-db (same naming conventions for named tables/etc) - but my memory is that write in-db may not work after datastream in (or directly after datastream-in). If you have a write-in-db after your datastream-in - drop it - and retest.