Missed the Q4 Fall Release Product Update? Watch the on-demand webinar for more info on the latest in Designer 24.2, Auto Insights Magic Reports, and more!
Free Trial

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Databricks Data Stream In Tool found bug

ChristinaFPE
7 - Meteor

I'm trying to write to a Databricks table. I've created the In-DB connection, and made a successful connection. I'm able to use the Connect In-DB tool to read the table I want. I can write to the table using the Write Data In-DB tool. However, when I try to write to the table using the Data Stream In tool, I get an error saying I've found a bug. Why can I write with the Write Data In-DB tool but not the Data Stream In tool?

 

I receive the same "found bug" error no matter what configuration I choose for the Data Stream In tool. I've tried all 3 drop down options: "Create Temporary Table", "Create New Table", and "Overwrite Table (Drop)". And for the "Create New Table" and "Overwrite Table (Drop)", I have tried putting just the table name, the schema.table name, and the database.schema.table name.

 

FoundBug.png

14 REPLIES 14
apathetichell
19 - Altair

Yeah - they'll ask you to enable trace logs. What happens if you delete the write-in-db  --- so you are only using datastream-in?

Mwoody_05
7 - Meteor

Hi there, No matter what I do, I keep getting the error "Invalid Object Name" I'm using the Data Stream In tool.

Do I need to put https:// in front of the host or Http Path ??

It says I have a successful connection, but I don't know what wrong because the error is so vauge.

Thank you in advance


apathetichell
19 - Altair
Mwoody_05
7 - Meteor

Hi, what data source are you using, 'Databricks Unity Catalog' or 'Databricks' ??

I only see the csv option under databricks data source

 

Screenshot 2024-08-06 142946.png

apathetichell
19 - Altair

Databricks - have you googled here? I've written ad nauseum on the set up which works for me - on various threads here. 1) you need to set up your connection - so you can scrolll down to that in connections. for writing you will need to configure your token/password AGAIN in the connection arrow on the right. I do not use DCM. I only take data in via In-DB. I only write via Datastream-IN. Your use cases may be vastly different. I bulk write locally - but I believe that S3 writing is more efficient. Message me if you have any questions with more information on your set up - It's definitely more efficient then postin ghere.

Labels
Top Solution Authors