I'm trying to write to a Databricks table. I've created the In-DB connection, and made a successful connection. I'm able to use the Connect In-DB tool to read the table I want. I can write to the table using the Write Data In-DB tool. However, when I try to write to the table using the Data Stream In tool, I get an error saying I've found a bug. Why can I write with the Write Data In-DB tool but not the Data Stream In tool?
I receive the same "found bug" error no matter what configuration I choose for the Data Stream In tool. I've tried all 3 drop down options: "Create Temporary Table", "Create New Table", and "Overwrite Table (Drop)". And for the "Create New Table" and "Overwrite Table (Drop)", I have tried putting just the table name, the schema.table name, and the database.schema.table name.
Yeah - they'll ask you to enable trace logs. What happens if you delete the write-in-db --- so you are only using datastream-in?
Hi there, No matter what I do, I keep getting the error "Invalid Object Name" I'm using the Data Stream In tool.
Do I need to put https:// in front of the host or Http Path ??
It says I have a successful connection, but I don't know what wrong because the error is so vauge.
Thank you in advance
@Mwoody_05 YES. see: https://abc-abc123-123a.cloud.databricks.com
https://help.alteryx.com/current/en/designer/data-sources/databricks.html#idp386033 - not the message on the trailing /
Hi, what data source are you using, 'Databricks Unity Catalog' or 'Databricks' ??
I only see the csv option under databricks data source
Databricks - have you googled here? I've written ad nauseum on the set up which works for me - on various threads here. 1) you need to set up your connection - so you can scrolll down to that in connections. for writing you will need to configure your token/password AGAIN in the connection arrow on the right. I do not use DCM. I only take data in via In-DB. I only write via Datastream-IN. Your use cases may be vastly different. I bulk write locally - but I believe that S3 writing is more efficient. Message me if you have any questions with more information on your set up - It's definitely more efficient then postin ghere.