We are celebrating the 10-year anniversary of the Alteryx Community! Learn more and join in on the fun here.
Start Free Trial

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Whether you can write data to the databricks using the output tool?

pg_two
7 - Meteor

HI,all

Whether you can write data to the databricks using the output tool?How do I write the result data to the databricks?

Because I had a problem: I was using the output tool to try to write the resulting data to the databricks, but the message was not supported. Do you have any solutions?

thanks all.

pg_two_1-1668499613618.png

 

 

13 REPLIES 13
LaszloD
5 - Atom

@apathetichell you seem to be an expert on this topic. Maybe you (or someone else) can help me. 
I managed to set up a Gallery connection to databricks and it's working fine to read data but when I try to write, I get this error: Writing to Spark is not supported.

 

I also tried to set up an in-db connection to write back to databricks using the data stream in tool with no luck. I get the same error.
This article shows how to set up the write tab for in-db connection. I set up the Connection String on the Read tab the same as I did for the Gallery connection (see screenshot), however for me the Connection String field on the write tab is greyed out. Any idea what am I doing wrong?


 

 

 

 

 

apathetichell
20 - Arcturus

hey - for writing - you'll definitely need to add a connection string and configure it.  you should be using the spark odbc (as pictured in the documentation you sent vs the apache spark for databricks). Try setting that up (ie using the Spark driver/including the dsn/username/password/cluster endpoint). see if that helps. I vaguely remember also setting it for .csv vs parquet or avro (not sure if this has been fixed).

 

 

LaszloD
5 - Atom

Thank you for your quick response. I reconfigured the in-db connection using the Apache Spark ODBC with no luck. Still same error.


I am using the spark odbc driver as the article suggested. Then I configured it as shown.
Now the write connection string textbox is not grayed out. However, I'm not sure what I should put there. Also I can't see the dialog box the article shows to set up for write.
See the screenshots below. 
Any idea what I'm doing wrong?

apathetichell
20 - Arcturus

hmmm.... looks like they updated it from what I'm used to. 1) try .csv. This is usually the easiest/most straight forward/most Alteryx friendly.

 

it's weird that that config screen has both host and url -> these often mean the same thing. can you try using datastream in vs write in db?

Labels
Top Solution Authors