Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Designer Output Data to Snowflake

RectorSeal_Jason
5 - Atom

Howdy All-  

 

I am trying to setup my 'Output Data' to send the data straight to a Snowflake table (Create or append or replace).  Snowflake security seems fine, I am able to modify table etc.   I also no longer receive an Alteryx error about authority.   The Tool does start moving data, but SUPER SLOW.  The total output is about 11k rows by 10 columns.   

 

The job just runs and runs.  The output does not show a % complete.  I end of stopping it, when I check the table some data has made it over <1,000 rows over 10 mins.   

 

I am sure there are a lot of setting I am unaware of. 

 

I usually send the out put to an excel file.  But, Snowflake is new for us and I need the data in Snowflake.  

 

Has anyone had success with outputting data to Snowflake?   What am I missing?  

 

Thank you all!

3 REPLIES 3
chukleswk
11 - Bolide

There are several things to check here when using snowflake:

  1. What size Warehouse is your role using? The smaller the warehouse, the longer it will take...
    • Here is a good site that will help you determine what size warehouse to use: Choosing the right warehouse 
    • Your warehouse setting will be set in your ODBC connection
  2. Are you able to use the Snowflake Bulk to load the data?
    • If you are, that will significantly reduce your run-time and this will use one of your current ODBC connections
  3. Load it using InDB connections as this will also speed up your loading time because it is using the server to process it instead of your local machine.
RectorSeal_Jason
5 - Atom

Thank you for the response. 

 

We are using an x-small warehouse. 

 

I have not tried Snowflake Bulk , Do I need anything special for it? 

 

I tried setting up in In-Db, again it could be me, but they do about the same as the regular. 

 

 

chukleswk
11 - Bolide

I would look to see if you have another warehouse available. Maybe try and use a Medium sized warehouse.

 

You don't need anything special to use Snowflake Bulk, it'll use you're regular ODBC connection. For technology you'll want to use: Snowflake Bulk (Local Staging Table) unless you have AWS available to you.

Labels
Top Solution Authors