Designer Output Data to Snowflake
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Howdy All-
I am trying to setup my 'Output Data' to send the data straight to a Snowflake table (Create or append or replace). Snowflake security seems fine, I am able to modify table etc. I also no longer receive an Alteryx error about authority. The Tool does start moving data, but SUPER SLOW. The total output is about 11k rows by 10 columns.
The job just runs and runs. The output does not show a % complete. I end of stopping it, when I check the table some data has made it over <1,000 rows over 10 mins.
I am sure there are a lot of setting I am unaware of.
I usually send the out put to an excel file. But, Snowflake is new for us and I need the data in Snowflake.
Has anyone had success with outputting data to Snowflake? What am I missing?
Thank you all!
- Labels:
- Output
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
There are several things to check here when using snowflake:
- What size Warehouse is your role using? The smaller the warehouse, the longer it will take...
- Here is a good site that will help you determine what size warehouse to use: Choosing the right warehouse
- Your warehouse setting will be set in your ODBC connection
- Are you able to use the Snowflake Bulk to load the data?
- If you are, that will significantly reduce your run-time and this will use one of your current ODBC connections
- Load it using InDB connections as this will also speed up your loading time because it is using the server to process it instead of your local machine.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Thank you for the response.
We are using an x-small warehouse.
I have not tried Snowflake Bulk , Do I need anything special for it?
I tried setting up in In-Db, again it could be me, but they do about the same as the regular.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I would look to see if you have another warehouse available. Maybe try and use a Medium sized warehouse.
You don't need anything special to use Snowflake Bulk, it'll use you're regular ODBC connection. For technology you'll want to use: Snowflake Bulk (Local Staging Table) unless you have AWS available to you.
