Speed Up IN-DB Data Stream Out

Barry_Cooper

I have a large workflow with several data stream outs from the same connect In-DB tool which connects to Athena with 64 bit ODBC driver. The connect In-DB tool connects to Athena and then from the tool there are multiple branches with different filters applied. At the end of each branch there is a summarization tool and a data stream out. It's taking over 3 hours to run... Is there something I could be missing to speed this up? Would it be quicker to stream out the raw data just once and then branch off and filter from that? Any advice, tips, tricks would be much appreciated.    

ChrisTX

Have you looked at the ODBC config Advanced Options, like "Rows to Fetch Per Block" ?

The Inspire 2016 Tips and Tricks document has a few tips for in-DB connections:

https://community.alteryx.com/t5/Alteryx-Designer-Knowledge-Base/Inspire-2016-Tips-amp-Tricks/ta-p/27667

Not sure how dated the document is, or if things like "Cache Data" and "Do Not Show % Complete" are applicable to an Athena connection.

Is it possible to reduce the number of records queried by using the Data Stream In tool, and using that data in a where clause with the Dynamic Input In-DB tool?

Chris