Workflow Taking Too Long to Run

Question

I have tried to construct this workflow about a thousand different ways without any luck. I am currently trying to create a workflow that will replace an old antiquated canned report. The problem I am running into is a couple of tables contain a significant amount (one table contains a colossal amount) of data, which is unfortunately necessary for the report I am trying to create. Fortunately not all of the columns are required for each table and therefore I have tried joins and multi joins after the select tool but as stated above, the workflow still takes too long to run. I thought about using In-Database tools; however, I do not think that will work due to the fact I only have read only access to the database. If I am wrong about this, please let me know.

Does anyone have any suggestions on how I can construct a workflow that would speed things up or even a pre-SQL statement, macro, or join that maybe I have not thought about, that would help? Any advice would be greatly appreciated and thank you in advance!

FreeRangeDingo · Answer

You could also try this...

https://www.bigmountainanalytics.com/how-to-reduce-the-size-of-alteryx-data-sets/

FreeRangeDingo · Answer

Have you enabled performance profiling to ensure you know where the flow is taking so long?  Click in the Canvas and then go to Runtime in the Workflow - Configuration.  Click the checkbox that says "Enable Performance Profiling".  After your un the flow, you'll see something like this in the Results panel.  This will tell you if it's your query or a join or something else.  If it is a query problem, then I would try using Dynamic Input or Batch macro as described here and here.

https://www.bigmountainanalytics.com/solve-query-timeout-issues-in-alteryx/

https://www.bigmountainanalytics.com/how-to-fix-query-timeouts-in-alteryx/

davidskaife · Answer

Hi @JustinZeh

One idea to consider; If the issue with the length of time it's taking to run is due to the data being extracted, have a think about creating an extraction workflow that extracts all the data you need and places into Alteryx Database Files.

You can then build the replacement report workflow on the back of the Alteryx Database Files so you only need to update the database files once, and the report workflow can be ran multiple times while building/testing?