Entire workflow caching

Question

Hi all,

Whenever I run my most recent workflow, it seems to auto-cache the entire workflow, rather than just the inputtools I want it to cache.

I've run the workflow with and without the AMP engine, but that doesn't seem to matter.

I've had the issue with some other workflows, but not with all of them. Has anyone had this issue before?

Yes I know my workflow is quite colorful, but that works for me ;)

caltang · Answer

Hi @RemcoV,

First off, I understand you better now. You are using the Input Tool to call from your DB - just one point before I proceed, have you used In-DB Tools before? I believe they will be a great boost as well in place of YXDB. Much better than using an Input Tool to call your DB whilst you design your workflow. https://community.alteryx.com/t5/Alteryx-Designer-Desktop-Discussions/Input-Data-vs-Connect-In-DB/m-p/93841

Back to topic, could you screenshot your Runtime Configuration page? In addition, what version of Alteryx are you running on? Tonya's comment here might help too: https://community.alteryx.com/t5/Alteryx-Designer-Desktop-Discussions/Does-quot-Cache-and-Run-Workflow-quot-behave-differently-when/td-p/790162

Lastly, perhaps you can turn off the "Cache Data box" and right click "Cache and Run" - see if this makes a difference. When you do this, your end point clicked will have a blue bubble wrapped over it, and should only be caching the workflow connected to said end point and not others unless you're joining or union everything together.

Not sure if this helps, but give it a shot! If you don't see the wrap or workflow message caching that particular data input, then you can stop the run. But if it does work, you'll need to do it for each input I believe, which can be time consuming.

Let me know if it works or not, I'll do more research!

RemcoV · Answer

Hi @caltang,

Thanks you for your quick response!

My inputtools are (almost) all database queries, which have the "Cache Data" box ticked.

However, once I then run my workflow the entirety of the workflow gets cached, not just the part I showed you.

Because the cache is cleared once I make a single change to the workflow, my inputs get de-cached as well. Resulting in me having to wait on the databasequeries once again after running.

I'm mainly just wondering why the entirety of my workflow gets cached, rather than just the input tools that should be.

caltang · Answer

If you're caching, do you cache run on the input itself or somewhere else? Usually, the end point of your cache is a light blue bubble, but I do not see it in your workflow.

If you're working with a large dataset for workflow building, may I suggest converting your input files into YXDBs (Alteryx DB file)? It's more compact, faster, and you will notice the difference in speed after conversion.

If it's really big, you can pair both YXDB and cache runs.

The reason I recommend this is based off your question, you just want to cache the input tools - I think YXDBs will serve you better for your purposes before completion of the workflow.