Re-run part of the workflow

Hi,

I currently have a long workflow some of which link to very large datasets through an SQL server. Is it possible to re-reun only a few of the nodes instead of bringing in the same dataset every single time I run the workflow? My aim is to shorten the amount of time it takes to re-run the workflow when I'm experimenting with the nodes (it's taking around 15 minutes)

Thanks

Preparation

Accepted answers

daniel_mmi

You might want to check out the Cache Dataset Macro, available in the Macro District, on the gallery.

http://community.alteryx.com/t5/Engine-Works-Blog/The-Cache-Dataset-Macro/ba-p/3162

It does just what it says, and lets you toggle the macro between a pass through state, in which it writes data to a temp file, and an interrupt state, in which it retrieves the same data. Once you're ready to run the whole thing again, just switch it back to get live data.

You might also want to put your slower/upstream nodes in tool containers, which you can then enable/disable.

All comments

daniel_mmi

You might want to check out the Cache Dataset Macro, available in the Macro District, on the gallery.

http://community.alteryx.com/t5/Engine-Works-Blog/The-Cache-Dataset-Macro/ba-p/3162

You might also want to put your slower/upstream nodes in tool containers, which you can then enable/disable.

Thank you so much! This tool is perfect - it would be useful as a standard node in Alteryx

ChiBK

This seems like a great tool but I've been unable to get it to work. I start with my inputs, then have my selects, then a union. After that, I've put in the cache tool. I've run it to write a temp file, and then changed it to run from the temp file while disabling the inputs, selections, and union. I am getting an error that the cache is in read mode.

Could anyone offer any advice?

Thanks,

Brad

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15875

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703