The Efficiency Boost App: An App Enforcing Efficient Design

[DylanB]

It seems that much of the vast appeal of Alteryx to so many people is the degree to which workflows remove the programming part of data analysis. This makes it easier to focus on the data while trusting that whatever method is being used to analyze the data is done effectively and efficiently. Additionally, the visual clarity of workflows lends itself well to anyone looking at a new workflow trying to grasp what's going on.

These two aspects of the Alteryx software can help to make it very easy to get "in the zone" - fully focused on getting to the desired result - but not necessarily concerned with the procedure for getting there.

The issue is that this can lead to minor (or major) inefficiencies (sorting data then filtering it, leaving extra columns sitting around long after their use instead of selecting them out, etc).

I set out to try to deal what was in my opinion with the simplest of these, sorting immediately before filtering, in the form of an app. It would take in an alteryx workflow, app, or macro and would spit back out a new and improved version.

A simple example:

Let's input a very simple workflow that sorts, then filters a dataset:

Now let's apply this Efficiency Boost App:

To get this result:

As you can see, it simply redirects the wires of the workflow to let data flow downstream more efficiently.

The results:

To figure out how much of a boost this had potential to give, I set up an iterative macro to take a size of a dataset and report back the time it took to randomly generate, then sort, then filter that many results. Then, I ran the Efficiency Boost App on it.

Here is the macro that sorts, then filters:

And here is the result after the Efficiency Boost App:

I threw these into a workflow to run them multiple times on different sized data sets and take averages, and it spit out these results (all in seconds):

It should come as no surprise that as datasets become larger, the Efficiency Boost App's benefits grow significantly.

Closing Remarks

As of now, the app is just in its infancy and has just been tested on relatively simple workflows/macros, but hopefully soon, now my groundwork on the parsing of the Alteryx XML is mostly done, it'll be possible to add much more functionality to find much more room for time savings.

Efficiency_Boost_App_v1.yxzp

[SeanAdams]

@JoshKushner - possibly worth looking into this for your next challenge (and rope in some of the team that's doing the "advancing" work?)

[JoshKushner]

 This is absolutely incredible and could really change the game for our canvases. There are so many possibilities with this kind of work by rearranging more tools, modifying select statements after monitoring runs, highlighting duplicative tools, etc. This could also potential be wrapped into the designer interface (written in itsi native language) to add even more possibilities (maybe real-time suggestions).

[andrewdatakim]

@JoshKushner,

After a few iterations, I could see this replacing or being an enhancement to the Overview Window in Alteryx, until users are comfortable with it. Then you would have a reference screen for duplicate tools etc. A self optimizing workflow would be incredible.