community
cancel
Showing results for 
Search instead for 
Did you mean: 

Engine Works Blog

Under the hood of Alteryx: tips, tricks and how-tos.
#SANTALYTICS

Gather all 9 clues to complete the final Weekly Challenge on Dec 16!

Learn More
Alteryx
Alteryx

It seems that much of the vast appeal of Alteryx to so many people is the degree to which workflows remove the programming part of data analysis. This makes it easier to focus on the data while trusting that whatever method is being used to analyze the data is done effectively and efficiently. Additionally, the visual clarity of workflows lends itself well to anyone looking at a new workflow trying to grasp what's going on.

 

These two aspects of the Alteryx software can help to make it very easy to get "in the zone" - fully focused on getting to the desired result - but not necessarily concerned with the procedure for getting there.

 

The issue is that this can lead to minor (or major) inefficiencies (sorting data then filtering it, leaving extra columns sitting around long after their use instead of selecting them out, etc).

I set out to try to deal what was in my opinion with the simplest of these, sorting immediately before filtering, in the form of an app. It would take in an alteryx workflow, app, or macro and would spit back out a new and improved version.


A simple example:


Let's input a very simple workflow that sorts, then filters a dataset:
simple_example.png

Now let's apply this Efficiency Boost App:

 

Efficiency_Boost_App.png

 

To get this result:

simple_example_edit.png

 

As you can see, it simply redirects the wires of the workflow to let data flow downstream more efficiently.

 

The results:

 

To figure out how much of a boost this had potential to give, I set up an iterative macro to take a size of a dataset and report back the time it took to randomly generate, then sort, then filter that many results. Then, I ran the Efficiency Boost App on it.

 

Here is the macro that sorts, then filters:

 

sort_filter.png


And here is the result after the Efficiency Boost App:

 

filter_sort.png

 

I threw these into a workflow to run them multiple times on different sized data sets and take averages, and it spit out these results (all in seconds):

time_results.png

 

It should come as no surprise that as datasets become larger, the Efficiency Boost App's benefits grow significantly.

 

Closing Remarks

 

As of now, the app is just in its infancy and has just been tested on relatively simple workflows/macros, but hopefully soon, now my groundwork on the parsing of the Alteryx XML is mostly done, it'll be possible to add much more functionality to find much more room for time savings.

Comments
Nebula
Nebula

@JoshKushner - possibly worth looking into this for your next challenge (and rope in some of the team that's doing the "advancing" work?)

Quasar

 This is absolutely incredible and could really change the game for our canvases. There are so many possibilities with this kind of work by rearranging more tools, modifying select statements after monitoring runs, highlighting duplicative tools, etc. This could also potential be wrapped into the designer interface (written in itsi native language) to add even more possibilities (maybe real-time suggestions).

Alteryx Partner
Alteryx Partner

@JoshKushner,

 

After a few iterations, I could see this replacing or being an enhancement to the Overview Window in Alteryx, until users are comfortable with it. Then you would have a reference screen for duplicate tools etc. A self optimizing workflow would be incredible.

Labels