Community Spring Cleaning week is here! Join your fellow Maveryx in digging through your old posts and marking comments on them as solved. Learn more here!

Analytics

News, events, thought leadership and more.
sadovsky
Alteryx Alumni (Retired)

IS Banner.png

 

As the data landscape evolves, organizations’ analytical needs grow increasingly complex. Historically, modern data-science techniques have been isolated to the select few who not only were experts at programming but were also deeply entrenched in statisticsNow that is no longer true! The Alteryx Intelligence Suite democratizes advanced analytical capabilities for any interested Alteryx user. It brings the power of predictive machine learning and natural language processing to all organizations looking to unlock the power of their data with Alteryx. 

 

In our initial release of the Alteryx Intelligence Suite, we chose to focus on two of the most common data science challenges facing organizations today: 

 

  1. Data is no longer constrained to just spreadsheets. Data-savvy organizations have image, PDF, and other text assets they can extract value from. With the Intelligence Suite’s text mining capabilities, we’re opening organizations to a whole new avenue of analytical capabilitiesSocial media comments, legal documents, support emails, and more all contain a treasure trove of data that, in many organizations, has never been fully discoveredThese building blocks let you get this type of data into Alteryx, prep it for analysis, and then explore the underlying topics and themes throughout the text and visualize your results to better understand the humans behind the data. 

  2. Success today requires staying two steps ahead. Business planning in the modern world is more complex than ever. Your organization needs every competitive edge and having a clearer view of what's to come could make or break the sustainability of your business. With the Intelligence Suite’s machine learning capabilities, we’re addressing how organizations use data to create models for prediction and interpretation. In all aspects of business, you often need to make decisions given incomplete dataPredictive modeling lets you use patterns observed in the past to infer what might happen in the future. The Intelligence Suite equips users with the building blocks to answer these types of questions, along with a guided experience to help navigate the complexities inherent in this process 

The Alteryx Intelligence Suite is designed for organizations in all stages of their analytic journeyFor a beginner analyst or an organization that is just starting to adopt advanced analytics, the Intelligence Suite gives you all that’s needed to begin your analytic journey knowing that the choices you make via our drag-and-drop building blocks and on-screen guides are backed by best-in-class data science via established open source libraries like scikit-learn and XGBoost. For advanced users, the building blocks provide in-depth configuration and customization of these libraries integrated into the Alteryx environment. 

 

Users can begin to explore their predictive problems such as ranking customers who are most likely to churn or predicting the probability of an event of interest using Assisted ModelingAs the organization matures, models can be deployed via Alteryx Promote or Alteryx Server for productionIf desired, models can always be translated to raw Python code to share with other data scientists or deployed in a cloud ecosystem 

 

Whether being used for prototyping or production, the process is transparent, letting business analysts and citizen data scientists work togetherThe same best-in-class data science capabilities are true for our text mining building blocksThey are built on libraries like TesseractVADER and scikit-learn, ensuring that users are getting the best-in-class capabilities available in the market, all with the ease of use of Alteryx. 

 

The Intelligence Suite’s Text Mining Capabilities 

I’m excited to highlight some of the amazing capabilities of our Text Mining tool group. At its core, the Text Mining Tool group makes it simple to get text into Alteryx from any format, including via PDFs and images by optical character recognition.  This capability alone enables a whole new way for users to bring data into Alteryx.  However, once data is there, the Text Mining tool group also provides building blocks for manipulating and processing that data even further.

 

Preparing Text for Analysis 

The tool group includes a building block specifically to prep text data for analysis, performing  “lemmatization.” Put simply, this approach helps take different forms of words into their base grammatical component. For example, “am” / ”are” / ”is” all become “be,” and “cat” / “cats” / “cat’s” / “cats’” would become just “cat.” When performing advanced learning on text, this step is crucial to generalize large bodies of complex text into simple underlying structure 

 

With the Intelligence Suite, the task is as easy as dragging a building block onto the Designer canvas and clicking your way to a custom configuration.

 

 

The Text Pre-processing building block configuration allows the preparation of text data through lemmatization, filtering, and removal of a custom list of strings.The Text Pre-processing building block configuration allows the preparation of text data through lemmatization, filtering, and removal of a custom list of strings.

 

 

Social Listening 

Mining the social web has become a disruptive new way for organizations to understand their product impact in near real time. Tweets can be collected and defined as being positive, neutral, or negative, and businesses can keep a daily metric of “positive to negative ratio” commentary to see how the web is reacting. That said, defining a tweet’s sentiment, and doing it at a large scale, used to require someone to get deep in code. With our code-free sentiment analysis building block, this becomes an easy task.  

 

With a very simple workflow leveraging the Intelligence Suite, you can create an effective way to bulk analyze tweets! 

 

Using the sentiment analysis tool, users can create outputs like this one pictured to track the overall positivity/negativity of large corpuses of text over time.Using the sentiment analysis tool, users can create outputs like this one pictured to track the overall positivity/negativity of large corpuses of text over time.

Topic Modeling 

Michael Jordan, along with David Blei and Andrew Ng, is one of the main authors on the journal article introducing Latent Dirichlet Allocation, the research that underlies the field of topic modeling. To no one’s surprise, this isn’t the same Jordan as the 14-time NBA all-star and brief minor-league baseball player for my favorite team, the Chicago White Sox. Imagine though, you had two giant blocks of text about both the sports star, and the University of California Berkley machine-learning star. How could you tell them apart?   

 

Well, the distribution of words in those documents would likely be very different. Topic Modeling looks at those distributions, realizing that some words might be common to both, but likely co-occur in other unique patterns. Applying Topic Modeling to these texts could help you annotate all your documents with topics like “Basketball” or “Machine Learning,” but you also might discover other themes like “Sneakers,” or “Space Jam,” that could help you further organize, search or summarize your texts. One can imagine how organizations armed with lots and lots of text documents could begin to utilize this technology.  

 

I had the luxury of learning topic modeling from John Lafferty, a coauthor of David Blei during my PhD. Bringing this technology to all users of all types of academic and work backgrounds is a personally close and exciting venture into democratizing data science for me!  Now instead of struggling to get code to work based on complex underlying mathematical models, I can drag and drop tools in Alteryx and quickly start to explore the topics in any set of documents. 

 

Topic modeling allows users to explore how terms and overarching topics exist in their text via a visual interaction.Topic modeling allows users to explore how terms and overarching topics exist in their text via a visual interaction.

 

 

 

Visualizing Your Output 

The Text Mining tool group lets you build word clouds from your output, giving you a graphical representation of your analysis, complete with filters and options to make your graphics shine!  For example, below is our data science word cloud, in the shape of a cloud. 

 
 
 
 

Visualization of text is possible with the word cloud tool, which is able to take another image as a template.Visualization of text is possible with the word cloud tool, which is able to take another image as a template.Picture5.png

 

 

Machine Learning with Alteryx Intelligence Suite 

Walking through all our new machine learning capabilities is too much content for this post, so instead I’d like to focus on some of my favorite features in the new Machine Learning tool group.  

 

Full Transparency and Control 

The Assisted Modeling building block keeps humans in the loop with machine learningWhile it profiles data to make the best suggestions possible given multiple heuristics and best practices, no one knows your data better than you! As opposed to other black-box solutions, Assisted Modeling shows why it’s making the recommendations it is and at what certainty, and always allows you to override its choices. 

 

Via the Details pane (right), users can see exactly how Assisted Modeling is making its recommendations and explore data for themselves.Via the Details pane (right), users can see exactly how Assisted Modeling is making its recommendations and explore data for themselves.

 

Feature Importance 

Picking the right data for a model is hardIf you’re not careful, data that wouldn’t be available for the model in the future could accidentally be included in your training setThis phenomenon is often referred to as data leakage and can cause models in production to fail entirely or produce subpar resultsOn the other end of the spectrum, often we don’t know what data is important to a task at hand, so we throw in everything we haveThis is often the best agnostic approach; however, it can slow down the modeling process, and has the potential of complicating algorithmscausing them to perform worse than they would otherwise 

 

Assisted Modeling uses two techniques (Gini Impurity and Goodman-Kruskal Tau), to identify the best set of features to use to efficiently generate an unbiased, high-quality model. 

Assisted modeling verifies the usefulness of predictors using two methodologies outlined in the Detail pane (right).  Any predictor that is suspiciously too good, or that lacks value, will be highlighted and escalated to the user to be dropped from analysis.Assisted modeling verifies the usefulness of predictors using two methodologies outlined in the Detail pane (right).  Any predictor that is suspiciously too good, or that lacks value, will be highlighted and escalated to the user to be dropped from analysis.

 

Leaderboard Explorations 

Perhaps my favorite theorem in all of machine learning is the “No Free Lunch TheoremRoughly paraphrased, it implies that there’s no way to know which modeling algorithm is going to be right for any particular datasetWhile XGBoost may be best for one set of data, a simple Linear Model could work well for anotherOur only solution to this problem is to run multiple models on training data, and empirically see which one works best 

 

Assisted Modeling’s leaderboard page allows us to do just that, with multiple models optimized to run in parallel given the constraints of your computer. 

 

The assisted modeling leaderboard allows users to compare models against multiple metrics and dive into interpretations and configurations for each model.The assisted modeling leaderboard allows users to compare models against multiple metrics and dive into interpretations and configurations for each model.

 

Upskilling 

The most valuable part of Assisted Modeling for many analysts will be that it can help you get better at Machine Learning and gives you the option to see your work graphically or as bare codeIt carefully guides you through the modeling process, explaining what it is doing and why, while providing a detailed glossary that explains terms and methodology in plain EnglishYou can simply click through default options, or, as you gain experience, begin to experiment on your own, putting the science in data science!  As you practiceyou can skip the “assisted mode altogether and focus on creating models right on the canvasUltimately, you can turn your model into raw Python code, letting you use the graphical interface to model and then see and edit in code what your guided modeling experience created 

 

Whether you’re a newcomer or experiencedAssisted Modeling helps you build or prototype, and ultimately share or explore models in their native Python representation, completing the journey from building blocks to executable code. 

 

The “Export Model to Python” functionality allows users to expose the underlying code beneath a model in the Alteryx Python tool.The “Export Model to Python” functionality allows users to expose the underlying code beneath a model in the Alteryx Python tool.

 

 

Parting words 

I’m excited to see what solutions you come up with using the building blocks in the Alteryx Intelligence Suite!   

 

Contact your account representative to purchase a license of the Alteryx Intelligence Suite, available in Designer in 2020.2, so you can start creating and democratizing data science across your organization. If you don't know your rep, or have questions about how to get started, head over to our Support Contact Portal and select Request Access to Intelligence Suite so we can get you set up and ready to go.

Alexander Sadovsky
Senior Director of Product

Alex is focused on guiding product teams charged with defining and executing the strategy for Alteryx’s advanced analytics and data science products, along with creating SDKs for the Alteryx end to end platform.

Alex is focused on guiding product teams charged with defining and executing the strategy for Alteryx’s advanced analytics and data science products, along with creating SDKs for the Alteryx end to end platform.

Comments
CamodCPA
8 - Asteroid

Incredible, very excited to dig in more!

mceleavey
17 - Castor
17 - Castor

Ooooooh! 

 

No , I didn't just make that noise in real life. That wasn't me. You can't prove anything.

 

Fascinating read and excited to see more. 

jacob_kahn
12 - Quasar

Wow! So overwhelmed! Looking to get the new palettes ASAP! So excited to print this out and utilize the information shared!

 

J

ArtApa
Alteryx
Alteryx

This is how I see Alteryx current capabilities:

ArtApa_0-1594292419756.png

 

AnthonyFGCR
5 - Atom

Awesome article, thanks for sharing Alexander.

 

 We got a lot of work to do...this is just the beginning!

TusharAnand
5 - Atom

I do not have a license to Intelligence Suite - text mining, machine learning. However, I need to access the trial so that I can assess whether I need the license for it. How can I get the trial of the intelligence suite?

Joe_Lipski
13 - Pulsar
13 - Pulsar

Hi @TusharAnand It looks like the free trial link is here: https://www.alteryx.com/Intelligence-suite/alteryx-free-trial

 

However you could also reach out to Alteryx Support or Fulfillment who should be able to put you in touch with your account rep.