Free Trial

Alteryx Designer Desktop Ideas

Share your Designer Desktop product ideas - we're listening!
Submitting an Idea?

Be sure to review our Idea Submission Guidelines for more information!

Submission Guidelines

Remove bad stopwords in Text Preprocessing tool

Please remove all stopwords that help to identify the sentiment of a text. E.g. words like 'no' and 'not' are currently removed when you enable the 'remove stopwords' options. Here is an example:

 

grossal_0-1606336161535.png

grossal_1-1606336172201.png

 

 

People will probably use the option to remove stopwords without even thinking about issues like this and might remove relevant information from texts and then do a Sentiment Analysis afterwards and wonder why the results are bad.

 

Dear Alteryx, please find a better stopword list or remove some words from the list.

1 Comment
CristonS
Alteryx Alumni (Retired)
Status changed to: Not Planned

We recommend that you don't use the Text Pre-processing tool to process text data for use with the Sentiment Analysis tool. The Text Pre-processing tool can remove features that the Sentiment Analysis tool relies on to determine sentiment. The underlying VADER algorithm optimizes for raw text. Text pre-processing is not recommended because VADER takes into account punctuation when assigning sentiment score. For example, the sentence “Star Wars is awesome!!!” would be rated as more positive than “Star Wars is awesome.” The same is true for capitalization used for emphasis.