Data Not Normally Distributed, which test?

Hi,

I want to test my data, however it is not normally distributed and now I dont know which test to use. Within my data there are two groups which I want to compare. The variable measures the speed between two events (average = 7 days). This is because of some outliers which I need to filter out.

1) What is the best way to handle outliers (z-score?)
2) Which test can I use to compare both groups?

How you guys can help me

not normally distributed.PNG

Not Normally Distributed.yxmd

Tips and Tricks

Transformation

Help

Predictive Analysis

Data Investigation

Accepted answers

caltang

The right skew will exist even after you calculate your z-scores. The z-score doesn't inherently change the shape of the distribution.

I'm pretty stumped myself - you may have to try other methodologies to cater to your non-standardized data.

Perhaps you can try standardizing the days data this way:

But is your research question: Is there a difference in days between Closed Won and other stages as you expected?

H0: No difference between Closed Won and other stages

Ha: There is a difference between Closed Won and other stages

If you do reach standardization, this article is useful: https://www.thedataschool.co.uk/liu-zhang/test-for-the-difference-in-the-mean-t-test-in-alteryx/

All comments

caltang

This is a question that involves some feature engineering and data sciene knowledge. Perhaps you can consider anything beyond -3 or +3 Z-Scores to be outliers, thereby reducing the number of observations in your analysis.

Your 2nd question is a bit vague. What are you testing? What are you testing between? Not very clear...

Also, it helps if you can provide your data or your workflow. Please provide relevant data to this use case, and kindly provide your criteria in as much detail as possible. If you have a workflow built halfway, kindly export that over as well.

To export a workflow go to: Options > Export Workflow. Kindly do NOT send a "Save As" copy.

Wouterrrrrr

Hi caltang,

Thank you for your response, I want to know which group is the quickest. However other test to determine the mean between two groups have the assumption that the data needs to be normnal distirbuted

caltang

Without the data, no one can give you good help. Can you kindly provide some data so that the community has something to work with...?

Wouterrrrrr

Hope this works

Not Normally Distributed.yxmd

BS_THE_ANALYST

@Wouterrrrrr this resource is fantastic if you're looking for predictive value: https://community.alteryx.com/t5/Data-Science/Alteryx-Predictive-Tools-Flowchart/ba-p/602881

if you're looking at which statistical test to apply, I think flowcharts are invaluable (source: https://onishlab.colostate.edu/summer-statistics-workshop-2019/which_test_flowchart/).

Screenshot 2023-10-24 085158.png

Also run your ideas through chatbotGPT/google. Assumptions etc.

All the best,

caltang

The right skew will exist even after you calculate your z-scores. The z-score doesn't inherently change the shape of the distribution.

I'm pretty stumped myself - you may have to try other methodologies to cater to your non-standardized data.

Perhaps you can try standardizing the days data this way:

But is your research question: Is there a difference in days between Closed Won and other stages as you expected?

H0: No difference between Closed Won and other stages

Ha: There is a difference between Closed Won and other stages

If you do reach standardization, this article is useful: https://www.thedataschool.co.uk/liu-zhang/test-for-the-difference-in-the-mean-t-test-in-alteryx/

Quick Links

This months top contributors

atcodedog05 19458

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703