Logistic Regression tool - Improving a model

Hello!

I'm trying to use the logistic regression tool to create a predictive model with my dataset, but it doesn't seem to be so precise and accurate as I expected (as the exit 'I' from the tool shows).

How could I improve my model or configure it to have the best performance according to my dataset? Do I need to change my data, or do something different from it?

I'm attaching my workflow in this post.

Thank you!

Felipe

Base de dados 'Produção Geral'.xlsx

Base de dados 'Requisição Extra' - Pós Alteryx.xlsx

Workflow - test.yxmd

Workflow

Predictive Analysis

Accepted answers

AngelosPachis

Hi @FelipeSS ,

One thing I can suggest is that you may have to split your dataset into two samples, one used to train your model (Estimation, ~80%) and one to make predictions (Validation sample, ~20%).

The reason you may want to think to implement this, is because otherwise your model will be biased, as seemingly it would make more accurate predictions than it actually can. The issue with that would become clearer if you apply the same model on a different dataset that your model has never "seen" before; chances are you accuracy to be quite low there.

I will revert with more comments hopefully, but this is a key thing you should take into consideration.

Cheers,

Angelos

All comments

AngelosPachis

Hi @FelipeSS ,

One thing I can suggest is that you may have to split your dataset into two samples, one used to train your model (Estimation, ~80%) and one to make predictions (Validation sample, ~20%).

I will revert with more comments hopefully, but this is a key thing you should take into consideration.

Cheers,

Angelos

mceleavey

Hi @FelipeSS ,

I've added some extra steps to your model and increased the accuracy by around 6%.

The main step is to introduce One-Hot Encoding to binarise your categorical variables. I built a tool to do this for you which I've attached.

Second, I introduced the positive value for your target variable.

Third, I randomly sampled your dataset to introduce a train and test stream.

I hope this helps.

One-Hot Encoder.yxmc

Workflow - test_mceleavey.yxmd

danilang

Hi @FelipeSS

Another thing to consider is that your data might not be a good fit for a logistical regression. Try the other models and score them to see what your best fit is.

Dan

FelipeSS

Thank you, @mceleavey!

FelipeSS

Thank you, @danilang, for your answer! Do I need to select a numeric field in my 'predictor variables'? Or can I use categorical (String fields) too?

FelipeSS

Thank you, @AngelosPachis! I will consider it and see how it works here.

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15878

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703