Error Messages when running Forest Model and Decision Tree

Hi everyone,

I get errors when running these models and do not understand the reason for the errors. Have done some searching, but the adjustments I have done thus far does not help that much. The data I use is 158MB, about 1.9mil records (1.3mil for evaluation for the models). I am training the data to determine if an order converted or not. The error messages and fields I use are as follows:

Account_categories, quote_day_of_date, geo, region, max_quoted_amount. These variable sums up the types of fields I have in the data, 3 interger types and 7 V_WString / string types. I am using a total of 10 fields and am training 2 models for each algorithm to see how the model performs on less variables and all variables.

I also share the R code I used to determine the variable importance and an image of the flow. (however I think the error is due to the error with the model):

I would appreciate any expertise advice on the errors I currently have.

Thank you!

Tips and Tricks

Predictive Analysis

Machine Learning

R Tool

Run Command

Accepted answers

All comments

CharlieS

Hi @Roche

I don't have any experience with this error, but I'll try and help troubleshoot. I would start out by testing your workflow with a small sample (maybe a random 10%?) to if there's something about the configuration is causing problem, or if it is just a capacity problem with the volume of records.

Let us know how that goes.

Roche

Hi @CharlieS

Have run the random forest models with 10% of the data and no errors. Will let you know about the other models.

Thank you!

CathyS_Slalom

Hi @Roche

The random forest algorithm can take a lot of your memory, you can check your memory limit using the syntax memory.limit() in R.

One note that R could use disk as memory, you could use memory.limit(100000) --> it will give you ~100GB of memory.

But this won't help you if you don't have that much of hard drive space.

Roche

Hi @CathyS_Slalom , thank you for your advice. If I give this command in R, how does it then become applicable within Alteryx's R code? I do think that the problem is the memory.

CathyS_Slalom

Hi @Roche, you would need to run the command in Alteryx.

1. Write your own code and run the random forest in R or Python from Developer tab

2. Modify the R from Forest_Model.yxmc

Hope this helps.

Roche

Hi, thank you. I have done so as seen in the image:

I am testing to see what the limit should be. Have used the 100 000 limit, but it yields no data, neither 25 000 or 10 000 or placing the R tool after the 'create sample' tool with limits to 7000 and 3000. If I test for the limit the forest tool gives a message "at least one predictor variable should be selected".

Not sure what I am doing wrong. Can you perhaps help me with this?

Thank you!

Rouche

Roche

Hi @CharlieS , I have been able to run 2 of the models successfully, but still struggle with the Random Forest model. At 10% it does run, but not at 50% or 40%. The other models have everything the same ito variables, data cleaning etc. I have also tried to change the memory settings in the workflow and am also using AMP engine, but it does not work.

CharlieS

Just to double check, have you tried not using the AMP engine?

Roche

Hi @CharlieS, I have run it with 50% of the data with AMP and without AMP. Have just run it again (to be sure new configurations are taken into account in the new results) and it gives the same main problem every time.

Here is the image of the R code that I used for the memory limit as well.

CharlieS

One more shot: have you tried increasing the Memory Limit setting in your System Settings? (Options > Advanced Options > System Settings > Engine > General > Memory Limit)

CathyS_Slalom

Hi @Roche - just saw your message, is the problem resolved? If not, would you mind to share your workflow with a sample of data?

Roche

Hi, I have changed the system settings to be 100000, but then there was no output from the flows and so I changed it back and instead changed the settings within the workflows with incremental steps to see if and when it will be successful. Had no success with the forest model in any setting. My manager has also sent a message to hear from Alteryx.

Other models run and I have the same variables etc for them.

Roche

Hi @CathyS_Slalom , thank you for getting back to me. No, it is not resolved yet. I will not be able to share data since it is confidential. Do not think I can attempt to create a similar scenario either. The data does run at 10% with no errors. The problem is when I try to run all 2mil rows or 50% of the data. Is there anything specific that you would want to check in the workflow e.g. settings in the forest model icon or variables? Currently it does look like a capacity problem.

Roche

The Boosted model is also giving me an error. This I see can also be a problem due to running out of memory.

CathyS_Slalom

Hi @Roche, I was thinking to see your workflow and find a place to write random forest model in Python or R directly from Alteryx, instead of using the Forrest Tool under predictive tab. Here is the link for an example random forest model in python

https://towardsdatascience.com/random-forest-in-python-24d0893d51c0

Roche

Hi @CathyS_Slalom, thank you very much! Appreciate your help. Currently I need to see if I can sort out the errors and as a last resort I will be able to do manual coding.

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15872

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703