community
cancel
Showing results for 
Search instead for 
Did you mean: 

Alteryx designer Discussions

Find answers, ask questions, and share expertise about Alteryx Designer.

Co-occurence for Large Datasets

Meteor

Hi,

 

I am trying to look at co-occurrence over a large sales data set. I want to know what products are purchased with other products.

 

I have tried using MB-Affinity but it crashes out at around 5,000 records. I have 19,440 unique articles and 2,928,930 transactions in my data set.

  

Any ideas how to get around this?

 

Thanks In Advance!

Scott

 

 

 

Alteryx
Alteryx

Hi @slinky123,

 

The Market Basket tools run in R which works in-memory. Moving this process to a machine with more available RAM will allow you to run the process on larger datasets (i.e. running your workflow on the Alteryx Server). 

 

If Alteryx Server or a desktop with more RAM is not available to you, could you break your data smaller time frames (i.e. run the tool set for each month, for each week, etc)?

 

Thanks!

 

Amelia

Meteor

@AmeliaG, thanks for the response.

 

I am running the process on a server with 128GB RAM and it still doesn't run past a few thousand unique articles.

 

Is there any other way around this that anyone has come up with? i.e. not using the MB tools?

 

Labels