Alteryx workflow - Memory limit

Hi guys,

Have a question regarding memory limit of Alteryx workflow and would have some wise advice from our community,

Basically, every time we run a workflow, Alteryx will assign a fixed space in memory for it. If size of the extract surpasses that memory limit, it’ll stop.

I tried to increase this limit to 12GB via User Settings, but the limit still got stuck around 4GB and can't go higher.

Any idea how I can really push the size up to 12GB or any workaround when working with workflow with heavy nodes?

Many thanks!

Output

Machine Learning

Accepted answers

RobertOdera

Hi, @DustinNg

1. Try using the Auto Field tool - it will significantly reduce your workflow size

2. Try using the Select Tool in your process so as to limit columns to only those that you need as your move along your process

3. How much RAM does your computer have? Settings don't matter if you do not have sufficient RAM

4. Try breaking down your process into multiple flows i.e. flows that process the parts + one main flow that combines the outputs of the parts into one output

5. If possible i.e. if you have Alteryx Server or permissions to run In-DB flows try that to leverage the Server/DB resources versus your desktop/laptop

6. Try limiting the use of joins or replacing memory-heavy tools such as Unique with Sample or using the Formula Tool to TRIM versus Data Cleanse

You will get more insight from the community, but I hope this helps you. Cheers!

All comments

RobertOdera

Hi, @DustinNg

1. Try using the Auto Field tool - it will significantly reduce your workflow size

2. Try using the Select Tool in your process so as to limit columns to only those that you need as your move along your process

3. How much RAM does your computer have? Settings don't matter if you do not have sufficient RAM

4. Try breaking down your process into multiple flows i.e. flows that process the parts + one main flow that combines the outputs of the parts into one output

5. If possible i.e. if you have Alteryx Server or permissions to run In-DB flows try that to leverage the Server/DB resources versus your desktop/laptop

6. Try limiting the use of joins or replacing memory-heavy tools such as Unique with Sample or using the Formula Tool to TRIM versus Data Cleanse

You will get more insight from the community, but I hope this helps you. Cheers!

DustinNg

Great! Thanks so much Robert!

Alteryx community is always da best

RobertOdera

You're most welcome @DustinNg!

apaul

Hi everyone,

I use a developer laptop for work, so computer should not really ever be a problem for me (may be wrong here - 32GB RAM).

I have brought a new input file into a reasonably large workflow and instantly got this error message. I then turned off all of my analytical containers and all of my containers holding my mapping files. So the only tools left to run in this work flow are the input file and select tool I leave attached.

I am still getting this error message despite turning all of these containers off and despite the fact I only have two tools supposedly running in this workflow now.

I have had this error message before for similar things in the past but they always seemed to correct themselves.

Any help is greatly appreciated,

Alex

Memory limit reached.png

AlexApolloni

We've encoutered this and the problem was parts of the workflow being corrupted.

(IE, through trial and error, we deleted and re-added tools and the memory error went away. )

Just FYI since a lot of the questions for this issue point to this thread.

HannahBrauer223

I've had this error a few times on workflows and it always is so random. Usually, I can just close and re-open Alteryx and the problem is fixed!

Quick Links

This months top contributors

AkimasaKajitani 389

mceleavey 388

mbarone 337

michael_weaver 335

Hollingsworth 335