Alteryx workflow - Memory limit
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi guys,
Have a question regarding memory limit of Alteryx workflow and would have some wise advice from our community,
Basically, every time we run a workflow, Alteryx will assign a fixed space in memory for it. If size of the extract surpasses that memory limit, it’ll stop.
I tried to increase this limit to 12GB via User Settings, but the limit still got stuck around 4GB and can't go higher.
Any idea how I can really push the size up to 12GB or any workaround when working with workflow with heavy nodes?
Many thanks!
Solved! Go to Solution.
- Labels:
- Machine Learning
- Output
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi, @DustinNg
1. Try using the Auto Field tool - it will significantly reduce your workflow size
2. Try using the Select Tool in your process so as to limit columns to only those that you need as your move along your process
3. How much RAM does your computer have? Settings don't matter if you do not have sufficient RAM
4. Try breaking down your process into multiple flows i.e. flows that process the parts + one main flow that combines the outputs of the parts into one output
5. If possible i.e. if you have Alteryx Server or permissions to run In-DB flows try that to leverage the Server/DB resources versus your desktop/laptop
6. Try limiting the use of joins or replacing memory-heavy tools such as Unique with Sample or using the Formula Tool to TRIM versus Data Cleanse
You will get more insight from the community, but I hope this helps you. Cheers!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Great! Thanks so much Robert!
Alteryx community is always da best
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
You're most welcome @DustinNg!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi everyone,
I use a developer laptop for work, so computer should not really ever be a problem for me (may be wrong here - 32GB RAM).
I have brought a new input file into a reasonably large workflow and instantly got this error message. I then turned off all of my analytical containers and all of my containers holding my mapping files. So the only tools left to run in this work flow are the input file and select tool I leave attached.
I am still getting this error message despite turning all of these containers off and despite the fact I only have two tools supposedly running in this workflow now.
I have had this error message before for similar things in the past but they always seemed to correct themselves.
Any help is greatly appreciated,
Alex
