Computer crashing - dataset too large?

Question

Hello!

I am connecting to a database, doing a little manipulation, and then streaming out a dataset to run a multi-row formula tool.

My dataset has 7 columns and at least a billion rows.

My workflow runs for several hours having completed all the in-database manipulation but never gets past the data stream out tool, and then my computer crashes. This has happened twice.

I can get you specks on my computer, the exact number of rows, etc. but I am wondering if someone knows exactly how much data you can put through Alteryx.

Thanks!

AlteryxUserFL · Accepted Answer

There is no row limit for Alteryx software and it is not uncommon to process over a billion rows of data in my experience. My guess is that the issue is likely your computer or the database. I would highly recommend using Alteryx Server for your use case as well to make things run faster.  Also, I would check into any network issues on the database side and on your computer side. A slow internet connection or a VPN will make pulling that many records from a database take a very long time.  I'm surprised the in DB part is taking so long as the workload for those tools is handed by the database, I would check into the database settings to see if anything is wrong there as well.