Speeding Up Consumer View macro?

[Alayna]

Hi - for those with the US Business Insights data package, are there any insights on how to efficiently use the consumer view macro? We are attempting to match 20 million rows fo customer names, phones, and addresses to demographics. Even trying the first 500k rows is taking 3+ hours. Now I do push it through cass so I know that's probably adding time, along with the 3 matching processes. Our data is also from a network install, so I'm guessing read/write speed from the network is affecting it.

If I tried to reinstall the data on my PC drive, could it possibly speed things up? Or maybe a simpler way using calgary joins? I just received the license a few weeks ago so I'm still learning the ropes. 

[alexnajm]

I would turn on Performance Profiling on your workflow (under the runtime settings) and run it on a subset of data to see which tool is the bottleneck! 

Otherwise it's likely a memory thing where your computer needs more memory to process faster. Also do you have AMP Engine turned on?

[Alayna]

Hi @alexnajm thank you for the reply! i do see it's our customer input and the macro itself taking the longest. I think it could be our network speed being too slow - but if it's a memory issue do you think increasing Alteryx's max memory could help?

for some reason the AMP engine leads to random "bugs" but it the workflow runs fine with it off.

[alexnajm]

Network speed will be hard to overcome, unless you can move the files off the network... increasing the memory could help otherwise.

Turn on AMP Engine AND Engine Compatibility mode then and see if you get the same bugs!

[Alayna]

I ended up reinstalling the data package to my harddrive and now it runs in less than hour. But thank you for replying!

[alexnajm]

Exactly - definitely the network then 😊