topic Why are my 10.0 worflows slower than when run on 9.5? in Alteryx Designer Desktop Discussions

Why are my 10.0 worflows slower than when run on 9.5?

anthony — Thu, 24 May 2018 01:26:06 GMT

Hi, I downloaded 10.0 this weekend and after running a few workflows 'felt' like it was slower.

I confirmed this today by comparing a workflow in 9.5 and 10.0 - 9.5 runs in 52.2 seconds and 10 takes 2:23 Minutes.

I am basically taking a yxdb and summarizing on several fields and then writing out to 2 TDEs.

I have 2 summarize tools and 1 big join but it runs much faster on 9.5.

Anyone else notice speed difference?

Re: Why are my 10.0 worflows slower than when run on 9.5?

s_pichaipillai — Tue, 22 Sep 2015 03:19:46 GMT

Hi Anthony

are both versions running on same machine?

can you check the system settings for both

Re: Why are my 10.0 worflows slower than when run on 9.5?

anthony — Tue, 22 Sep 2015 15:34:29 GMT

Yes this is on the same machine one after another with same memory usage/availabllity/etc.

I closed and reran this monring and got similar results.

Re: Why are my 10.0 worflows slower than when run on 9.5?

TaraM — Tue, 22 Sep 2015 15:55:18 GMT

Which workflow are you running first? 9.5 or 10.0 - the data could be cached and the second runtime would be much faster. Which process takes the longest? Is it the Join or the write? If you could share your workflow we could take a closer look.

Re: Why are my 10.0 worflows slower than when run on 9.5?

anthony — Tue, 22 Sep 2015 16:12:33 GMT

I have run in various sequences and closed/opened v10 today w/o running in v9.5. Same issue. I have turned off write to TDE and it is much faster so seems like the write to TDE is the issue

I cannot share workflow because data has PII - i have seen the yxmd to customer support to see if they have any ideas.

Here is a screen grab - pretty basic workfow. I take data from a yxdb wit about 500k rows and summarize into 2 tdes

Re: Why are my 10.0 worflows slower than when run on 9.5?

RodL — Tue, 22 Sep 2015 16:35:27 GMT

Yes, I have found where performance on writing to the TDE can vary.

You won't be able to use this to compare the 9.5 to 10.0 processing, but one other thing to note is the new setting in 10.0 under 'Runtime' where you can check 'Enable Performance Profiling'. If you have this checked, it will provided a tool-by-tool analysis of how much time each tool took and the percentage of the overall process.

That will at least give you some concrete feedback in this case as to where the majority of the workflow process is spent.

Re: Why are my 10.0 worflows slower than when run on 9.5?

LauraS — Tue, 22 Sep 2015 17:50:36 GMT

Hi Anthony,

I love Rod's suggestion. Will you please let us know the results of the performance profile? We would like to understand if one tool or another is slowing down the workflow. We are not currently aware of any major issues in performance, but will definitely dig in once we get more information.

Thanks,

Laura

Re: Why are my 10.0 worflows slower than when run on 9.5?

anthony — Tue, 22 Sep 2015 17:48:22 GMT

I did this yesterday - i did not save results but TDE write took 40% of the time.

It seems like the write to tde is the issue base on watching the workflows run in each version.

Re: Why are my 10.0 worflows slower than when run on 9.5?

LauraS — Tue, 22 Sep 2015 17:50:24 GMT

Thanks Anthony! We will do some digging. Stay tuned!

Re: Why are my 10.0 worflows slower than when run on 9.5?

JCR — Tue, 22 Sep 2015 18:31:17 GMT

Anthony,

We haven't changed the .tde generation in v10. Thanks for the feedback, we're going to benchmark the two versions and see if there is a side effect from some other changes.

Can you give me an idea of how big your esulting .tde is and what data types are involved in the dataset? that would help us make sure we don't miss anything in the test scenario.

Thanks

Re: Why are my 10.0 worflows slower than when run on 9.5?

anthony — Tue, 22 Sep 2015 18:38:05 GMT

attached are 2 selects going into tdes... i had to change to xml as select save format is not valid for post i guess

shipping tde is 7.9 megs

sales tde is 17.5 megs

Re: Why are my 10.0 worflows slower than when run on 9.5?

anthony — Tue, 29 Sep 2015 17:52:11 GMT

Figured out that user/system settings where both set to override default caused issue.

Now running at same speeds.

Turned off system override and it is fine.