Alteryx designer Discussions

Find answers, ask questions, and share expertise about Alteryx Designer.
Alteryx is here to help you solve your biggest data challenges. Read about the new Virtual Solution Center here.

Changing Field headings & Sum calculations - is it Quicker In-DB or during Workflow?

Highlighted
8 - Asteroid

I am doing a large number of calculations (basic sum of Revenue).

I want to find the fastest way to do this as there are 50 million rows of data to process.

 

Will this be quicker inside the IN-DB tool or during the actual workflow (after the Data Stream Out tool)?  So stream out all data and do a Summarise tool after that.

 

Same with renaming Field Headings - will this be quicker IN-DB or during the workflow?

 

 

Any hints / tips would be appreciated.

 

Many thanks,

Alteryx Certified Partner
Alteryx Certified Partner

Hi @rmwillis1973 

 

Most of the times operations are quicker using In-DB, because you're processing everything in your database, which probably has good hardware resources and optimizes your queries.

 

I'm not sure what you're planning to do, but I would recommend doing all the aggregations you need using In-DB. This way you reduce the number of records, and then working them out in Alteryx using the Data Stream Out tool is much easier. 

 

Cheers,

Labels