Limit Data

Hi,

Is there a way to limit your data set without hard coding this in the initial SQL.I have a table that contains 500 million records but by using the filter tool alteryx loads the initial 500mil first before doing the filter after. is there a way to do the filtering form the intial data pull.

Thanks

Martin

Best Practices

Preparation

Accepted answers

mjtowne

Hi,

I have worked out that by using the Dynamic Input tool i can change a string in my where clause to replace the values to limit the data set.

I have combined this with a macro so that the user can select what values they need in the where clause.

Thanks

Martin

All comments

jdunkerley79

Thats what the In-DB tools are for.

They run all the filters server side until you bring into your tool.

Take a look at:

http://community.alteryx.com/t5/Alteryx-Knowledge-Base/In-Database-Processing-FAQ/ta-p/1141

And @Ned post on the project: https://inspiringingenuity.net/2014/08/13/alteryx-project-lock-in/

RodL

And if you are wanting to do this just to limit records during development work, keep in mind there is a "Record Limit" option in the Input tool configuration.

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703