Limit Data

[mjtowne]

Hi,

Is there a way to limit your data set without hard coding this in the initial SQL.I have a table that contains 500 million records but by using the filter tool alteryx loads the initial 500mil first before doing the filter after. is there a way to do the filtering form the intial data pull.

Thanks

Martin

[jdunkerley79]

Thats what the In-DB tools are for.

They run all the filters server side until you bring into your tool.

Take a look at:

http://community.alteryx.com/t5/Alteryx-Knowledge-Base/In-Database-Processing-FAQ/ta-p/1141

And @Ned post on the project: https://inspiringingenuity.net/2014/08/13/alteryx-project-lock-in/

[RodL]

And if you are wanting to do this just to limit records during development work, keep in mind there is a "Record Limit" option in the Input tool configuration.

[mjtowne · Accepted solution]

Hi,

I have worked out that by using the Dynamic Input tool i can change a string in my where clause to replace the values to limit the data set.

I have combined this with a macro so that the user can select what values they need in the where clause.

Thanks

Martin

[Gina2021]

Thanks @RodL ! That was the simple answer I was hoping for!