Possible to use a file as a "not in" filter?

[jensroy]

Hi,

I am wondering if it is possible to use fields in one file as a filter for fields in another file. I have a list of 50 values that I want to filter out of a file that has X million rows. Currently I am using the "Right-side" output of a join, but I hope to find a faster way. The sample workflow attached has 500 rows of data.

Any ideas on how to optimize this would be very appreciated!

[jdunkerley79 · Accepted solution]

Try a  Find and Replace appending a column of the blacklisted SKU. You can then filter when null.

Running the original join it takes ~34ms on my PC (according to profiling)

Using a find and replace and then a filter is about ~7ms.

[jensroy]

Thanks a lot, that worked like a charm.

Also, congratulations on winning the Grand prix Mr. Community! :D

[jdunkerley79]

hehe. Thanks.