Hi All,
I have the same problem as in this question:
Basically need to split data into multiple streams based on the values in a column. Question: Is there a way to do this without dumping the data into an intermediate set of files?
Thanks
I believe you are looking for the Filter Tool. Would there be any dynamic reasons where a filter would not work?
Thx,
Hi TonyM,
The column I'm splitting on can have many different values which are not always present and I'm not 100% positive of the "universe" of values that may appear. A "filter chain" in this case would be very cumbersome to set up and error prone.
Thnx
Hey @dmitry_berman! I'm not sure what the magnitude of "many" is in your case, but several filters is the only thing that I can think of that might work here to get multiple streams of data. Since you don't know what the actual values will be, though, you could use a Summarize tool to GroupBy the field the values are coming from, add a RecordID, then some filters based on RecordID =1, 2, 3, etc. This should eliminate your 'error prone' issue from your previously reply, but maybe not the cumbersome part.
You can also try this Macro in the Gallery by @Bruttan1:
https://gallery.alteryx.com/#!app/Multi-Output-Filter/599574a1a18e9e1298d2ac94
Hi @dmitry_berman,
You can do some configuration in the output tool as given below, It will create files by grouping your desired column values. You will get as many files as distinct values exists in that field.
Depending on how many values you expect, this is simpler than a batch macro. I had a similar issue and just summarized by the values in the field in question, assigned a record ID to them, and then did filters by the record ID. If you had a relatively small amount of values per run, even if the values differed day to day, you could capture them all this way.
User | Count |
---|---|
19 | |
14 | |
13 | |
9 | |
8 |