Creating Subsets

So I am tasked with creating subsets for my data. We have a couple hundred columns. So it is basically Create subset "Hypertension" is variable Clinic01 == 1 but there are many different subsets I have to create. In my head, I imagine that I can get there by creating a bunch of Filter Tools, but I have about a hundred subsets to create, so i was wondering if there exist a faster and more efficent way to create subsets. I have lookedbut have been unable to find them. Thank you.

Preparation

Accepted answers

jdunkerley79

Ok so here is a first go.

I take the data and transpose it so looks like:

Filter this where the value is 1. I am working with a numeric field but this can be changed to cope as needed.

After that I join to a table mapping clinic to subset name

This gives a set of subsets each case belongs to

Next join back to the original data to add a subset field and duplicate the rows for those cases in multiple subsets

Finally as @MarqueeCrew mentioned use an Output tool to save to a set of files append the subset name to the file name to create a set of files one for each subset

Sample attached with some fake data. Will Write to C:\Temp when run

Subset Save.yxmd

All comments

MarqueeCrew

Robert,

If you are outputting the subsets, you can take name from a field and append it to the filename. You can keep the field in the data and create hundreds of output files from just a single output tool.

Thanks,

Mark