Alteryx First N% Rows (e.g. 80%) coming up as "undefined 80%"

Question

I am trying to prep my data to split it into my test and training data (Split 80/20). I have selected the First N% of rows function, and input a value of N=80, however on my workflow diagram it is displaying an "undefined 80%" label. I have been trying to find out what the issue is, but have not been successful. Please help.

Screenshot 2021-08-13 205058.png

danilang · Answer

Hi @LinoLam99

In any data analysis work, you have 2 phases, 1) developing the model.  2) Validating the model.  When developing the model you need 2 distinct datasets, one to train the model and the other to test it.  You iterate developing and refining the model using the same training and testing datasets in each iteration.  Once your model is a refined as required, you then validate it using the holdout dataset to validate it.  Using the holdout dataset as a final validation is a check against biases introduced by the process that created the  three datasets.  There is always a small chance that the random process of partitioning your data into the three groups has not sampled from all the independent variables evenly.

In order to ensure that the training, testing and holdout datasets don't change throughout your development stage, you should have a separate workflow that partitions the data into three identified tables.  From then on use these three tables as the input to your development and validation workflows.

Dan

apathetichell · Answer

Records that are neither in the testing nor training data. Used on larger datasets. Worth mentioning that your original strategy would not have worked. If you select 80% and then 20% for training and testing respectively they need to come from the same seed - or you your second selection should (statistically speaking) be 80% (16/20)  repeated with your earlier data. That's not what you want. sample tool that you used doesn't allow for seed setting so that's not going to give you what you want. Random % Sample COULD with a join be used to divided up a set but I'd recommend just using create samples - or as I do it hard code it in R.

phottovy · Answer

@apathetichell  I edited my post to recommend the "Create Samples" tool a couple minutes after posting my initial response but good catch from my explanation.