The Model Comparison macro compares the performance of one or more different predictive models based on the use of a validation (or test) data set. It generates a report, a table of basic error measurements, and a table of prediction results for each model. The macro supports all binary classification (the case where the target variable has only two levels, or classes, such as "Yes" and "No"); multinomial classification (the case where the target variable has more than two levels or classes, such as "car", "bus", "train", and "airplane"); and regression (continuous target variable) models. The measures reported differ based on the type of models being compared.
To use this macro, an additional R package (ROCR) needs to be installed. The link below provides instructions on how to install R packages that can be accessed by Alteryx. The macro will attempt to install the needed R packages if they are not already installed, but this may be prevented by certain firewalls and proxy servers.
Using additional R packages