Modeling and evaluation

Now we'll discuss various aspects of modeling and assessment. In both the KNN and SVM cases, we'll do feature selection using a technique known as Recursive Feature Elimination (RFE) in conjunction with cross-validation. As with all feature reduction and selection, this will help to prevent overfitting the model.