Supervised learning: predicting an output variable from high-dimensional observations

Supervised learning: predicting an output variable from high-dimensional observations# Nearest neighbor and the curse of dimensionality# k-Nearest neighbors classifier# The simplest possible classifier is the nearest neighbor: given a new observation X_test, find in the training set (i.e. the data used to train the estimator) the observation with the closest feature vector. (Please see the Nearest