In deep learning, architecture engineering is the new feature engineering June 11, 2016 Two of the most important aspects of machine learning models are feature extraction and feature engineering. Those features are what supply relevant information to the machine learning models. Representing the word overfitting using various feature representations: Morphological = [(prefix, over-), (root, fit),