Partial Least Squares

Partial least squares regression predicts a response from many, often highly collinear predictors by projecting them onto a small set of latent components — but, unlike principal components regression, it chooses those components to maximize their covariance with the response, not just the variance of the predictors. This supervised dimension reduction makes PLS a workhorse in chemometrics, spectroscopy, and other wide-data settings where predictors vastly outnumber observations.