Robust Logistic Regression
Robust Logistic Regression (Mallows-Type Weighted Estimation) · Also known as: robust binary regression, weighted logistic regression, Mallows-type logistic regression, Robust Lojistik Regresyon
Robust Logistic Regression is a variant of logistic regression that is resistant to outliers and leverage points, fitting a binary or categorical outcome with Mallows-type weighted estimation. The robust framework for generalized linear models was developed by Cantoni and Ronchetti (2001), with a weighting approach later refined by Bondell (2008).
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use robust logistic regression when the outcome is binary or categorical and you suspect outliers or leverage points that would distort an ordinary logistic fit. It needs a reasonable sample size (at least about 50 observations) for the weighting to behave well. It is a strong choice for classification and prediction tasks on cross-sectional or longitudinal data where data quality is a concern.
Strengths & limitations
- Resistant to outliers and leverage points that would bias ordinary maximum-likelihood logistic regression.
- Down-weights, rather than discards, suspect observations through Mallows-type weights, retaining information from the full sample.
- Supports robust inference for generalized linear models, giving more trustworthy coefficients and standard errors under contamination.
- Requires a moderate sample size (about 50 or more); in small samples it can suffer convergence problems and classical logistic regression is preferable.
- When strong leverage points are present, Mallows-type weights may be insufficient and a bounded-influence (MM-type) estimator is needed instead.
- More complex to fit and interpret than ordinary logistic regression, and not available out of the box in every statistics package.
Frequently asked
How does robust logistic regression differ from ordinary logistic regression?
Both use the same logistic link and linear log-odds. The difference is in estimation: ordinary logistic regression maximises the likelihood and lets every observation count equally, while the robust version solves a weighted estimating equation that down-weights leverage points and bounds the influence of large residuals.
What are Mallows-type weights?
They are weights that depend on each observation's position in the predictor space, shrinking the contribution of points with high leverage. Combined with a bounded score function on the residuals, they keep any single unusual case from dominating the estimated coefficients.
When should I switch to an MM-estimator instead?
When strong leverage points remain influential even after Mallows weighting, the bounded-influence guarantee of a Mallows-type weight can be insufficient. A high-breakdown MM-type estimator gives a more resistant fit in that situation.
Is it safe to use on small samples?
Not really. Below roughly 50 observations the weighting and convergence become unreliable, and under about 30 the method may not converge at all. For small samples, classical logistic regression is the safer default.
Sources
- Cantoni, E. & Ronchetti, E. (2001). Robust Inference for Generalized Linear Models. Journal of the American Statistical Association, 96(455), 1022-1030. DOI: 10.1198/016214501753209004 ↗
- Bondell, H. D. (2008). Robust Logistic Regression Using a Weighting Approach. Biometrics, 64(2), 421-427. link ↗
How to cite this page
ScholarGate. (2026, June 1). Robust Logistic Regression (Mallows-Type Weighted Estimation). ScholarGate. https://scholargate.app/en/statistics/robust-logistic-regression
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Logistic RegressionResearch Statistics↔ compare
- MM-EstimatorStatistics↔ compare
- OLS RegressionEconometrics↔ compare
- Quantile RegressionEconometrics↔ compare
- Robust Time Series AnalysisStatistics↔ compare