Logistic Regression
Binary Logistic Regression · Also known as: logit model, binomial logistic regression, LR
Logistic regression is a statistical method for modeling the probability of a binary outcome (disease present/absent, success/failure) as a function of continuous and categorical predictors. Developed by David Roxbee Cox (1958), it solves the problem of predicting categorical outcomes by applying a logistic transformation to constrain predictions to the [0,1] probability interval, enabling accurate risk stratification, diagnostic prediction, and causal inference in epidemiology, medicine, and social science.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
+82 more
When to use it
Use logistic regression when predicting or explaining a binary outcome. Clinical applications: predicting disease diagnosis, treatment response, mortality; calculating risk scores (e.g., APACHE score, CURB-65 pneumonia severity). Epidemiological studies: estimating odds of disease associated with exposures while adjusting confounders. Diagnostic accuracy: validating a diagnostic test (predict disease from clinical findings). Survey research: modeling yes/no responses to policy questions. For continuous or polytomous (>2 category) outcomes, use linear or multinomial regression. For survival data (time-to-event), use Cox regression.
Strengths & limitations
- Directly estimates probability of outcome, enabling risk stratification and informed decision-making in clinical and policy contexts.
- Odds ratios are intuitive for practitioners: a dichotomous measure of association easily communicated to clinicians and public.
- Robust to violation of normality (unlike linear regression); only requires that conditional distributions are binomial, not normal.
- Flexibly incorporates continuous and categorical predictors, interactions, and nonlinear terms (e.g., polynomial, spline) to capture complex relationships.
- Probabilistic output and ROC curves enable threshold optimization: choose classification cutoff based on sensitivity/specificity tradeoff suited to application context.
- Sensitive to multicollinearity: highly correlated predictors produce inflated standard errors and unstable coefficient estimates; check variance inflation factors.
- Assumes linear relationship between log-odds and predictors; misses nonlinear associations unless explicitly modeled (e.g., polynomial, spline transformation).
- Imbalanced outcomes (rare events): if outcome proportion is extreme (e.g., 5% positive), parameter estimates are biased and confidence intervals wide; consider penalized regression or case-control sampling.
- Assumes independence of observations; clustered data (e.g., patients in hospitals) violates assumption and requires multilevel logistic regression.
- Classification performance depends heavily on chosen probability cutoff; different thresholds optimize sensitivity vs specificity, and no single cutoff suits all contexts.
Frequently asked
How do I interpret an odds ratio of 2.5 with 95% CI [1.8, 3.5]?
An OR of 2.5 means the odds of the outcome are 2.5 times higher for a 1-unit increase in that predictor (or for the indexed category vs reference, if categorical), adjusting for other predictors. The 95% confidence interval [1.8, 3.5] indicates that with 95% confidence, the true population OR falls between 1.8 and 3.5. Because the CI excludes 1, the association is statistically significant (p < 0.05). Magnitude interpretation: OR 1–1.5 = small effect, 1.5–3 = moderate, >3 = large. Clinicians often ask: is 2.5× higher odds clinically meaningful for this outcome? Context matters.
What does the Hosmer-Lemeshow test tell me, and when should I worry about a low p-value?
The Hosmer-Lemeshow test assesses whether predicted probabilities match observed outcome proportions across risk deciles. p > 0.05 suggests good calibration; p < 0.05 suggests the model mispredicts in some risk groups, indicating potential misspecification. A low p-value prompts investigation: examine decile-wise calibration plots, check for nonlinear relationships not captured, explore interactions, or investigate outliers. However, with very large samples, even trivial departures from perfect calibration can yield low p-values; visual inspection of calibration plots is often more informative than the test alone.
How do I choose a probability cutoff for classifying individuals as at-risk or not?
The choice depends on the clinical or policy context and the cost of false positives vs false negatives. ROC curve plots sensitivity (true positive rate) vs 1-specificity (false positive rate) across all probability thresholds. A cutoff of 0.5 is default but rarely optimal. If missing positive cases is costly (e.g., missing cancer diagnosis), choose lower cutoff (higher sensitivity). If false alarms are costly (e.g., unnecessary interventions), choose higher cutoff (higher specificity). Use Youden index (sensitivity + specificity − 1) or examine positive predictive value (PPV) and negative predictive value (NPV) in your population to decide.
How does logistic regression differ from linear regression for predicting binary outcomes?
Linear regression applied to binary outcomes produces predicted values outside [0, 1], violates normality assumption, and produces heteroscedastic residuals. Logistic regression constrains predictions to probabilities via the logistic transformation, assumes binomial conditional distribution, and produces homoscedastic residuals. Moreover, standard errors from linear regression are biased; logistic regression uses maximum likelihood, which yields correct inference for binary data. Logistic is specifically designed for binary outcomes and should always be preferred; linear regression on binary outcomes is a common mistake.
Sources
- Cox, D. R. (1958). The regression analysis of binary sequences. Journal of the Royal Statistical Society, Series B, 20(2), 215–242. DOI: 10.1111/j.2517-6161.1958.tb00292.x ↗
- Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied Logistic Regression (3rd ed.). John Wiley & Sons. DOI: 10.1002/9781118548387 ↗
How to cite this page
ScholarGate. (2026, June 4). Binary Logistic Regression. ScholarGate. https://scholargate.app/en/research-statistics/logistic-regression
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Multiple Regression AnalysisResearch Statistics↔ compare
- Propensity Score MatchingResearch Statistics↔ compare
- Survival AnalysisResearch Statistics↔ compare