Nonlinear Programming
Also known as: NLP optimization, Constrained nonlinear optimization, Smooth optimization, Doğrusal olmayan programlama
Nonlinear programming (NLP) is a branch of mathematical optimization concerned with problems in which the objective function or at least one constraint is nonlinear. Formalized comprehensively by Jorge Nocedal and Stephen Wright in their seminal 2006 text, NLP encompasses gradient-based algorithms — including sequential quadratic programming (SQP), interior-point methods, and quasi-Newton approaches — for finding locally or globally optimal solutions to continuous decision problems arising across engineering, economics, and the physical sciences.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use nonlinear programming when the objective or constraints cannot be linearized without material loss of accuracy and the decision variables are continuous. Typical settings include engineering design with physical law constraints, portfolio optimization with nonlinear risk measures, and regression with nonlinear model forms. Key assumptions are that f and c are at least twice continuously differentiable (for gradient-based solvers) and that constraint qualifications hold. When variables are integer-valued, mixed-integer nonlinear programming (MINLP) extensions apply. For convex problems, interior-point methods guarantee global optimality; for non-convex problems, only local guarantees exist.
Strengths & limitations
- Handles a wide class of real-world problems where linear or quadratic approximations are insufficient.
- Mature algorithmic theory with well-studied convergence guarantees for convex instances.
- Efficient gradient-based solvers (SQP, interior-point) scale to thousands of variables in practice.
- Unified Lagrangian framework accommodates mixed equality and inequality constraints naturally.
- Non-convex problems offer only local optimality guarantees; global solutions require additional global search strategies.
- Requires objective and constraints to be smooth (at least differentiable); non-smooth problems need specialized subdifferential methods.
- Computational cost grows substantially with problem size when exact Hessian evaluation is required.
- Constraint qualifications may fail (e.g., at degenerate feasible points), causing KKT conditions to lose their theoretical grounding.
Frequently asked
Is every linear program also a nonlinear program?
Yes. Linear programming is a special case of NLP where both the objective and all constraints are affine. However, LP admits the simplex and interior-point algorithms that exploit linearity and are far more efficient than general NLP solvers; using a general NLP solver for an LP is wasteful but mathematically valid.
When can I trust that a KKT point is a global minimum?
When the NLP is convex — meaning f is convex and the feasible set is a convex set — any KKT point is a global minimum. For non-convex problems this guarantee does not hold, and a KKT point is only a local minimum (under second-order sufficiency conditions). Global optimization methods such as branch-and-bound or convex relaxations are needed otherwise.
What is the difference between SQP and interior-point methods?
SQP iteratively solves quadratic programming subproblems that approximate the NLP locally and is often preferred for small-to-medium problems with many active constraints. Interior-point (barrier) methods stay strictly inside the feasible region and tend to scale better for large sparse problems. Both converge superlinearly under appropriate regularity conditions.
Sources
- Nocedal, J., & Wright, S. J. (2006). Numerical Optimization (2nd ed.). Springer. ISBN: 978-0-387-30303-1
How to cite this page
ScholarGate. (2026, June 2). Nonlinear Programming. ScholarGate. https://scholargate.app/en/optimization/nonlinear-programming
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Convex OptimizationOptimization↔ compare
- Dynamic ProgrammingOptimization↔ compare
- Stochastic OptimizationOptimization↔ compare