Agent-Based Sensitivity Analysis — Quantifying Parameter Influence in Complex Simulation Models
Also known as: ABM sensitivity analysis, ABSA, SA for ABMs, agent-based model sensitivity testing
Agent-based sensitivity analysis (ABSA) applies sensitivity analysis techniques to agent-based models (ABMs) to determine which input parameters most strongly influence emergent outputs. Because ABMs are stochastic and nonlinear, standard analytical derivatives are unavailable; ABSA uses designed simulation experiments — screening methods, variance-based indices, or regression-based surrogates — to rank parameter importance and guide model calibration and validation.
Key highlights
- Reveals which parameters drive emergent outcomes, focusing calibration and validation efforts efficiently.
- Compatible with any ABM regardless of internal structure, since only model inputs and outputs are required.
- Handles stochastic models by incorporating replication into the experimental design.
- Morris screening scales to dozens or hundreds of parameters with modest computational cost.
- Sobol indices provide a rigorous variance decomposition that decomposes total output variance into individual and interaction effects.
- Supports transparent documentation of model assumptions for peer review and policy applications.
Intuition
This section is available to Pro members. Upgrade to Pro
How it works
This section is available to Pro members. Upgrade to Pro
When to use it
Use ABSA when an agent-based model has multiple uncertain parameters and you need to know which matter most before calibration, when reviewers or stakeholders require evidence of model robustness, or when computational resources must be allocated efficiently across a large parameter space. Apply Morris screening for exploratory phases with many parameters; switch to Sobol indices when quantitative variance decomposition is needed for a smaller subset. Do NOT use ABSA as a substitute for model validation against real data; sensitivity alone cannot confirm that a model is correct. Avoid variance-based methods when individual ABM runs are extremely slow and the parameter space is very high-dimensional — surrogate emulator approaches may be needed instead.
Strengths & limitations
- Reveals which parameters drive emergent outcomes, focusing calibration and validation efforts efficiently.
- Compatible with any ABM regardless of internal structure, since only model inputs and outputs are required.
- Handles stochastic models by incorporating replication into the experimental design.
- Morris screening scales to dozens or hundreds of parameters with modest computational cost.
- Sobol indices provide a rigorous variance decomposition that decomposes total output variance into individual and interaction effects.
- Supports transparent documentation of model assumptions for peer review and policy applications.
- Variance-based Sobol indices require many model runs (thousands to tens of thousands), making them costly for slow ABMs.
- Results depend on the assumed parameter ranges and distributions; poor range specification leads to misleading importance rankings.
- Standard sensitivity indices assume output is a scalar; multivariate or time-series outputs require specialized extensions.
- Stochastic noise in ABM outputs inflates variance estimates, requiring sufficient replication to separate parameter signal from simulation noise.
- Sensitivity analysis does not identify the correct parameter values — it only ranks their influence.
Common pitfalls
This section is available to Pro members. Upgrade to Pro
Applications
This section is available to Pro members. Upgrade to Pro
Frequently asked
How many simulation runs do I need for reliable sensitivity estimates?
It depends on the method. Morris screening typically needs N × (k+1) runs, where k is the number of parameters and N is 10–50 trajectories — feasible even for slow models. Sobol variance-based indices require N × (k+2) runs with N often 500–2000 or more. Always run a convergence check by computing indices at increasing sample sizes until they stabilize.
Can I use ABSA on a model with time-series outputs rather than a single scalar?
Yes, but additional steps are required. Common approaches include computing sensitivity indices on summary statistics of the time series (mean, peak, final value), applying functional sensitivity analysis using principal components of the output trajectories, or using a surrogate model trained on the time-series data.
What is the difference between Morris screening and Sobol indices for ABMs?
Morris screening is a qualitative or semi-quantitative method that ranks parameters cheaply, making it ideal for initial screening of large parameter spaces. Sobol indices provide a full quantitative variance decomposition (first-order and total-order effects including interactions) but require far more runs. The recommended workflow is Morris first, then Sobol on the influential subset.
Does sensitivity analysis replace calibration?
No. Sensitivity analysis identifies which parameters matter and which can be fixed at nominal values; it does not tell you the correct parameter values. Calibration — matching model output to empirical data — is a separate step that should focus on the influential parameters identified by ABSA.
Is a surrogate emulator needed for computationally expensive ABMs?
For ABMs where a single run takes hours, running thousands of configurations for Sobol indices may be impractical. In such cases, a statistical surrogate (Gaussian process, polynomial chaos expansion, or random forest) trained on a limited ABM run budget can approximate the model and allow sensitivity analysis on the surrogate at negligible additional cost.
Sources
- 1.Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004). Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models. John Wiley & Sons.ISBN 9780470870938
- 2.ten Broeke, G., van Voorn, G., & Ligtenberg, A. (2016). Which Sensitivity Analysis Method Should I Use for My Agent-Based Model? Journal of Artificial Societies and Social Simulation, 19(1), 5.
You have read it. What now?
Cite this page
ScholarGate. (2026, June 3). Agent-based sensitivity analysis. ScholarGate. https://scholargate.app/simulation/agent-based-sensitivity-analysis