Agent-Based Markov Model — Hybrid Simulation with Autonomous Agents and Markov State Transitions

The Agent-Based Markov Model (ABMM) is a hybrid simulation framework that embeds Markov chain state-transition logic inside individual autonomous agents. Each agent independently samples its next state from a probability transition matrix, enabling the model to capture both micro-level heterogeneity across agents and the tractable probabilistic structure of Markov chains. The approach is widely used in health economics, epidemiology, social science, and operations research.