Probability Fundamentals

Probability fundamentals are the basic rules that govern how likelihoods of events combine and how random variables are described. They define what a probability is, how to add and multiply probabilities of events, and how to summarise a random quantity by its distribution, expectation, and variance — the building blocks every later statistical method depends on.

Definition

Probability is a number between 0 and 1 assigned to an event to express how likely it is to occur, obeying the axioms of non-negativity, total probability one over the sample space, and additivity for mutually exclusive events.

Scope

The entry covers the sample space, events, the probability axioms, the addition and multiplication rules, complementary events, and the concept of a random variable with its expectation and variance. It introduces the distinction between discrete and continuous random variables. It treats probability as a methodological foundation and does not give clinical recommendations.

Core questions

• What is a sample space and what counts as an event?
• How do probabilities of combined events add or multiply?
• What is a random variable and how is its distribution summarised?
• How are expectation and variance defined and interpreted?

Key concepts

• Sample space
• Event
• Probability axioms
• Addition rule
• Multiplication rule
• Complementary event
• Random variable
• Expectation (mean)
• Variance and standard deviation

Mechanisms

The sample space lists all possible outcomes of a random process, and an event is a subset of it. Kolmogorov's axioms require that every event has a non-negative probability, that the whole sample space has probability one, and that the probability of a union of mutually exclusive events is the sum of their probabilities. From these follow the complement rule (the probability of an event not occurring is one minus its probability), the general addition rule for the union of two events, and the multiplication rule for joint occurrence. A random variable assigns a number to each outcome; its expectation is the probability-weighted average of those numbers, and its variance measures their spread around the expectation. These definitions apply to discrete variables, whose values can be listed, and continuous variables, described by a density.

Clinical relevance

The rules of probability govern how uncertainties about diagnoses, risks, and test results combine, so a working grasp of them supports interpretation of quantitative evidence in the health sciences. This entry is methodological background and does not direct individual clinical decisions.

History

Early probability arose from seventeenth-century correspondence on games of chance and was systematised by Bernoulli and Laplace. The modern axiomatic foundation, which defines probability as a measure on a sample space, was set out by Andrey Kolmogorov in 1933, unifying the field and providing the rigorous basis used in statistics today.

Key figures

• Andrey Kolmogorov
• Pierre-Simon Laplace
• Jacob Bernoulli

Seminal works

• kolmogorov-1956
• ross-2014
• rosner-2015

Frequently asked questions

What does it mean for two events to be mutually exclusive?

Two events are mutually exclusive if they cannot both occur at once; for such events the probability that either occurs is simply the sum of their individual probabilities.

What is the difference between expectation and variance?

Expectation is the long-run average value of a random variable, while variance measures how widely its values spread around that average; the square root of the variance is the standard deviation.