Foundations of Probability
Probability Foundations
The Language of Chance
Probability starts with a clear framework. An experiment is any process with an uncertain result, like rolling a die. Each possible result is an outcome. The set of all possible outcomes is the sample space, which we usually call . For a single six-sided die, the sample space is simple and finite: .
An event is just a specific outcome or a set of outcomes we're interested in. In set theory terms, an event is any subset of the sample space. For our die roll, an event could be simple, like rolling a 5. Or it could be more complex, like rolling an even number. The event of rolling an even number, let's call it , would be the subset .
Every event is a specific collection of outcomes from the sample space.
Since events are sets, we can use set operations to combine or modify them. This is how we handle more complex scenarios.
- Union (A ∪ B): This is event A or event B (or both) happening. If is rolling an even number and is rolling a number greater than 4 (), then .
- Intersection (A ∩ B): This is event A and event B happening. Using the same events, . It's the outcome that satisfies both conditions.
- Complement (A'): This is event A not happening. The complement of rolling an even number is rolling an odd number: .
The Rules of the Game
To move from sets to actual probabilities, we need a few ground rules. These are the axioms of probability—fundamental truths that we accept without proof. They ensure that our calculations are consistent and logical. All of probability theory is built on these three simple ideas.
| Axiom | Description | Meaning |
|---|---|---|
| 1. Non-negativity | For any event A, . | The probability of an event can't be negative. |
| 2. Unit Measure | . | The probability of the entire sample space is 1 (or 100%). Something has to happen. |
| 3. Additivity | If A and B are mutually exclusive events, then . | If two events can't happen at the same time, the probability that one or the other occurs is the sum of their individual probabilities. |
The concept of is key to the third axiom. Two events are mutually exclusive if they cannot happen at the same time. In set terms, their intersection is the empty set (). For a single die roll, the events "rolling a 1" and "rolling a 6" are mutually exclusive. You can't do both in one roll.
This leads to our first tool for calculation. If we have a set of simple, mutually exclusive outcomes, each with an equal chance of occurring, we can find the probability of any event by counting.
Let's go back to our die. The sample space has 6 equally likely outcomes. What is the probability of our event , rolling an even number? The event includes the outcomes {2, 4, 6}, so there are 3 outcomes in .
Using our formula, . This simple calculation works because it respects all three axioms. Each outcome has a probability of 1/6 (non-negative), the sum of all six is 1, and since each outcome is mutually exclusive, the probability of the event is the sum of the probabilities of its outcomes ().
Time to check your understanding of these core concepts.
In probability theory, what is the term for the set of all possible outcomes of an experiment?
An experiment consists of flipping a coin twice. The sample space is {HH, HT, TH, TT}. Which set represents the event 'getting at least one head'?
With these foundations—sample spaces, events as sets, and the axioms—we have a solid framework for tackling more complex probability problems.