No history yet

Probability Foundations

The Language of Chance

Probability starts with a clear framework. An experiment is any process with an uncertain result, like rolling a die. Each possible result is an outcome. The set of all possible outcomes is the sample space, which we usually call SS. For a single six-sided die, the sample space is simple and finite: S={1,2,3,4,5,6}S = \{1, 2, 3, 4, 5, 6\}.

An event is just a specific outcome or a set of outcomes we're interested in. In set theory terms, an event is any subset of the sample space. For our die roll, an event could be simple, like rolling a 5. Or it could be more complex, like rolling an even number. The event of rolling an even number, let's call it AA, would be the subset A={2,4,6}A = \{2, 4, 6\}.

Every event is a specific collection of outcomes from the sample space.

Since events are sets, we can use set operations to combine or modify them. This is how we handle more complex scenarios.

  • Union (A ∪ B): This is event A or event B (or both) happening. If AA is rolling an even number and BB is rolling a number greater than 4 (B={5,6}B=\{5, 6\}), then AB={2,4,5,6}A \cup B = \{2, 4, 5, 6\}.
  • Intersection (A ∩ B): This is event A and event B happening. Using the same events, AB={6}A \cap B = \{6\}. It's the outcome that satisfies both conditions.
  • Complement (A'): This is event A not happening. The complement of rolling an even number is rolling an odd number: A={1,3,5}A' = \{1, 3, 5\}.

The Rules of the Game

To move from sets to actual probabilities, we need a few ground rules. These are the axioms of probability—fundamental truths that we accept without proof. They ensure that our calculations are consistent and logical. All of probability theory is built on these three simple ideas.

AxiomDescriptionMeaning
1. Non-negativityFor any event A, P(A)0P(A) \geq 0.The probability of an event can't be negative.
2. Unit MeasureP(S)=1P(S) = 1.The probability of the entire sample space is 1 (or 100%). Something has to happen.
3. AdditivityIf A and B are mutually exclusive events, then P(AB)=P(A)+P(B)P(A \cup B) = P(A) + P(B).If two events can't happen at the same time, the probability that one or the other occurs is the sum of their individual probabilities.

The concept of is key to the third axiom. Two events are mutually exclusive if they cannot happen at the same time. In set terms, their intersection is the empty set (AB=A \cap B = \emptyset). For a single die roll, the events "rolling a 1" and "rolling a 6" are mutually exclusive. You can't do both in one roll.

This leads to our first tool for calculation. If we have a set of simple, mutually exclusive outcomes, each with an equal chance of occurring, we can find the probability of any event AA by counting.

P(A)=Number of outcomes in ATotal number of outcomes in SP(A) = \frac{\text{Number of outcomes in A}}{\text{Total number of outcomes in S}}

Let's go back to our die. The sample space SS has 6 equally likely outcomes. What is the probability of our event AA, rolling an even number? The event AA includes the outcomes {2, 4, 6}, so there are 3 outcomes in AA.

Using our formula, P(A)=3/6=0.5P(A) = 3/6 = 0.5. This simple calculation works because it respects all three axioms. Each outcome has a probability of 1/6 (non-negative), the sum of all six is 1, and since each outcome is mutually exclusive, the probability of the event is the sum of the probabilities of its outcomes (1/6+1/6+1/6=3/61/6 + 1/6 + 1/6 = 3/6).

Time to check your understanding of these core concepts.

Quiz Questions 1/7

In probability theory, what is the term for the set of all possible outcomes of an experiment?

Quiz Questions 2/7

An experiment consists of flipping a coin twice. The sample space is {HH, HT, TH, TT}. Which set represents the event 'getting at least one head'?

With these foundations—sample spaces, events as sets, and the axioms—we have a solid framework for tackling more complex probability problems.