No history yet

Probability Basics

The Language of Chance

We navigate uncertainty every day. Will it rain? Will my favorite team win? Will this traffic ever move? Probability is the mathematical tool we use to measure and understand this uncertainty. It gives us a way to talk about how likely something is to happen.

At its core, probability is a number between 0 and 1 that represents the likelihood of an event.

A probability of 0 means the event is impossible. The chance of a standard six-sided die landing on a 7 is 0. A probability of 1 means the event is certain. The chance that the sun will rise tomorrow is, for all practical purposes, 1.

Everything else falls somewhere in between. A coin flip has a 0.5 chance of landing on heads. This doesn't mean it will land on heads half the time, but that over many, many flips, the results will get closer and closer to that 50/50 split.

P(Event)=Number of ways the event can happenTotal number of possible outcomesP(\text{Event}) = \frac{\text{Number of ways the event can happen}}{\text{Total number of possible outcomes}}

This simple fraction is the foundation for calculating basic probabilities. For a fair six-sided die, the probability of rolling a 4 is $1/6$, because there's only one '4' on the die (one way the event can happen) out of six total possible outcomes.

Sample Spaces and Events

To calculate probability, we first need to clearly define all the things that could happen. In probability, this complete set of all possible outcomes of an experiment is called the sample space.

Sample Space

noun

The set of all possible outcomes of a random experiment.

For flipping a single coin, the sample space (often denoted as SS) is {Heads, Tails}. For rolling a standard die, the sample space is S={1,2,3,4,5,6}S = \{1, 2, 3, 4, 5, 6\}.

An event is any specific outcome or group of outcomes you're interested in. It's a subset of the sample space.

ExperimentSample Space (S)Example Event (E)Probability P(E)
Rolling a die{1, 2, 3, 4, 5, 6}Rolling an even number: {2, 4, 6}3/6 = 1/2
Flipping a coin{Heads, Tails}Getting tails: {Tails}1/2
Drawing a card{52 cards}Drawing a King: {K♠, K♥, K♣, K♦}4/52 = 1/13

Notice how the event is always a part of the larger sample space. The event "rolling an even number" includes three of the six possible outcomes in the sample space for a die roll.

The Rules of the Game

Probability isn't just a loose concept; it's governed by a few fundamental rules called axioms. These were formalized by the mathematician Andrey Kolmogorov, and they ensure that our calculations are consistent and logical. Think of them as the constitution for probability.

There are three main axioms that all probabilities must obey.

1. Probability is non-negative. The probability of any event must be greater than or equal to zero. You can't have a negative chance of something happening. This is the most intuitive rule.

P(E)0P(E) \ge 0

2. The total probability is 1. The probability of the entire sample space is 1. This means that something from the set of all possible outcomes must occur. When you roll a die, it is certain to land on one of its six faces.

P(S)=1P(S) = 1

3. Probabilities of mutually exclusive events add up. If two events are mutually exclusive, it means they cannot happen at the same time. For example, you can't roll a 2 and a 5 on a single die roll. The axiom states that the probability of one event or the other happening is simply the sum of their individual probabilities.

P(E1 or E2)=P(E1)+P(E2)P(E_1 \text{ or } E_2) = P(E_1) + P(E_2)

Let's use our die roll example. The event of rolling a 2 has a probability of 1/61/6. The event of rolling a 5 also has a probability of 1/61/6. Since you can't roll both at once, the probability of rolling a 2 or a 5 is:

P(2 or 5)=P(2)+P(5)=1/6+1/6=2/6=1/3P(\text{2 or 5}) = P(2) + P(5) = 1/6 + 1/6 = 2/6 = 1/3

These three axioms are the bedrock of probability theory. From them, we can derive all sorts of complex and powerful ways to analyze the world.

Quiz Questions 1/7

What does probability fundamentally measure?

Quiz Questions 2/7

For a standard six-sided die, what is the sample space?