No history yet

Introduction to Probability

What Are the Chances?

Life is full of uncertainty. Will it rain tomorrow? Will my favorite team win the championship? Will I hit a string of green lights on my way to work? We can't know the future for sure, but we can try to measure the likelihood of different possibilities. This is the core idea behind probability.

Probability is the science of quantifying uncertainty. It gives us a mathematical way to talk about how likely something is to happen.

It’s a tool we use every day, whether we realize it or not. When a weather forecast says there's a 70% chance of rain, that's probability at work. It helps you decide whether to bring an umbrella. To really understand it, we need to learn a few key terms.

The Language of Chance

To talk about probability precisely, we use a specific vocabulary. Let's start with the basics.

Experiment

noun

Any process or action that has an uncertain result.

An experiment could be as simple as flipping a coin or as complex as launching a satellite.

Outcome

noun

A single possible result of an experiment.

For a single roll of a standard six-sided die, the possible outcomes are 1, 2, 3, 4, 5, or 6.

Sample Space

noun

The set of all possible outcomes for an experiment. It’s often written inside curly braces { }.

The sample space for rolling a die would be S = {1, 2, 3, 4, 5, 6}. It lists every single thing that could happen.

Event

noun

A specific outcome or a group of outcomes that we are interested in.

An event can be one outcome (like rolling a 3) or multiple outcomes. For example, the event "rolling an even number" corresponds to the set of outcomes {2, 4, 6}.

Putting a Number on Uncertainty

Probability gives us a way to measure the chance of an event happening. This measure is always a number between 0 and 1.

An event with a probability of 0 is impossible. For instance, the probability of rolling a 7 on a standard six-sided die is 0.

An event with a probability of 1 is certain to happen. The probability of rolling a number less than 7 on a die is 1, because every possible outcome (1, 2, 3, 4, 5, 6) is less than 7.

Everything else falls somewhere in between. A probability of 0.5, or 1/2, means the event is just as likely to happen as it is not to happen, like getting heads on a fair coin flip.

If P(E) is the probability of an event E, then it's always true that 0P(E)10 \le P(E) \le 1.

Theory vs. Reality

So how do we find that number between 0 and 1? There are two main ways to think about probability: theoretical and empirical.

Theoretical probability is what we expect to happen in an ideal world. It's based on logic and symmetry, assuming every outcome is equally likely.

We calculate it without actually doing an experiment. For example, a die is a perfect cube with six sides. In theory, each side has an equal chance of landing face up. To find the probability of an event, we use a simple formula.

P(Event)=Number of favorable outcomesTotal number of outcomesP(\text{Event}) = \frac{\text{Number of favorable outcomes}}{\text{Total number of outcomes}}

Let's find the probability of the event "rolling an even number." The favorable outcomes are {2, 4, 6}, so there are 3 of them. The total number of outcomes is 6. So, the probability is:

P(even number)=36=12P(\text{even number}) = \frac{3}{6} = \frac{1}{2} or 0.50.5.

Empirical probability is what actually happens when we do an experiment. It's based on real-world observations and data.

Sometimes we can't figure out the theoretical probability. What's the probability that your favorite baseball player gets a hit? There's no simple way to calculate that from theory. Instead, we look at data.

If the player has gotten 150 hits in their last 500 at-bats, we can estimate the probability of them getting a hit in their next at-bat. The formula is similar, but based on trials.

P(Event)=Number of times event occurredTotal number of trialsP(\text{Event}) = \frac{\text{Number of times event occurred}}{\text{Total number of trials}}

So, for our baseball player, the empirical probability of getting a hit is:

P(hit)=150500=310P(\text{hit}) = \frac{150}{500} = \frac{3}{10} or 0.30.3.

This is also called relative frequency. It’s an approximation. If you roll a die 10 times, you might get an even number 6 times, for an empirical probability of 6/10. This isn't the theoretical 5/10. But a fascinating thing happens: as you perform more and more trials, the empirical probability usually gets closer and closer to the theoretical probability. This idea is called the Law of Large Numbers.

Now that you know the basics, let's see how well you've grasped these fundamental concepts.

Quiz Questions 1/6

In probability, what does the term "sample space" refer to?

Quiz Questions 2/6

A standard deck of 52 playing cards has 13 cards in each of the 4 suits (hearts, diamonds, clubs, spades). What is the theoretical probability of drawing a heart?

Understanding these core ideas of experiments, outcomes, and the two types of probability is the first step in using this powerful tool to make sense of an uncertain world.