Probability Fundamentals
Probability Basics
The Language of Chance
Life is full of uncertainty. Will it rain tomorrow? Will my favorite team win the championship? Will I catch the bus? We constantly make guesses and predictions. Probability gives us a mathematical way to talk about this uncertainty.
At its heart, probability is a measure of how likely an event is to occur. We express it as a number between 0 and 1. A probability of 0 means the event is impossible. A probability of 1 means the event is absolutely certain to happen. Everything else falls somewhere in between.
Think of it like a likelihood scale. A probability of 0.5, like in a coin flip, means there's a 50/50 chance of the event happening.
Sample Spaces and Events
To calculate probabilities, we first need to understand all the possible outcomes of a situation. This complete set of possibilities is called the sample space.
Sample Space
noun
The set of all possible outcomes of a random experiment. It's often denoted by the letter S or the Greek letter Omega (Ω).
For example, if you roll a standard six-sided die, the sample space includes every possible number you could roll. We can write this as:
Now, let's say we're interested in a specific outcome, like "rolling an even number." This is what we call an event.
Event
noun
A specific outcome or a set of outcomes from an experiment. An event is always a subset of the sample space.
For our die roll, the event of rolling an even number would be the set . Notice that every element in our event is also an element of our sample space . An event is simply a piece of the sample space we want to focus on.
When all outcomes in a sample space are equally likely, we can calculate the probability of an event with a simple formula.
For our event of rolling an even number, there are 3 favorable outcomes (2, 4, 6) and 6 total outcomes in the sample space. So, the probability is:
The Rules of the Game
Probability isn't just a loose concept; it's governed by three simple but powerful rules called axioms. These were formalized by the Russian mathematician Andrey Kolmogorov in the 1930s. They ensure that our calculations are consistent and logical.
Think of axioms as the fundamental ground rules that everything else in probability is built upon.
Axiom 1: Non-Negativity The probability of any event can never be negative. It must be zero or a positive number. This makes intuitive sense—you can't have less than a zero percent chance of something happening.
Axiom 2: Total Probability The probability of the entire sample space is 1. This means that one of the possible outcomes must occur. When you roll a die, you are guaranteed to get a 1, 2, 3, 4, 5, or 6.
Axiom 3: Additivity If you have two or more events that cannot happen at the same time (we call them mutually exclusive), the probability of one or the other happening is the sum of their individual probabilities. For example, you can't roll a 1 and a 3 on a single die roll. The events are mutually exclusive. So, the probability of rolling a 1 or a 3 is:
These three axioms are the bedrock of probability theory. From them, we can derive all other rules and properties needed to solve complex problems.
What does a probability of 1 indicate?
If you flip two fair coins, what is the complete sample space of possible outcomes? (H = Heads, T = Tails)
These foundational concepts are the first step. With a solid grasp of sample spaces, events, and the basic rules, you're ready to explore the more intricate and powerful aspects of probability.