No history yet

Probability Basics

Quantifying Uncertainty

Probability is simply a way to measure how likely something is to happen. We use it every day, whether we're checking the weather forecast or deciding if we should buy a lottery ticket. It helps us navigate a world full of uncertainty by putting a number on it.

This number always falls on a scale from 0 to 1. An event with a probability of 0 is impossible, like a standard coin landing perfectly on its edge. An event with a probability of 1 is certain, like the sun rising tomorrow morning.

Most events fall somewhere in between. A coin flip has a 0.5 probability of landing on heads, meaning it's just as likely to happen as not.

The probability of any event is a number between 0 (impossible) and 1 (certain).

We often express the probability of an event, let's call it AA, using the notation P(A)P(A). So, for a fair coin flip, we would write P(Heads)=0.5P(\text{Heads}) = 0.5.

Mapping the Possibilities

To calculate a probability, we first need to understand all the possible outcomes. In probability, any process with an uncertain result, like rolling a die or drawing a card, is called an experiment.

Sample Space

noun

The set of all possible outcomes of an experiment.

The sample space is a complete list of everything that could happen. If you roll a standard six-sided die, the sample space, often denoted by SS, is:

S = {1, 2, 3, 4, 5, 6}

Now, let's say you're interested in a specific result, like rolling an even number. This is called an event.

Event

noun

A subset of the sample space; a specific outcome or a set of outcomes.

An event is just a collection of one or more outcomes from the sample space. The event of rolling an even number corresponds to the set {2, 4, 6}. For a simple experiment where each outcome is equally likely, the probability of an event is the ratio of the number of favorable outcomes to the total number of outcomes in the sample space.

P(A)=Number of outcomes in event ATotal number of outcomes in SP(A) = \frac{\text{Number of outcomes in event A}}{\text{Total number of outcomes in S}}

For our die roll, the probability of getting an even number is:

P(Even)=36=0.5P(\text{Even}) = \frac{3}{6} = 0.5

The Three Axioms

Probability isn't just a set of convenient rules; it’s a formal mathematical system built on three fundamental truths called axioms. These were established by the Russian mathematician Andrey Kolmogorov in the 1930s and form the bedrock of modern probability theory.

Lesson image

These axioms ensure that our calculations are logical and consistent. Let's break them down.

Axiom 1: Non-negativity. The probability of any event is always non-negative. It's either zero or positive. You can't have a negative chance of something happening.

P(A)0P(A) \ge 0

Axiom 2: Unit Measure. The probability of the entire sample space is 1. This means that one of the possible outcomes must occur.

P(S)=1P(S) = 1

When you roll a die, you are guaranteed to get one of the numbers from 1 to 6. The probability of rolling a number that is in the set {1, 2, 3, 4, 5, 6} is certain, so its probability is 1.

Axiom 3: Additivity. If two events are mutually exclusive (meaning they can't happen at the same time), the probability that one or the other occurs is the sum of their individual probabilities.

For example, when rolling a die, the event of rolling a 1 and the event of rolling a 2 are mutually exclusive; you can't do both on a single roll. The event AA is 'rolling a 1' and event BB is 'rolling a 2'.

P(A or B)=P(A)+P(B)P(A \text{ or } B) = P(A) + P(B)

The probability of rolling a 1 is $1/6$, and the probability of rolling a 2 is $1/6$. Therefore, the probability of rolling a 1 or a 2 is:

P(1 or 2)=16+16=26=13P(1 \text{ or } 2) = \frac{1}{6} + \frac{1}{6} = \frac{2}{6} = \frac{1}{3}

These three simple axioms are all we need to build the entire framework of probability, allowing us to tackle much more complex problems.

Quiz Questions 1/5

The probability of any event is always a number between:

Quiz Questions 2/5

In probability theory, what is the term for the complete set of all possible outcomes of an experiment?

These foundational concepts—the 0-to-1 scale, sample spaces, events, and the three axioms—are the building blocks for exploring the fascinating world of chance and likelihood.