No history yet

Expectation Properties

The Rules of Expectation

The expected value, or expectation, of a random variable is its long-term average. It tells us what to expect if we were to repeat an experiment many times. But to really unlock its power, we need to understand a few fundamental properties that govern how it behaves. These properties are like the grammar rules of probability, allowing us to break down complicated problems into much simpler pieces.

Linearity

The most powerful property of expectation is its linearity. This means you can split the expectation of a sum into a sum of expectations. It also means you can pull constants out of an expectation. This is a huge deal because it works even if the random variables are dependent on each other.

E[aX+bY]=aE[X]+bE[Y]E[aX + bY] = aE[X] + bE[Y]

Let's make this concrete. Imagine you're playing a game that involves rolling two different dice, a standard six-sided die (let's call its outcome XX) and an eight-sided die (outcome YY). In this game, your total score is calculated as twice the result of the first die plus the result of the second die, or 2X+Y2X + Y. You want to find the expected score.

Instead of figuring out the probability of every possible combined score, linearity lets us calculate the expected value of each roll separately and then combine them.

The expected value of a single roll of a fair six-sided die is 3.5. So, E[X]=3.5E[X] = 3.5. For an eight-sided die, the expected value is 4.5, so E[Y]=4.5E[Y] = 4.5. Using the linearity property, we can find the expected score of our game:

E[2X+Y]=E[2X]+E[Y]=2E[X]+E[Y]=2(3.5)+4.5=7+4.5=11.5\begin{aligned} E[2X + Y] &= E[2X] + E[Y] \\ &= 2E[X] + E[Y] \\ &= 2(3.5) + 4.5 \\ &= 7 + 4.5 = 11.5 \end{aligned}

Just like that, we found the average score you'd expect over many games is 11.5, without ever needing to list out all 48 possible outcomes.

Other Key Properties

Besides linearity, two other properties are essential. They are more intuitive but just as important.

Expectation (also called expected value) is the average or mean value you would expect from a random experiment if you repeat it many times.

First is non-negativity. If a random variable can never take a negative value, its expectation can't be negative either. This makes perfect sense. If you're rolling a standard die, the outcomes are all positive numbers (1 through 6). There's no way the average of those outcomes could ever be negative.

If X0, then E[X]0.\text{If } X \ge 0, \text{ then } E[X] \ge 0.

Second is monotonicity. This property says that if one random variable is always less than or equal to another, its expectation will follow the same pattern. Let's say you have two lottery tickets. Ticket A's prize, XX, is always less than or equal to Ticket B's prize, YY. Monotonicity tells us that the expected prize from Ticket A must be less than or equal to the expected prize from Ticket B.

If XY, then E[X]E[Y].\text{If } X \le Y, \text{ then } E[X] \le E[Y].

These properties are the building blocks for working with expected values. They allow us to reason about random variables and simplify calculations in powerful ways.

Ready to test your understanding?

Quiz Questions 1/5

Let X and Y be two random variables with E[X] = 10 and E[Y] = 5. What is the expected value of the random variable Z = 3X - Y?

Quiz Questions 2/5

True or False: The linearity of expectation, which states that E[aX+bY]=aE[X]+bE[Y]E[aX + bY] = aE[X] + bE[Y], only holds if the random variables X and Y are independent.

Mastering these properties is a key step toward a deeper understanding of probability.