No history yet

Properties of Expectation Values

Transcript

Beau

Okay, so last time we figured out the expected value of a single six-sided die roll is three-point-five, right?

Jo

Yep, exactly. The average outcome if you were to roll it an infinite number of times.

Beau

Right. So... what if I roll two dice? And add them up. Do I have to... like, map out every single possible outcome? Two, three, all the way to twelve, figure out the probability of each one, and then do that big summation thing we did before? Because that sounds... tedious.

Jo

You absolutely could. And you'd get the right answer. But there's a much, much easier way. Think of it like a cheat code. This is where the properties of expectation values come in. They're basically rules that let us simplify these kinds of problems.

Beau

A cheat code for math? I'm listening.

Jo

So the first big one is called Linearity of Expectation. It sounds intimidating, but the idea is super simple: the expectation of a sum is just the sum of the expectations.

Beau

Wait. You're saying... for the two dice, I just take the expected value of the first die... three-point-five... and add the expected value of the second die, which is also three-point-five?

Jo

And you get...?

Beau

Seven. The expected value is seven. That's it? That feels too easy. There has to be a catch.

Jo

No catch! That's the beauty of it. It works for adding random variables together. And it also works with constants. So, say... the expected value of two times a die roll... is just two times the expected value of one die roll.

Beau

So... two times three-point-five, which is also seven. Huh. Okay. So let's make it weirder. What if I have a normal six-sided die and also one of those... uh... four-sided pyramid dice?

Jo

Okay. A D4. So what's its expected value?

Beau

Um, well the outcomes are one, two, three, four. Add 'em up, that's ten. Divide by four... so, two-point-five?

Jo

Perfect. So, what's the expected value of the sum if you roll both dice?

Beau

It would just be three-point-five plus two-point-five... which is six. Without having to calculate anything complex. That's actually really cool. It's like a superpower.

Jo

It is! And it's incredibly useful. It's used everywhere from finance to, I don't know, analyzing game shows. Now, here's a simple one. Another property. It's called non-negativity.

Beau

Let me guess. The expectation value can't be negative?

Jo

Almost! It can't be negative if all the possible outcomes of your random variable can't be negative.

Beau

Oh, right. That makes sense. Like a die roll. You can't roll a negative two. The outcomes are one, two, three, four, five, six. So the average, the expectation, has to be somewhere in that range. It can't be a negative number.

Jo

Exactly. If you're calculating the expected number of rainy days in a week, you know your answer can't be negative one. It's a simple, intuitive check, but it's a formal property that's surprisingly useful for sanity-checking your work.

Beau

Okay, so we have linearity, which is the addition rule, and non-negativity, which is the 'don't be ridiculous' rule. What's next?

Jo

The next one is a little more abstract, but it's incredibly powerful. It's called the Law of Total Expectation. Sometimes people call it the Tower Rule.

Beau

Tower Rule. Okay. Sounds... ominous. Or like something out of a fantasy novel.

Jo

Basically, it says that the expected value of a random variable is the expected value of its conditional expectations.

Beau

...You've lost me. Expected value of an expected value? My brain just folded in on itself.

Jo

Okay, okay, let's ground it. Let's make it concrete. Imagine you're an insurance analyst. You want to find the expected claim amount for a new customer.

Beau

Okay, I'm a very serious insurance analyst. I have a tiny calculator and everything.

Jo

Perfect. Now, you know that claim amounts are very different for different age groups. People under 25 are, let's say, higher risk. People over 25 are lower risk. Trying to find the overall average directly is hard because you have this big mix of people.

Beau

Right, it's not one uniform group.

Jo

Exactly. So the Law of Total Expectation lets you break the problem down. First, you calculate the expected claim amount just for the under-25 group. Let's say your data shows it's, I don't know, five hundred dollars.

Beau

Okay, E of claims, given you're a reckless youth, is five hundred bucks.

Jo

Then you calculate the expected claim for the over-25 group. They're more careful, so let's say it's only two hundred dollars.

Beau

Alright, so we have these two separate averages.

Jo

Now, you look at your overall pool of customers. Let's say you know that thirty percent of your customers are under 25, and seventy percent are over 25.

Beau

Okay...

Jo

To get the total expected value, you just take a weighted average of those conditional expectations. So you take the five hundred dollars for the young group and weight it by their probability, thirty percent. Then you add the two hundred dollars for the older group, weighted by their probability, seventy percent.

Beau

So... point-three times five hundred, that's a hundred and fifty. And point-seven times two hundred, that's... a hundred and forty. Add them together... two hundred ninety dollars. So the overall expected claim is two hundred ninety.

Jo

Precisely. You took the average of the averages. That's the Law of Total Expectation. You broke a complex problem down into simpler, conditional pieces, found the expectation for each piece, and then averaged them back together based on how likely each piece was.

Beau

That's... actually not as scary as it sounded. It's just a way of dealing with mixed groups. You handle each group on its own and then combine them proportionally.

Jo

You got it. So we have our three properties. Linearity lets us add and multiply. Non-negativity keeps us in the real world. And the Law of Total Expectation lets us divide and conquer complex problems.

Beau

So linearity would have told me right away that rolling a hundred dice has an expected sum of three hundred and fifty. And the Tower Rule helps me figure out insurance premiums. Not bad for a few rules.

Jo

See? They're just tools. Powerful tools that let you skip a whole lot of tedious calculation and get right to the answer.