No history yet

Expectation Values in Decision Theory

Transcript

Beau

Okay, so we've been talking a lot about expectation values, you know, calculating the average outcome of rolling a die or flipping a coin. But... how does this stuff actually help in, like, real life? When am I ever calculating the expected value of a die roll at my job?

Jo

That is the million-dollar question, isn't it? And the answer is... probably never for a literal die roll. But the underlying concept? You use it all the time without realizing it. It’s the core of making decisions when you don't know what's going to happen.

Beau

Decision-making under uncertainty. That sounds... very formal. And also very much like my entire life.

Jo

Exactly! Think about it. Let's say you get two job offers. Job A pays a guaranteed seventy thousand dollars. Job B pays fifty thousand, but there's a fifty percent chance of getting a fifty-thousand-dollar bonus at the end of the year. Which one do you take?

Beau

Ooh, okay. So, Job A is a sure thing. Seventy K. Job B is... riskier. It could be fifty K or it could be a hundred K. My gut says take the sure thing, but the hundred K is tempting.

Jo

Let's use what we learned about expectation values. Job A's expected value is just seventy thousand, right? It's a hundred percent probability. For Job B, we have a fifty percent chance of fifty thousand and a fifty percent chance of a hundred thousand.

Beau

So... half of fifty K is twenty-five K, and half of a hundred K is fifty K. Add them together... seventy-five thousand dollars. Huh. So Job B has a higher expected value.

Jo

Exactly. On paper, it's the better choice over the long run. But your gut reaction was to take the sure thing. That's because we don't just think about expected value, we think about something called 'expected utility'.

Beau

Utility? Like... satisfaction? Or happiness?

Jo

Precisely. The pain of earning only fifty thousand might be much greater for you than the extra happiness you'd get from a hundred thousand versus seventy-five. So, for you, the seventy-thousand-dollar sure thing has higher *utility*, even if its monetary expectation is lower.

Beau

Okay, that makes total sense. It's like buying insurance. You expect to lose money, right? The premium you pay is more than the expected payout of a claim. But the utility of not going bankrupt if your house burns down is... well, it's huge.

Jo

That's a perfect example. We pay a small, certain loss to avoid a small chance of a catastrophic loss. We're maximizing our expected utility, not our expected financial outcome. And companies use this for big decisions in economics, operations... all over the place.

Beau

So these are mostly one-off decisions. But what about when you have to make a whole sequence of them? Like, uh... I don't know, trying to hire the best person for a job when you have to interview them one by one.

Jo

That's a fantastic question, and it leads to a really cool idea called the 'prophet inequality' problem. The name is a bit dramatic.

Beau

A prophet? Are we predicting the future now?

Jo

Sort of. Imagine you're presented with a series of prizes, one at a time. Each prize has a value. You know the distribution of the values, but you see them in a random order. When you see a prize, you have to decide immediately: take it and stop, or reject it forever and see the next one.

Beau

Okay, so it's like your hiring problem. You interview someone. They seem pretty good. Do you offer them the job, or do you hold out for someone potentially better, risking that everyone else is worse?

Jo

Exactly. The 'prophet' in this problem is someone who can see all the prizes—or all the candidates—in advance and just pick the best one. Their expected outcome is simply the expected value of the maximum prize. We, as mere mortals, can't do that.

Beau

So we're trying to get as close to the prophet's choice as possible?

Jo

Yes, and the prophet inequality tells us something amazing. It says there's a simple strategy that guarantees you an expected outcome of at least half of what the prophet would get.

Beau

Half? Just by using a simple rule? What's the rule?

Jo

The simplest version is a threshold strategy. You calculate a threshold value beforehand. Then you go through the options one by one and take the very first one that exceeds your threshold. That's it.

Beau

And how do you... calculate that threshold? You just pick a number?

Jo

It's based on the expected values. The classic threshold is half of the expected maximum value. So if you were looking at ten prizes and the expected best one was worth, say, a hundred dollars, your threshold would be fifty. You'd take the first prize you see that's worth more than fifty.

Beau

You might end up with a fifty-one dollar prize and miss a ninety-nine dollar one later. But you also might avoid ending up with a five-dollar prize because you were too picky.

Jo

Exactly! It balances the risk of stopping too early with the risk of holding out for too long. It's a strategy that guarantees a pretty good outcome, even if it's not always the perfect one. It's using expectation values to navigate a sequence of decisions under uncertainty.

Beau

So whether it's picking a job or hiring a candidate, it's all about figuring out the expected utility of your choices, and then using that to set a rule for yourself.

Jo

You got it. It removes some of the emotion and gut feeling and replaces it with a logical framework. You're not just hoping for the best; you're playing the odds in a smart way.

Beau

Playing the odds in a smart way. I like that. So next time I'm deciding what to have for dinner, I should calculate the expected utility of pizza versus tacos.

Jo

I mean, you could. But you might find the expected value of just flipping a coin is higher, considering the time you'd save.