Cautionary Tales with Tim Harford - When the Robots Take Over... - Cautionary Questions
Episode Date: May 24, 2024Tim Harford is joined by Jacob Goldstein to answer your questions. Does winning the lottery make you unhappy? Is Bitcoin bad for the economy? When does correlation imply causation? And what will Ti...m and Jacob do when the robot overlords come for their jobs? We love hearing from you, so please keep your questions coming: tales@pushkin.fm.See omnystudio.com/listener for privacy information.
Transcript
Discussion (0)
Pushkin.
It all started with two federal agents who heard a rumor.
She mentions, well, there is this alleged murder to have taken place.
There is just one problem.
They had no clue who the victim was.
We have to do our job and we have to find out who did they kill.
It had been 15 years since this alleged murder.
Was it still possible to unearth the truth?
to unearth the truth. I used to watch the Unsolved Mystery Shows
and I often thought about calling
because I was like, this is not right.
How can a person get killed and no one knows anything?
I'm Jake Halpern and this is Deep Cover, The Nameless Man.
Listen wherever you get your podcasts I'm Jake Halpern, and this is Deep Cover, The Nameless Man.
Listen wherever you get your podcasts.
And if you want to hear the entire season right now,
ad free, subscribe to Pushkin Plus
on our Apple Podcast show page or on pushkin.fm slash plus.
Let's play around. Warder Studios, it sounds very Elvin.
I always think of David Bowie when I think of Warder.
In one of his early songs he talks about bright lights, Soho, Warder Street.
Bowie himself has an Elfin aspect.
He certainly does.
His breakthrough gig at Aylesbury, my hometown, which basically is
about the only thing remarkable about Aylesbury.
Well, and also home of Tim Hartford, as the plaque says.
Yeah. They've got a statue for Bowie, not yet for me. I don't know why. Should we go?
Okay. Let's go.
Okay, I'm ready.
Hello and welcome back to another episode of Cautionary Questions, our first of 2024.
I am of course Tim Harford. You are our loyal listeners, you've been sending in your burning
questions on money, technology, economics and problem solving and thank you so much
to everyone who's done so. And today is the day I do my best to answer them. And thankfully,
I won't be alone in this endeavour. Here to help me out, both with the questions and I
think with some of the answers, is the brilliant, brilliant Jacob Goldstein, the host of Pushkin
podcast, What's Your Problem, author of the book Money, the true story of a made-up thing.
Jacob was my inaugural Cautionary Questions
co-host. Jacob, it's wonderful to have you back.
Tim, it's an honor. Hi.
So we should just get on with the questions because we always have so many and so much
to say. So what have you got in your big bag of listener questions for me?
Let's start with a question from Alex in Melbourne, Australia. Alex writes, I work with artificial intelligence image
generation software almost daily now.
And I'm quickly seeing how so much of my workforce
and processes can either be sped up or entirely replaced
by AI.
And this makes me nervous.
And then he asks about universal basic income,
this idea of a government giving all its citizens money.
And he says, it seems for the first time that computers
and software will actually replace jobs
in a deeply concerning way, which is both exciting
and terrifying.
What are your thoughts on UBI, universal basic income,
as a solution to an AI crisis and the widespread philosophical
and economic implications of this?
I love this question. I mean, it's so big. And I think the first thing to say is we don't
really have any idea. If what Alex is thinking about comes true, and if most people just
have no economic value, they have value as human beings, have value as members of society,
but there's nothing that they could actually sell their labour to do, then that's completely uncharted territory. We've never
been anywhere like that before. So everything we do is kind of speculative.
We've feared it for a long time, right? We've had 200 years of being afraid of technological
unemployment and my prior on this is to be somewhat skeptical, right? Like clearly there can be
some large number of people who lose their jobs and we should be concerned about that and we should think about how to mitigate that
but the idea of
more or less everybody losing their jobs
I'm skeptical of for the simple reason that it hasn't happened in 200 years of incredible technological progress and right now
after decades of extreme technological progress, in the US, unemployment is below
4%.
The share of working-age people who are working is near all-time highs.
And so somehow, we keep coming up with new things to do for money, no matter how many
things computers can do.
And so my first thought is, I don't
think we're going to have everybody losing
their jobs to AI.
I definitely could be wrong, but that's what I think.
No, I think that's a good working assumption.
If you think back a few centuries,
basically almost all the labor that people did,
they might wash their clothes occasionally.
Well, that's been outsourced to the washing machines.
They'd spend a lot of time moving water around,
just drinking water cooking water
Throwing out human excrement. That's all now handled by
Automated systems digging people did a lot of digging right pulling a plow
Almost everything we used to do is now done by machines, but somehow we still all have jobs
Let's at least accept the premise that maybe this time it might be different
Because the robots are doing everything there's still material prosperity. Let's at least accept the premise that maybe this time it might be different.
Because the robots are doing everything, there's still material prosperity, there's food out
there, all the services we could possibly want. We just have to find some system whereby
the humans who have no economic value get to enjoy all this cool stuff that's being
produced by the machines.
Yeah. And you know, technological prosperity
has given us in the developed world,
UBI for old people, right?
In the US, as in every developed country, as far as I know.
Once you get to some age, if you are a citizen
and you have worked, the government gives you money.
Every month until you die, right?
And so you could imagine a kind of creeping extension of that.
Certainly right now they're not talking about lowering the retirement age in the US,
they're talking about raising it as in many countries. Yeah, raising it in the UK as well,
but it's still a long way away from life expectancy. My recollection is that when
Bismarck introduced the first pension, which was in Germany in the late 19th century, I think the pension started to be
paid at the age 67 and the life expectancy was 63.
You get negative four years in expectation.
People who survive long enough to claim any pension at all are already exceptional.
So that would be like having a pension today that started at age 90.
Like some people will get it, but most people won't.
But actually, a lot of people could easily
collect 30 years of pension, certainly 20 years.
So they're living a large proportion of their adult life,
receiving money from the state.
And they're also receiving money from their own savings,
their own investments, which might be a replacement for UBI.
Maybe we all just have shares in the robots instead.
We have shares in Google robots instead. We have shares
in Google or whatever and that's how we get paid.
Yes. Whether that is mediated by the government or not looks somewhat different, right? Either
the government is taxing the owners of Nvidia and Google stock and distributing the money
or everybody owns Google and Nvidia stock. There is the piece of this which is about
the non-financial parts of work, right?
I mean there's a political economy piece, this sort of bridge, how do we get from here
to there if that happens?
And that is complicated and maybe ugly.
If the robots can do all of the stuff, the computers can do it, there's no economic reason
why humans couldn't just receive whatever, an allowance, they're given 10 robots or they're
given $10,000 a month to spend on whatever they like.
There's no economic reason why that couldn't happen, but I think what you're getting at
is what does it do to us if we're in that situation?
Yeah, yeah.
Like, I don't want to not have a job.
I recognise that I am fortunate to have a job that I enjoy, that I derive a part of
my identity from.
I recognise that for many,
in fact, probably most people, a job is not that. It's some unpleasant thing they do because
they need the money and if they got more money they would quit their job. Well, you probably
know the kind of empirical evidence on this better than I do. Like people have looked
at lottery winners, right? And my sense is it's not great for you to win the lottery
and quit your job. It doesn't actually make you happier.
Actually, the evidence on lottery winners is a bit mixed and I think slightly we hear
all the disaster stories of lottery winners.
Actually it's great to win the lottery? That's amazing. Is that true?
I think it's fine. Yes, it's just fine to win the lottery. It's not really a problem
to win the lottery is my vague recollection. I wrote about this a couple of years ago. But we may not all want a job, but we all want something to do.
We all want to feel useful.
We all want a sense of some kind of purpose.
We all want, I think, that experience of mastery,
that experience of knowing that you can do something
that not everybody can do.
Those things don't have to come from a job,
but for a lot of people, they do come from a job. Yeah, for me, in my narrow provincial experience of life, it's frankly hard to imagine getting
those things without a job.
Yeah. It comes back to my initial reaction to Alex's terrific question, which is, this
is such unknown territory that we can only really speculate. But I think you and I, Jacob,
are in agreement that the fundamental issue here is not economic.
It's really to do with our souls.
How would we react if our desire for mastery,
our desire for meaning, our desire to feel useful,
if that had to be satisfied without having a job,
and what would we do, and could we cope?
And I don't know.
I mean, Harford, if the robots come and take our jobs,
let's just you and me make a podcast for free.
I'm in. I'll commit right now in the robot utopia apocalypse
to making a weekly podcast with you for free.
Deal.
Sorry, we have no more time.
You must give in to your robot overlords.
Give us another question.
Hello, Rice Abhinav.
I would like to ask with the onset of AI, what is the next cautionary tale you anticipate talking about in the years to come?
Hello, Abhinav. I have just finished the first draft of a script about the coming of AI.
And without giving too much away, the cautionary note is about what happens when automation
gets so good that we lose our own skills, we hand over control to the machine, and then
how do we respond when the machine says, actually this one's too hard, could you take over again?
Suddenly we're back at the wheel and we're out of practice.
Hartford, it's not another plane crash.
Is it?
Don't you have a moratorium on doing plane crashes at this point?
Because it sounds like that.
I'm going to say nothing more.
Fair enough.
Let's go for a break.
It all started with two federal agents who heard a rumor.
She mentions, well, there is this alleged murder to have taken place.
There was just one problem.
They had no clue who the victim was.
We have to do our job, and we have to find out who did they kill.
It had been 15 years since this alleged murder.
Was it still possible to unearth the truth?
I used to watch the Unsolved Mystery shows and I often thought about calling because
I was like, this is not right.
How can a person get killed and no one knows anything?
I'm Jake Halpern, and this is Deep Cover, The Nameless Man.
Listen wherever you get your podcasts.
And if you want to hear the entire season right now ad free,
subscribe to Pushkin Plus on our Apple Podcast show page
or on pushkin.fm slash plus.
We're back. I'm talking to Jacob Goldstein, the host of What's Your Problem? And we are
doing a cautionary questions Q&A episode. Jacob has the questions. Jacob's
also helping with the answers. I'm really set to requirements here, but I'm doing my
best. Jacob, what have you got for me?
Tim, our next question comes from Adam, who writes, Hi, I have a question about investing
in cryptocurrency.
Oh dear. Oh dear.
Come on, give it to him. It's an interesting one.
Traditionally, when buying shares in a company, you would be supporting that company to grow,
create a new product, or enter a new retail space.
This would hopefully create jobs and new products.
When people invest money into cryptocurrency, or any currency for that matter, isn't that
money just sitting around not doing anything until you withdraw it?
Would investing in crypto be bad for the economy compared with investing in businesses?
This is a deep question.
I really like it.
As the author of the wonderful book Money, the True Story of a Made-Up Thing, I am sure
you have thoughts, Jacob.
Let me have a first crack and you can tell me everything I've missed.
Yeah.
So let's say you buy Bitcoin or whatever and then the money's just sitting there because
Bitcoin is not building anything.
You're not buying investment in, say, a road building company or you're not buying an investment
in Google, which is developing new technology.
There's one of two possible things that happens.
So most likely is whoever you bought the Bitcoin from now has your money,
well now it's their money, and then they're going to do something with that money. So
maybe they then buy shares in Google, or they then set up a business, or they will then
go on to do something with that money, or they'll lend it to somebody else and that
person will do something with it. Eventually the money will find its way into some productive
investment. The fact that you bought Bitcoin off somebody does
not mean that they won't then do something useful with the money. But then, let's say
for some reason they just go, you know what, I'm just going to sit on this money, it's
just dollars, I'm going to stick them under the mattress. I guess a Bitcoin guy might
do that. That would reduce inflationary pressures on the economy, which is something we want
anyway. And if inflationary pressures are reduced too much, the Federal Reserve could
then go, you know what guys, we should probably print some money or otherwise stimulate the
economy. Actually, the worst thing that could possibly happen is that the money gets invested
in buying more computers that could be put to better use but in fact just end
up doing Bitcoin mining. I guess what I'm saying is as long as they don't spend it on
Bitcoin mining computers, it's totally fine. What am I missing?
I went around the same track as you went around. And you know, different cryptocurrencies have
different methods of regulation, right? So Bitcoin by design is this very energy intensive computing process in order to mine Bitcoin.
And that is, in my opinion, a bad outcome socially.
I agree.
Because you could imagine a world where maintaining the Bitcoin network was socially desirable.
In the world as it has evolved, I don't find it particularly socially desirable.
But at this point, I don't think most of the money going into Bitcoin is going to miners,
right?
There's a large stock of Bitcoin that exists in the world.
I mean, an interesting thing about money is it almost never sleeps.
It keeps going.
And so you can always ask what happens next.
You know, with the stock market, sometimes people talk about money on the sidelines when
they're like, well, the stock market can go up some more because there's a lot of cash
on the sidelines.
And there's this famous billionaire investor, Cliff Asness.
He's an interesting guy.
He got a PhD from the University of Chicago,
studied with Gene Fama, famous economist.
And Cliff Asness gets driven up the wall
when people say cash on the sidelines
for the same reason you just said, right?
Like every time somebody buys a share of stock,
someone else is selling it.
Right?
So like the money is changing hands, the stock is changing hands, but like there are no sidelines
with money.
Yeah.
And even if someone puts just cash in a checking account, well then now the bank has money
and you can bet the bank is going to want to do something with that money, something
productive.
And even if they don't put it in the bank, even if, as I say, it's under a mattress, well,
even then the Federal Reserve could always print money.
Yeah, the stock of money is not fixed, right? I think there's an assumption in the question,
I think goes back to the pre-modern era, the era before the 1930s, when money was based
on gold or silver, and it was finite,
right? There was a fixed amount of gold and silver in the world. In those days, indeed,
if you sat on money, you were effectively reducing the supply of money in the world.
But to your point, the supply of money in the world is as big as the central bank wants
it to be. And so it's not a meaningful constraint on economic growth. So the ultimate answer
to the question is, if you are just sitting on money, it's not
really going to have an effect on the broader economy.
Well, I think we've come to agreement.
Hopefully that makes sense to Adam.
Next question.
Our next question comes from Dr. Yvonne Couch, who is associate professor of neuroimmunology, Alzheimer's Research UK fellow,
associate research fellow at St. Hilda's College,
stipendary lecturer at Somerville College,
University of Oxford.
Yeah, University of Oxford, I know it well.
One of my sisters went to St. Hilda's College
and one of my sisters went to Somerville College.
So this feels very much in the family.
So what does Dr. Couch got to say?
She writes, my question was vaguely economics based, So this feels very much in the family. So what does Dr. Couchcott say?
She writes, my question was vaguely economics based, although probably not very.
Is the way we currently fund science feasible going forward?
Do we just have too many scientists and not enough resources?
All the best, Yvonne.
Oh, love it.
Let me throw out a few thoughts then.
I think that probably there is a problem with the way we fund science, but there's no one
way that we fund science.
So you have university research, you have various grants, various sources of funding,
philanthropy and so on.
You also have private sector research, which is often incentivised by the patent system.
And then you have big block
grants that are handed out by agencies such as the National Institutes for Health. So
there are lots of different ways that science gets funded. A couple of things that worry
me is that first of all there's a big incentive to make really incremental improvements rather than
to take risks. There's a great economics paper studying scientists who are funded by
the National Institutes for Health, which is a wonderful institution, very important,
and scientists who on paper seem to be the same, they're on the same career track,
they've got very similar publication records, And they were instead funded by a private foundation called the Howard Hughes Medical Institute.
Listeners who want to hear more about Howard Hughes and the Howard Hughes biography can
go to the back catalogue of cautionary tales. So the Howard Hughes Medical Institute basically
takes risks. It wants people to do something new. it's happy with a high risk of failure as long
as there's some chance of a real breakthrough success.
And this particular paper, studying the results that come from these two funding systems,
basically finds that the grant funders get what they pay for.
So the National Institutes for Health get a high success rate, but it's often quite incremental
progress. And the Howard Hughes Medical Institute has lots and lots success rate, but it's often quite incremental progress.
And the Howard Hughes Medical Institute has lots and lots of failures, but when it succeeds,
it really succeeds, and these are hugely important papers. And I just feel that we're not deliberate
enough about saying, well, how much of our funding ecosystem should be aiming at kind
of venture capital style for really big wins and how
much should be incremental. I think those are not the sorts of questions that get asked.
So that's one of the things that worries me. What's your take, Jacob?
One of the things that I have read is that over time the average age of grant recipients
from the NIH has gone up and up and up. So kind of you just think of this whole universe as getting older and
more risk averse and more kind of bureaucratic. There is an interesting set of counter pressures,
I think, rising up, partly out of Silicon Valley. I don't know if you've come across
the work of Patrick Collison and his brother. They're from Ireland. They founded Stripe.
They're very rich. Stripe is a big company that does basically payment stuff online. They have a really interesting
set of kind of philanthropic endeavors around the idea of progress. You know, they're trying
to create a kind of field of progress studies that is, it's very meta. What are the conditions
that best foster technological and scientific progress?
Yeah, but this question from Dr. Couch is very meta. It's very much progress studies, isn't it?
Yes. There's this institute in the Bay Area called the Arc Institute that hires leading
scientists. The basic idea is give talented people freedom and money, right?
And encourage them to take big swings.
And they are interested, you know, not just in outcomes, but in new tools, right?
Again, continuing on the nerdy thing.
Like if you take a tool like CRISPR, CRISPR is an intermediate tool that allows people
to cut up a genome, basically.
We just had the first transplant from an animal into a human a few weeks ago because of CRISPR. We have the first treatments for sickle cell disease because of CRISPR.
So I do think there is a wave of people trying to rethink scientific funding. There is a
bottom line aspect to this question from Dr. Couch that I don't feel like I know enough
to answer. I'm curious if you do. I mean the question is the way we currently fund science feasible going
forward. There is a yes no version of the answer. Do you think you know? Is it?
I don't know the answer but I guess I don't know either.
Another thing that concerns me on this which is potentially really existential
is the question of how we fund new antibiotics.
I think this points to a real weakness in the ecosystem of research funding. So if you
think about the basic way we develop drugs, the fundamental incentive is the patent. So
a drug company spends a lot of money, tries to develop drugs, some of them work, some
of them fail, a lot of them fail, but in the end you have a drug and the deal is we give you this artificial
monopoly called a patent and it'll only last for a certain amount of time, which is kind
of a problem because it takes so long to develop the drugs, maybe the patent's nearly expired.
You can charge an incredible amount for these drugs for a while and then your patents will
run out and then loads and
loads of people will make the same drug and it'll come down in value. For example, Viagra,
you could sell this for a huge amount of money and now Viagra is off patent and anyone can
make a generic Viagra. So that's the incentive that we've given to private companies, that
you will have this temporary monopoly.
So now think about antibiotics. The problem with antibiotics, we have lots of antibiotics
that work really well, except the bacteria have figured them out. And why have they figured
them out? Because we've used them, and the bacteria develop resistance. So what we really
need is new antibiotics that we don't use. And now think about how the patent system
deals with that. So you basically say, if you develop a new antibiotic, we'll give you a temporary monopoly, but we really need you to just
not sell any, don't sell any of this. Except in cases of dire emergency. It's like a break
glass in case of emergency. I mean, I feel like a bounty, like every econ nerd storyteller loves a
good bounty, right? Wasn't this done with malaria vaccine, which is actually coming along quite well?
You have some universe of people say, we will pay a billion dollars to anyone who comes
up with a new antibiotic that meets this set of criteria, that treats this set of bugs
that are resistant to these existing antibiotics.
And we'll give you the money and you give it to us and we'll put it on the break glass in case of emergency shelf.
You've used the word bounty but what the term that is normally used is an advanced market commitment.
These were proposed most famously by Michael Kramer who's a Nobel Prize winner in economics
and basically the way this price, this bounty tends to get paid is as a kind of extra payment
on top of each dose you sell. So we'll
give you extra for every kid that gets vaccinated.
So we're back to the same problem in that universe?
Back to the same problem. But the reason why does it have to be like that? It doesn't have
to be like that. But the reason that they tend to be structured like that is because
you need to demonstrate some kind of market demand. Somebody needs to be willing to buy
your product. If they are,
we'll give you an extra payment for every product you sell. But that wouldn't work
for antibiotics. There's so many different ways in which science funding could be said
to be broken. But I think Dr. Couch is right to raise the issue. We need to do a lot more
of this kind of meta thinking about progress studies.
Tim, that was a lot of answer. Let's take a break. Cautionary Tales will be back in
a moment.
It all started with two federal agents who heard a rumor. She mentions, well, there is
this alleged murder to have taken place.
There was just one problem. They had no clue who the victim was.
We have to do our job, and we have to find out
who did they kill?
It had been 15 years since this alleged murder.
Was it still possible to unearth the truth?
I used to watch the Unsolved Mystery shows and I often thought about calling because
I was like, this is not right.
How can a person get killed and no one knows anything?
I'm Jay Calbern and this is Deep Cover, The Nameless Man.
Listen wherever you get your podcasts.
And if you want to hear the entire season right now, ad free,
subscribe to Pushkin Plus on our Apple Podcast show page
or on pushkin.fm slash plus.
And we're back. I'm Jacob Goldstein here with Tim Harford on Cautionary Tales. Hello, Jacob. More questions? What have you got for me?
All right, Tim, I got another one for you. It comes from Graham in Florida. Graham writes, I'm fascinated by errors made by falsely identifying correlation as causation.
What examples of this error stand out to you?
I love the question, but I'm going to slightly sidestep it because I'm worried by this question,
but I think that it's generally more complicated than simply, oh, some fool sawORA correlation and thought it was causation.
You don't want to talk about sunspots and crop yields?
Well, let's talk about Storks and Babies briefly.
Okay. A classic, a classic of the genre?
Yeah, the most successful book ever published about statistics, How to Lie with Statistics
by Darrell Hough, includes this example of Sts and babies and shows that there's a correlation between the number of stalks and the number
of babies. And there are various ways to demonstrate this correlation. One way to do it is you
just look at national populations. You go, hey, countries with lots of stalks also have
lots of babies. And there's a very, very strong correlation. But of course, the reason is
big places like the United States have a lot of room for storks and a lot of room for babies and small places like
Luxembourg or the Vatican City don't have a lot of room for babies and don't
have a lot of room for storks. So then you go, oh that's a great example of this
mistake. The sting in the tale of that story, as I describe in my book The Data
Detective, is that Darrell Hough, the guy who created that story, then
went on to tell the same story in congressional testimony saying that there was no compelling
evidence that smoking cigarettes would give you lung cancer. And it was just like storks
and babies. And he was actually hired by the tobacco lobby.
It was just correlation.
It was just correlation. They seemed about correlation. Or they seemed about the same.
Sure, yeah, there are people who smoke and there are people who get cancer, but there's
no causal evidence.
One theory was cigarettes are so soothing, and if you have some early symptoms of lung
cancer, maybe you soothe that with the soothing vapors of cigarettes.
I mean, it's completely ridiculous, but this sort of rhetoric was deployed.
And so one of the things I'm very concerned about in my work on statistics is that it's
great to be sceptical about statistics and to point out lots of examples of statistics
being misused, but if that's all you do, you just get to a, a kind of nihilistic situation
where you're just constantly rejecting statistical evidence.
Cause oh, it's just another of those damn lies and statistics.
When you look at the real world, I think this
gets to be incredibly interesting.
So a real hot topic at the moment is, are smartphones
destroying a generation, basically?
Are our kids having their mental health wrecked?
There's a new book that basically makes that argument.
Yeah.
A new book by a prominent academic.
Yeah, by Jonathan Haidt.
And there have been others by Gene Twenge.
And lots of people have said this.
And the evidence for it is mostly correlational.
Not completely.
There are some experiments, but they're not that convincing.
None of them are perfect, but there are lots of different ways
of measuring it.
And the really interesting evidence basically says, look,
there appears to be a mental health crisis.
The kids seem
to get really distressed, particularly the girls, when children have access to social
media on their phones. And that happens around sometime between 2010 and 2014. And at the
same time, suddenly you've got this outbreak of suicidal ideation, self harm, poor mental
health and so on. And that's correlational
evidence. I don't completely believe it, but I don't completely not believe it either.
I think that's what makes it interesting and makes it important to engage with. You
have to start going, well, what's the alternative explanation? Is there something else that
happened sometime about sort of 10, 12, 14 years ago that might explain this mental health
distress? So the timing of the great financial crisis probably not quite right. Donald Trump, maybe Donald
Trump is upsetting the kids. Timing doesn't work. So partly it's does the
pattern of the correlation make enough sense to explain this causal story? Which
funnily enough is basically exactly what the scientists finding a connection
between cigarettes and lung cancer were doing. They only had correlational
evidence for a long time.
They weren't running randomized trials saying, you know, half of you smoke and half of you
don't smoke.
I mean, they couldn't do that.
They had to look at correlational evidence and sometimes that's what we've got.
This question got me thinking about the rise in social science of what they call natural
experiments, right?
Trying to find instances in the real world
where you have something that obviously
is not as good as a randomized trial
because you just can't get that
with large numbers of people in the world,
but that gives you some element of randomization
or pseudo-randomization, something that allows you
to try and make the leap from correlation to causation.
And you know, this, as far as I know,
goes back to the Vietnam War, right,
where in the US there was a draft lottery,
and there were social scientists after the war
who looked and said, oh look, here are people
who are at an aggregate level, very similar
on many dimensions, socioeconomic dimensions.
We can look at people who randomly got drafted
versus those who
randomly didn't and who appear quite similar in the aggregate and see how
their outcomes differ. And that's a really good example of a natural
experiment because it's actually very close to a real experiment. Yeah, when you get a
lottery in the real world now, social scientists flock to it, right?
Similarly, there was one in Oregon some years ago with Medicaid, which is the
health care program for low-income people in the U.S. And Oregon got some new Medicaid funds,
and they randomly allocated them to a group of people over time, right? So that social
scientists could say, oh, look, here are people who are basically identical. Some of them got
this health insurance and some of them didn't. And in that case, the findings were quite interesting. Medicaid didn't appear to be
as helpful as I would have thought, as the researchers themselves would have thought,
according to the one I interviewed. It lowered mental health problems, people worried less
about money, but like their basic health outcomes didn't improve, which nobody would have guessed,
right? And the evidence is quite robust. When you don't have those lotteries, as you say,
the world is just hard to understand.
I mean, even in some instances
where you do have randomized trials,
people are complicated, the body is complicated,
society is complicated.
And so, you know, correlation in a certain way,
I think is underrated.
Like, yes, obviously it doesn't equal causation,
but it's a place to start looking, right? It's a place to start asking questions.
I think that's absolutely right. And we need more randomized experiments. There are more
opportunities to run them than people seem to think. For example, one of the things that
John Height in his book is arguing for is, you know, you shouldn't have smartphones in
schools. Schools should be phone-free zones. I could completely imagine a state saying we're going to introduce a rule whereby in all of the schools in the state, no
smartphones, strictly forbidden, you have to put them in a locker when you show up
and then unlock them at the end of the day. You could introduce that rule and
just go well we're going to introduce it for a semester at random in 50% of the
schools and then we'll introduce it in the other 50% of the
schools in the next semester. And we'll just randomise that, because we want to know whether
there's any point in this experiment or not. That's not very difficult to do. It would
create so much information about children's performance in the classroom, their mental
health, that could inform policy across the world.
That would be the dream. You know, there is now a robust set of methods, essentially, where social scientists could
look at that state and compare it to neighboring states and see the difference in differences,
as they say, see the change over time.
And that's an instance where it wouldn't be as elegant as randomizing within a state.
But I feel like you could start to get pretty good data data even if you did one state compared to other states.
Yeah, if you've got no experiments, we should run them.
If we don't run them, there are still ways of making correlation talk.
Should we have another question?
Okay, Tim, we got one more.
We had to have one game-related question for you.
Oh, great.
Yes, you're welcome. This one comes from Joost, who writes, Hi Tim, diving into the board
game shaped flank you've now exposed for discussion. That is a very gamerish way in. What board
games or board game mechanisms that you enjoy are particularly insightful on some aspect of real world economics, offer a unique
angle to look at a maybe niche problem, and what non-D&D games are you particularly enjoying
right now? Love the show however many episodes you produce. That is a listener we all want.
Thank you, Joost.
Yeah, so kind, Joost.
There are a couple of mechanisms that I do see used quite often that shed important light
on economics.
So one is trading.
A lot of games involve trading.
Now, Monopoly, that classic of sadly not a very good game, there's a cautionary tale
about the history of Monopoly if people want to listen.
Monopoly, in theory, involves trading, but in practice not a lot of trading happens.
It turns out that you need to give people a reason to trade.
The great modern game Settlers, now about 30 years old.
By the way, Settlers, I assume that's Settlers of Catan as an outsider, not on a first name
basis with the game?
Settlers of Catan is the game.
It's the game that Monopoly wishes it was. It's like if Monopoly had been designed
with a modern eye to be super exciting. People need different resources and the supply of
resources fluctuates. So sometimes you've got loads of wood, sometimes there's no wood.
So there's an active incentive to trade all the time. Oh, and by the way, if you don't
trade every now and then the robber baron comes and takes stuff. So there's an interesting
insight that trading doesn't just happen because it's allowed. There needs to be some difference
in value and perhaps some incentive to get on with it. So my personal favourite game is
Agricola, a wonderful game about developing a farm, which doesn't sound promising but it's
really really good. But one of the clever things about Agricola is it uses an auction in an
interesting way. It's sometimes called a uses an auction in an interesting way.
It's sometimes called a descending clock auction or a Dutch auction.
The prize gets more and more tempting.
So in Agricola there's just more and more good stuff on the board.
In a traditional descending clock auction basically the price is going down and down
and down and down.
And everyone is just sitting there and then it's a question of who grabs it first.
The longer you leave it the better it gets, but then only one person
can have it. It's very, very elegant. They sell flowers at Aalsmeer in the Netherlands
and it's just incredibly quick, much, much quicker than selling say art, you know, you're
selling a van Gogh. The price rises and rises and rises.
So auction design is the whole thing, right? Yeah.
When would you choose a traditional prices going up eBay art style auction in the real
world and when would you choose a Dutch prices going down auction?
What do you get in a relative sense out of each one of those?
There's a couple of differences.
One is that in certain types of ascending auction, you get to see people dropping out
as the price rises.
It depends on the way the auction is designed.
But you could imagine an ascending auction where you just see people going,
no, I'm out, I'm out, I'm out.
Sort of the classic kind of art auction in a movie.
Yeah, and so you're learning information as the price rises.
How many people are still interested?
Are there still 10 people interested? Is it just two people?
Right.
So that generates information.
By generating information, it might raise the final price overall. The advantage of the descending auction is
it's just so quick. You can run an auction in 10 seconds. It's a hundred
thousand tulips, here are the tulips, we're gonna sell them for whatever 10,000
euros, 9,900, 9,800, 9,000 and it's just literally a clock. The clock just
runs around showing what the
price is and then someone presses the button, sold, okay, now bring in the roses. So it's
very fast.
You would want to have a good idea of the market clearing price if you were going to
run that kind of auction so that you didn't sell it for too cheap, right? It's fast but
you run the risk of selling it for too cheap. But if it's just commodity tulips then you
basically know the market clearing price anyway.
Yeah, it's almost like a stock market for tulips. That I think is why it works so well.
Whereas if it's a unique work of art, you need to give maximum information, maximum
comfort to people, maybe a little bit of theatre as well. We're not in a hurry to run this
auction. The cost of the auction itself is trivial compared to the value of what's being
sold.
Now we go over to Agricola and have a descending auction. It feels exciting and it also feels
like you're trying to guess what is in your opponent's head, right, because they're not
revealing it as they would in a descending price auction. You have to think, oh, what
are they willing to pay for it?
Absolutely. And it works slightly differently, but functionally what's going on is that every
turn you take, you get to grab some resource on the board. And then once you've grabbed
the resource on the board, no one else is allowed to grab it until the next round. And
there are several moves you can make in each turn. So you might be able to get two or three
things each turn. And so you go backwards and forwards, it's your move, it's my move.
And each time we want to grab something, and you might go, well, do I want to grab it now, or do I want to wait until next turn where it
might be better? And you're trying to figure out, like, what is the thing that the other
person is desperate to have? Can I just let this pile get bigger because they can't afford
to take it because they've got to use their move on something else? It's a very, very
clever game. I do enjoy it. You also asked what non-D&D games I am enjoying.
I am enjoying a modified version of Blades in the Dark,
which is a classic role-playing game, very fast-moving.
You get to do Ocean's Eleven or other kind of heists,
and it's very modifiable.
We're speaking on Monday, just yesterday on Sunday,
had a whole bunch of old friends around to my house and we just played this game all
day and we had an absolutely terrific time.
I feel like you're living the dream, Harford.
Makes me happy.
Living my best life.
Jacob, this has been such fun.
Thank you so much for doing this.
Ah, it was a delight.
I'll come back any time.
We would love to have you back.
Thank you everybody who sent in a question. Sorry we
weren't able to answer all the questions, but we are going to be back with another cautionary
questions episode later this year. Please do keep your queries coming. Send them into
tales at pushkin.fm. That's T-A-L-E-S at pushkin.fm. I will be back with another cautionary tale
in two weeks time. Jacob Goldstein has
a wonderful podcast called What's Your Problem. Thank you Jacob.
Thanks Geoff.
Cautionary Tales is written by me, Tim Harford, with Andrew Wright. It's produced by Alice
Fiennes, with support from Marilyn Rust.
The sound design and original music
is the work of Pascal Wise.
Sarah Nix edited the scripts.
It features the voice talents of Ben Crow, Melanie Guthridge,
Stella Harford, Jemma Saunders, and Rufus Wright.
The show also wouldn't have been possible
without the work of Jacob Weisberg, Ryan Dilley,
Greta Cohn, Letal Mallard, John Schnarze, Eric Sandler, Carrie Brody and Christina Sullivan.
Cautionary Tales is a production of Pushkin Industries. It's recorded at Wardour Studios
in London by Tom Berry. If you like the show, please, remember to share, rate and review. It all started with two federal agents who heard a rumor. She mentions, well
there is this alleged murder to have taken place. There was just one problem.
They had no clue who the victim was. We have to do our job and we have to find
out who did they kill. It had been 15 years since this alleged murder.
Was it still possible to unearth the truth?
I used to watch the Unsolved Mystery shows
and I often thought about calling
because I was like, this is not right.
How can a person get killed and no one knows anything?
I'm Jake Halpern and this is Deep Cover, The Nameless Man.
Listen wherever you get your podcasts.
And if you want to hear the entire season right now,
ad free, subscribe to Pushkin Plus
on our Apple Podcast show page or on pushkin.fm slash plus.