Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 150 | Simon DeDeo on How Explanations Work and Why They Sometimes Fail
Episode Date: June 7, 2021You observe a phenomenon, and come up with an explanation for it. That's true for scientists, but also for literally every person. (Why won't my car start? I bet it's out of gas.) But there are litera...lly an infinite number of possible explanations for every phenomenon we observe. How do we invent ones we think are promising, and then decide between them once invented? Simon DeDeo (in collaboration with Zachary Wojtowicz) has proposed a way to connect explanatory values ("simplicity," "fitting the data," etc) to specific mathematical expressions in Bayesian reasoning. We talk about what makes explanations good, and how they can get out of control, leading to conspiracy theories or general crackpottery, from QAnon to flat earthers. Support Mindscape on Patreon. Simon DeDeo received his Ph.D. in astrophysics from Princeton University. He is currently an Assistant Professor in Social and Decision Sciences at Carnegie Mellon University, and External Professor at the Santa Fe Institute. Web site Carnegie Mellon web page "From Probability to Consilience: How Explanatory Values Implement Bayesian Reasoning," Wojtowicz and DeDeo Axiom of Chance blog Google Scholar publications
Transcript
Discussion (0)
Hey everyone, it's Cal Penn.
I'm inviting you to join the best-sounding book club you've ever heard with my podcast,
Earsay, the Audible and I-Heart Audio Book Club.
Every episode, I nerd out with amazing guests and dive into the best new audiobooks available on Audible.
It's the book club for your ears.
Listen to Earsay, the Audible and I-Heart Audio Book Club.
On the I-Heart Radio app or wherever you get your podcasts.
From the neon lights of the club to the harsh, buzzing lights of the
office. Don't let the wear show on your face. Just swipe
Mabeline instant eraser concealer to erase the night before, wherever that happens to be.
Instantly covered dark circles and under eye bags for a brighter, more awake look.
This do-it-all formula also contours, corrects, and highlights, all while staying lightweight,
crease-resistant, and smooth. It may be the world's greatest eraser. Find your shade of
instant eraser concealer at your local retailer. Hello everyone. Welcome to the Mindscape
podcast. I'm your host, Sean Carroll.
Obviously, on a podcast like mine, we're often going to be talking to scientists of various sorts, theoretical scientists in particular.
Some of my favorites, not all of them, but a lot of times we're talking about the ideas for how we might explain some scientific phenomenon, right?
Coming up with a new theory, whether it's dark matter or evolutionary biology or whatever it's going to be.
You might remember, in fact, that I had Lee Smollin on the podcast very recently, and despite the fact that we work in very similar areas,
and we're personally very friendly,
we have different ideas about how to go about building
the better next generation scientific theories.
Why is that?
How can two scientists who are both more or less trained in the same way
come up with very different preferences
when it comes to building new explanations?
That's what we're on about today on today's podcast
with Simon Deo.
Simon actually started as a theoretical cosmologist,
much like myself,
but he switched into some combination of statistics
and data-driven social science and cognitive science.
So it's a wonderfully difficult specialty to pin down,
but he's both at Carnegie Mellon University and also the Santa Fe Institute.
So we overlap a lot in our intellectual interests.
And what Simon talks about in the paper that we're going to be discussing today
is how explanations work.
And honestly, explanations in this sense is kind of a synonym
for a theoretical viewpoint or formalism to answer some kind of question, right?
So you have some phenomenon, whether it's my car broke down or there's dark matter in the universe, and you want to explain it.
Now, what happens is you can invent an explanation and different people will prefer different kinds of explanations for different reasons.
So what Simon and his collaborators have done is to break down the different parts of Bayesian analysis that go into making a good explanation and sort of quantify different preferences or different values you may have for choosing your personal preferred kind of explanation, right?
Explanations have different kinds of good aspects.
An explanation can be simple.
It can be powerful.
It can be close to things we already understand.
It can explain many things at once, right?
These are all good things, but sometimes they fight against each other.
Sometimes an explanation can be simple but not powerful.
It's simple for only one phenomenon.
Or it's both simple and powerful, but utterly different than anything we know.
So how to balance these is kind of a human subjective thing, right?
And we talk about both how scientists actually do this when you have legitimate scientific disagreements,
you know, the many world's interpretation of quantum mechanics versus the Copenhagen interpretation,
or pilot wave theories or something like that,
what are the different values that the practitioners have
that allow them to prefer in an intellectually respectable way
these different explanations in a situation where we don't know which one is right yet?
And what's fascinating about Simon's analysis is
it goes beyond the case where everything's working, right?
You know, I can say that I like many worlds as my favorite theory,
but I have absolute respect for people who don't,
if they have principled reasons for preferring some other things,
sometimes people pick wrong explanations because they're failing at balancing these different kinds of values.
So there's sort of a continuum between high-level scientific discourse about unknown theories
and complete crazy talk, conspiracy theories.
You know, why do people believe Q&N or that school shootings or false flag operations or something like that?
Well, you can understand that in terms of them putting all of their eggs in one explanatory basket,
all of their values are concentrated on comprehensiveness and rather than simplicity or something like that.
So it's not just that there are sensible people in crackpots.
There's a continuum of ways that we can try to explain the world,
and you can try to analyze the similarities and differences between conspiracy theorists
and the world's best theoretical physicists, okay?
It gives you a lot of food for thought about how we go about explaining things in our everyday lives.
So with that, let's go.
Simon Dedeo, welcome to the Mindscape Podcast.
Hi, Sean.
So we've had a lot of people, at least a few people, talking about misinformation, disinformation, conspiracy theories that people fall in love with, things like that.
And I think that what we'll be talking about today, you'll correct me if I'm not getting this exactly right, but rather than focusing on that, you know, the huge wrongness of believing in a conspiracy theory or a crackpot scheme, we're thinking about explanations more.
broadly and saying that there are people who believe in conspiracy theories or crackpot
schemes, but their kind of belief, the way they justify it, et cetera, is of a piece with
perfectly respectable scientific beliefs.
We should sort of, it's a matter of balancing things here and there rather than a matter
of a completely different way of thinking.
Is that fair?
Yeah.
You know, we've been working on these questions for a while, and one of the inspirations for
me at least was a couple years ago now.
David Deutsch wrote a book called The Beginning of Infinity.
Right.
And this is a lovely, it's a lovely book.
It's nuts, but it's lovely.
And, you know, Deutsch really focuses on something that I had sort of thought about,
but not as clearly for many years, which was this idea that you explain things, right?
And that explanation is not simply, you know, something we do to feel better about the world,
but it's actually this enormously generative process.
You know, we had this problem.
You know, there was this puzzle for me when I first started working outside of physics
because people in biology want to predict things,
or at least the outside world wants to predict things.
Biologists themselves don't usually.
When we work on social behavior, people want to say,
can you predict the next war or whatever?
And so Deutsche really crystallized for me the way in which that's not actually what this game is about.
And not only is it not what this game is about, it's like, that's okay, right?
So, you know, the fact that we can't predict things, you know,
especially not about the future is not a sign that we're doing something wrong,
but this time we're doing something different.
So, you know, Deutsch, that was the sort of way in,
and that kind of percolated in my head for many years.
When I got to CMU, I started working with a graduate student, Zach Woltowich.
And, you know, Zach and I played around with a lot of different ideas.
And we started to think about, you know, could we build a theory of explanation making?
You know, this, you know, actually there was another impetus for this, which was, is a logician at CMU at Debbie Borg.
And so Debbie and I talked for a while about, there's this joke, right, why do mathematicians try to prove things they already know are true?
Right.
Like this is the worst, you know, science is about producing experiments with uncertain outcomes.
So, you know, what's the goal of a mathematician?
You know, no one shocked when Fermat's Last Theronum has no solution, right?
And so, you know, Devin and I talked about this.
And, you know, so, and, you know, just to dig a little into this,
in science, people have, let's say, tried to even formalize what the next experiment you should do is.
Right?
So this is called optimal information design or goes by any different terms.
So you can say, you know, should we build, you know, the next,
Hubble Space Telescope or should we build the LHC, which one is going to give us more information,
right? And so you pick the one that will give you more information. The one thing you shouldn't do
is do an experiment where you are guaranteed to know the outcome. Yeah. So then, you know, we talk and,
you know, Debbie and I talk and you say, well, what's, why does a mathematician care about proving
something they already know is true? And, you know, Debbie's answer is, you know, something like P versus
NP, right, these really challenging problems. One of the intuitions is that the solution is,
is going to discover unexpected connections
between very different branches and mathematics.
So it'll give us a new view onto things
we thought we understood because of the way
in which these different chunks have to be brought together.
So go on, John.
This is very relevant to my interests, as they say, on the internet,
because of course, in quantum mechanics,
we have a situation where generations of physicists
have been brainwashed into thinking
that we don't need to understand what's happening,
all we need to do is make the predictions
for the outcomes of observations.
And the counter example I try to say
is, look, what if you had a black box
into which you could ask
literally any outcome
of a specific physical situation?
Does that count as solving all of physics,
right? You know, anything you want to know,
but you have to re-ask it. It doesn't tell you what the theory is.
It just tells you, when you collide these two billiard balls,
they scatter off at this particular angle.
I don't think that counts as a good theory of physics.
We want the theory for reasons beyond that.
Right, right, right, right.
Right.
So, you know, if we're building a theory of how to, exactly how to shake the box,
like we have a goal in shaking the box in a certain way, right?
And then the question is, yeah, what's the goal?
How do we know when we've reached that goal?
How do we know if we're on the right track?
And so, you know, someone like Deutsch, you know, articulates this fact that, you know,
what we care about is explanations.
Then, you know, Zach and I dig in and we say, all right, let's try to build, you know,
and this is a joke here, right?
Let's try to build a unified theory of explanation making.
And, you know, this then, this then rolls into a year of enormous fun, right?
Trying to make sense of the ways in which you have a whole bunch of different experiments that we do.
For example, lab experiments on people in, you know, in a psych lab, right, where we say,
and this is not my work, Tonya Lombroso is one of the big figures in this.
So, you know, you might tell somebody, okay, look, there's this alien, right?
These aliens and, you know, they fall victim to these kinds of diseases and this disease gives these symptoms and that disease gives that symptom.
And, you know, this alien comes into your consulting room and he has, you know, spots and a cough and, you know, diagnose this alien.
And you can look at the different choices people make.
in a sense, a diagnosis by proxy is an explanation for the symptoms that the person brings in
or the alien brings in. And so by looking at the choices they make in attributing, let's say,
a pair of diseases or a single disease to the alien, you learn a lot about the kind of preferences
we have, the ways in which we select explanations one from another. And let me just, to be super
duper clear, we're using the word explanation here, almost in the sense of a theory or a model, right?
It's not like someone says, well, explain black holes to me.
And we think we know what black holes are, but there's this pedagogical attempt to explain them in a comprehensible way.
You're using the word explanation to really mean knowledge of what is going on behind the scenes that can help us.
And then we can sort of choose between competing explanations that can't all be right.
Right.
So this is great, right?
So, you know, our model is a Bayesian model, meaning we ask questions.
about the things we have to hand, let's say the facts in the world, and we ask the ways in which
they match the models we have with the world. And so it's a very specific kind of model. It's a generative
model, which says it gives you degrees of belief in the things that could happen. So in that sense,
you know, we've really boiled it down to a paradigm that, you know, in one sense, it doesn't really
match any kind of science we do, right? Like, you know, condensed matter physics is not a generative
model in the sense that it specifies the probability of different things happening.
Sorry, what is the definition of a generative model?
Right.
So a generative model tells you not just the things that might happen or the things that could
happen, but also gives you degrees of likelihood for the different things that could happen.
It's a way you can think of it as like a mini simulation that you have controls over.
So you can see inside the simulator.
And that simulator, you push a button and it projects a possible world under the screen.
Right.
So, but you ask this, you know, when you ask, Sean, what is an explanation more broadly?
Um, uh, this gets into a big question that let's say, uh, we can split into two parts, right?
An explanation has to do with empirical facts.
Right.
It's, it's a way of accounting for stuff that has happened, right?
Or stuff you know.
Um, but it's all.
also an account of how that stuff could have happened.
And generally, it's an account of other things that might happen, other things you could look for, other things that could happen in the future or happening somewhere else.
So there's sort of two pieces when we think about an explanation.
One piece, when we evaluate one, right, one piece is, you know, you asked me to explain this, right?
Can you?
meaning can you tell me a story in some way in which the thing that happened comes true?
Yep, sure.
Right.
So that's kind of this empirical piece, right?
And then this other piece that's sitting there, which is this much troubling piece,
is how do I feel about the larger structure of that explanation, including the things it might do for things that could happen in the future, let's say, things that I haven't observed yet?
Also things like, what does the explanation look like?
How succinct is it?
How concise is it?
versus how elaborate it is.
So when we refer to things like Occam's Razor,
what we're talking about is that second chunk, right,
of the ways in which we might value an explanation.
Hiring people for your business is as much about who you say yes to as who you say no to.
But it sure helps when you can narrow down the list to only really great choices first.
So you're not choosing between good and bad, but good and great.
That's what you get with Indeed.
Indeed is the job site that makes hiring.
as easy as one, two, three. Post, screen, and interview all on Indeed. You can get your
quality shortlist of candidates whose resumes on Indeed match your job description faster,
only pay for the candidates that meet your must-have qualifications, and schedule and complete
video interviews in your Indeed dashboard. Indeed makes connecting with and hiring the right
talent fast and easy, with tools like Indeed instant match and indeed skills tests, that on
average reduces hiring time by 27%. You can choose for more than 130 skills tests, then add your
must-have requirements so that you only pay for applications that meet them. Get started right now with a
free $75-sponsored job credit to upgrade your job post at Indeed.com slash mindscape. That's a $75
credit at Indeed.com slash Minescape. Offer valid through June 30th, Terms and Conditions apply.
And in some, this is going to be very vague and then you'll fix it.
But one of the nice things about your way of talking about explanations is it is Bayesian, like you said.
And we talk about Bayesian stuff on the podcast all the time.
So the folks have heard the term.
But all we really need is the idea that there's a prior, there's some pre-existing probability or credence that the model is right.
And then you update because information comes in.
And what you do in some sense is sort of decompose those two parts, the prior part and the likelihood part, into different values that an explanation can have. Is that fair?
Right. Yeah. So, you know, we put explanations into the super collider. We spin them really fast. And it turns out that what we thought, right, were two things. They're actually, let's say, at least four things.
Tell us what the four things. And sorry?
Tell us those four things.
I will tell you.
You know, the human curiosity is infinite, right?
So, and, you know, of course, what does it mean to diagnose or to discover these subpieces of a mathematical equation?
You know, what we're really doing is saying this piece picks up on a psychological value, right?
So, in fact, our minds are sensitive, let's say, not just to the prior and the posterior, right?
the things you knew beforehand and how well you do on the next bit, but also these little pieces, right?
So, for example, in the case of the empirical side of the evaluation of explanations, we split in the two pieces.
One is descriptiveness, we call it.
Descriptiveness is just how likely is the stuff that happened taken individually given your explanation, right?
So I've got a whole bunch of things that happen.
I want you to explain, right?
You give me an explanation.
If I pick, let's say, any piece of what I've seen at random, how well does the explanation
doing?
So as opposed to, sorry, let me back up, because we're trying to convert into words something
that is mathematically very clear if we could see the equation in front of us, which we can't.
Right, right.
So in the, in basis theorem, there is this idea of the likelihood, which is to say the probability
that you would be getting that evidence if this particular explanation was.
were the right one.
And I think what I hear you saying is,
yes, that's a thing,
but we're going to divide that up.
We're going to divide this probability
of getting the evidence given the explanation
into first the probability of getting
this particular piece of data.
Is that right?
That's right, yeah.
Okay.
So, you know, I have a story about, let's say,
gosh, now I'm on the spot.
Let's think of a good one.
I have a story about why my food tastes this way, let's say.
And it's hot and it's salty, right?
So I have a certain explanation and let's say that it's hot and it's salty because I put it in the oven.
Now that explanation does really well to explain why it's hot, right?
It doesn't do so well to explain why it's salty.
I might also say it's hot and salty because I put it.
put it in the oven and then I salted it, right? So now, okay, I've, what I've done is that I've
explained two things in the world. In some sense, I've explained them somewhat separately.
Yeah. Right. So I've, I've accounted for this fact with this part of the explanation,
this other fact with this other part of the explanation. And in that case, sort of trivially,
the only value, the only empirical value there is what we call descriptiveness, because it does just as well
explaining one part of the data as the other part, as in fact both parts together.
Good.
So there's a different piece, though, here that's coming in or that comes in, which is,
and maybe this is a better way to say it, Sean, some explanations link things together.
Right?
Some explanations not only say what's happening, but also say this thing happening is in some
way correlated with this other thing happening.
Right.
So I can put food in the oven, right?
Or I can salt the food.
But these two things in that explanation aren't really dependent upon each other.
Right.
Right.
So my explanation hasn't linked together these two things.
Right.
There are explanations that do link things together.
So, and I mean, I know you're more of the foodie than I am, right?
Like, don't you like salt crust and cook something, right?
Like there's some way that like when you cook something and salt, it's
better. I don't know. Help me, Sean.
Right. Let's imagine there is.
You picked a tough example. I think of the best
explanation I can think of is you put salt
in it and then you put it in the oven. Sorry.
Sorry. Put it in the oven. Right, right, right.
Maybe you're cooking it in like pure, like
literally sodium, right?
You know, maybe you're cooking at Pittsburgh style,
right, where the salting and the heating
is something that, you know, has to go together.
In that case,
the reason it's hot and it's salty
is it's being cooked in Pittsburgh style.
But the...
And if it's, yeah.
So I think that we would agree.
So good.
So what we're doing here is taking terms and an equation, basis theorem, and we're relating
them to human values.
We like it when, if you just said on the street, do you like explanations that cover many
things at once and link them together?
People would say yes.
And now you're able to identify where that value is expressed in basis theorem.
But what's interesting to me here is that this idea.
that the explanation can link the data together is in what you're calling the empirical part.
It's not in the prior.
It's not just part of saying, well, it's a simple cohesive theory of everything.
That's ordinarily what I would think of as living in the prior credence before we collect any evidence at all.
Right, right.
So this is great.
I should say, Sean, I have a better example, which I think will work much better.
So we could rewind or should we just plow on.
Plow onward because we can see the gears turning.
It's good for people.
Okay, good, good, good.
We can, thinking live.
So your intuition is not crazy, right?
There is something about this feature we call co-explanation,
which is how it links things that we've observed together.
And that seems to be linked to just how the theory would do in general, right?
That's something we call, in fact, we have a name for it.
We call it unification.
The critical part here, and this is, you know, it's in some sense a trivial distinction, is that co-explanation only deals with the facts you have to hand.
Okay.
Not necessarily the facts that you could get in the future, right?
So it's simply, you know, somebody presents you a scenario or a situation with a bunch of features in it.
He may also present you with different kinds of explanations that make the observed things,
dependent upon each other or not.
Okay.
Right.
So it's, you know, in some sense, it's this very, you know, sort of blinkered view of the world.
It's only one part.
So it's, you know, what do we have so far?
In other words, let's imagine that there were 50 different ways I could characterize the food I'm eating.
And I had a theory that only had two inputs that explained all 50 of them.
But if the two that I had actually measured were saltiness and,
and heat and those two needed both the two inputs to explain them, then at that level,
I haven't really co-explained anything, even though the theory in itself was quite simple
and unified for these particular data, it was not doing that particular value.
Right, exactly. So your theory would be, let's say, high in unification. Right. It's making a lot
of promises, right? It's tempting you, right? It says, you know, let's go out there and see. And,
you know, at some point we're going to come up to the dark side of this. So QAnon certainly has this
feature. It's like, you know, there's a lot of things that might be linked. And I wonder what
you'll find if you look for yourself, right? So there are these kind of promises that theories make.
And the promises, of course, they're deeply satisfying when they pay off, right? And so I think about
when I teach, that co-explanatory moment is a lovely moment, right? It's, you know, you've thought this,
like I've been telling you this. Now check this out and you pull, you know, you pull away the curtain.
And lo and behold, people see this thing in a new light and they understand the old thing and the new
thing as being somehow linked together. I remember telling my friends in undergraduate school,
you know, what I learned is that when you do a Lorenz transformation in special relativity,
like you move to a different reference frame.
It's just like doing a rotation in space,
except it's in space time.
And you could see them go like,
oh, why didn't they tell us that?
That's awesome, right?
Like it's unifying these two different things.
Yeah, I mean, I, you know, so it's funny.
I'm trying to think of a better example.
So let me give you one so we can maybe use it as we go forward, right?
Instead of food, let's see being hot versus salty,
let's imagine you have an undergraduate.
Okay.
And you see they've taken a class in, let's say, French and a class in neuroscience, right?
And so, you know, one explanation is they're interested in French.
They're interested in neuroscience, right?
So these two facts are not dependent upon each other.
You can basically like French, independently of neuroscience.
But another explanation would be this is a linguistics major.
Right?
And now, aha, okay, right?
there is now this common explanation that says they're a linguistics major, the fact that you took
neuroscience is connected to the fact that you took French, right?
The discovery of majors, right, enables you to make sense of what all the undergraduates
were doing in that school, these kind of hidden common causes, driving the classes they're
showing up.
So I think I am getting it.
The virtue or the value that we're pinpointing here is not just the simplicity of the underlying
explanation, but the fact that it relates these two particular facts that we have seen.
It's not just that it explains both.
It actually relates them to each other in a powerful way.
One doesn't move if the other doesn't move, right?
That sort of thing, right?
You know, you have a sore throat and a runny nose, right?
One answer could be you have allergies and you were screaming, right?
Another explanation could be you have one of these things, right?
You have a virus.
Good sort.
Okay.
There's one thing I want to put so it's funny because you you you did the same thing I did when we first started working on this which is you said oh and a co-explanatory theory is also a simple one
But it's not right so you can have some enormous cascade
Of coincidence or you know of like I'll tell you why you know the bus was late and you know your watch was broken
It's because there's a malevolent conspiracy
that is, you know, chasing you through the world, arranging things so that the guy who fixed your watch, timed it to break and stop the bus. And yes, that does make these facts in the world dependent upon each other. It's a deeply non-simple theory. Or even if you just had a hundred different kinds of data and your theory was that data one is correlated in this way with data two always and data two is always correlated with data three in this way. And it just goes one with a hundred different correlations independently.
then you've co-explained everything,
but you don't have a simple theory.
You've co-explained the pairs, right?
So if you think about it, right,
like now just imagine
filling out that pyramid, right?
So these two things are co-explained by this cause
and these two things are co-explained by this cause.
Those hidden things there, those two causes,
maybe they're co-explained, right?
So now you get this like big branching tree
where, you know, everything goes back to, you know,
the godhead or something.
But your instinct's not wrong, right?
Because, you know, if you're,
your first thought was, wow, what it's simple. It's kind of cool, right, that these two things are
dependent upon each other. And I think now it's kind of a nice situation here where we see that
the things we like may lead us astray. Yeah. Right. If somebody, you know, leads you to perceive
these two things are correlated, we kind of like it, right? We think, oh, you know, that's elegant,
that's simple. Simplicity is a value, right? But, you know, let's hold on a second, right? Because maybe there's
some other pieces here that are in play, right?
And this, of course, this was the Odyssey of Discovery for us,
is realizing that a lot of things that we think of as values are, you know,
or a lot of things we think of as good things are actually combinations of values, right?
And they're combinations, let's say, of well-weighted values, right?
So this is, you know, you want to cook a good explanation.
Don't put, you know, too much fish sauce in, right?
Like a little goes a long way.
And so, you know, so it was difficult for us at first to kind of break apart our own values.
I mean, I won't speak for Zach.
But for me, it was difficult to break apart our own values to start to see how things, you know, could go right or could go wrong along each of these axes.
Well, that's right.
So these are values.
And not only just value neutral values, but they're good values.
We would like to be able to co-explain.
We would like to be able to be descriptive.
But they're going to compete against each other.
That's going to be the trick.
So we have on the table, descriptiveness, co-explanation, what are the other values?
Excellent.
All right.
So let's sweep over to the, let's call it the theoretical side, the theoretical values.
Those were the values of the theory.
And now we're doing the theoretical side.
Exactly, right.
So, you know, descriptiveness, co-explanation, it's all about, you know, show me the money, right?
Show me the data.
Let's see what the explanation is doing for the stuff that's causing us all these problems.
So then let's go over to the theoretical side.
We split this into two parts, right?
One part we called domain dependent value.
Let's, I'll tell you what I promise.
I will tell you what that is in the second.
The other part we called, and you'll be happy sharp,
we call this simplicity.
That's good.
Right.
So let's dig into the easy one, which is domain dependent value.
Domain dependent value is your intuitions just about the stuff,
the explanation is about, right? So, you know, the example of the car mechanic, right? You bring your car
in and it's like, oh, yes, it's a Volkswagen those years. It's the installation that goes bad, right?
So these kinds of experiences, their intuition, it's tacit knowledge, it's all of these things
that go into your sense of how the world works in this domain, right? So most of our domain
independent values, they're invisible until you change fields, right? And you'll get really upset
because you present a biologist with a theory that explains all the data and it's really beautiful.
And they're like, that's just not how life works. Like it just doesn't work that way. And you're
like, tell me. And they're like, you have to actually do this for 10 years, 20 years. So that's a
real part. It's a real part that's sitting there. It's obviously a bit harder to study in the lab.
because either everybody has the same domain dependent values.
We all have the same like folk physics, folk biology,
you know, sort of stories about the way the world works.
And then, of course, in the things we know very well,
we have very specific values.
But it's, you know, it's tough to get enough car mechanics in the lab
at the same time to understand how these values play off.
So, I mean, is this, how does this relate to the idea
that if we have a new idea or some specific explanation,
it should try to cohere and be compatible with things
that we already think are true elsewhere?
Is that the same idea or related idea?
I think we really wanted to keep this kind of simple, right?
We wanted to say, this is just how likely do you think explanations of this pattern are?
You may have some deep theory, right?
But let's go back to the car mechanic, right?
There's, you know, 50 different models of cars.
You work on cars long enough.
You learn that the Volkswagen has this insulation problem,
and the Subaru tends to have a piston problem.
this is not fitting into some grand theory about car manufacturing and, you know, the,
the industry. It might if you were a certain kind of car mechanic, but by and large, you know,
you're working off of, you know, let's say, you know, doesn't have to be stimulus response,
but just things you've noticed and remembered. Maybe there's some pattern recognition involved.
But we really wanted to kind of keep this as almost an untheorized chunk, right?
these are the things that make the biologists say life doesn't work that way and then you say why and they're like i you know get out of my office right
it's one thing to start exercising again it's another thing to keep it up as a regular habit with world-class instructors curated music and endless fitness variety peloton has created an unmatched fitness experience to keep you motivated workout after workout with epic artist collaborations and instructor curated playlists
Peloton's music experience is unlike any other.
Whether you're in the mood for some hip-hop, pop, or country,
the Peloton bike has the right music to keep you entertained and motivated all year long.
And whether you're looking for some extra encouragement,
structured workouts, or just in the mood to laugh,
the Peloton instructors are there to bring out your best during each class.
From beginner programs to Tabata intervals,
Peloton meets you at every step in your fitness journey.
As you progress, choose from a wide range of cycling class.
that meet your level and keep you challenged every time you clip in.
So get started on your Peloton journey.
Go to OnePelon.com to learn more.
That's O-N-E-P-E-L-O-T-O-N.com.
So let me try another example.
So you and I both used to be cosmologists.
We've moved on in our lives.
But something that cosmologists often do is to say,
well, maybe there's some scalar field or some modification of gravity,
some new fundamental physics that stretches out
that affects things in galaxies and clusters
that we've never noticed here in the lab.
And you tell this to particle physicists
or to quantum field theorists,
and they're like, no, effective field theories
don't work that way.
You don't have weird things showing up
at long distances in the infrared
that wouldn't show up at short distances.
We're pretty confident in the long distances.
Is that an example?
That's a good example.
I think let's push even further way from, you know, particle physicists, let's say have stories
about how effective field theories work. But, you know, okay, you want a physicist? I'll give you a
physicist. So Scott Aronson has a wonderful blog post about why I won't read your proof that
P equals NP or P not equal MP. Right. Right. And, you know, it's a kind of long list, right? And
none of these, and I actually have to remember, but, you know, most of these reasons do.
not involve his theories about the way P versus NP work, right?
Sure.
These, these, you know, one of his great examples is, if you're using mathematics that I just
don't think is powerful enough, right?
Like category, no, right?
Category theory is not going to do this.
Now, it isn't because, you know, Scott has tried or has some great theory about why category
theory won't work.
He's just like, that, you know, it's, that's, you know, it's great, but it's, that's, it's,
It's just sandbox stuff compared to what you would need.
Well, Scott, of course, former Mindscape guest.
More recent Mindscape guest, Julia Gallif,
she and I were talking about how one deals with crackpot theories in physics.
And the point being, so I have a way of dealing with crackpot theories in physics as a physicist,
but she says, you know, she's not a physicist.
So how should she approach grandiose claims from people she doesn't know?
And because she's not a physicist, she has to rely on signals from the
person who has the theory, right? Like, do they recognize the problems that their theory has? Are
they willing to say they might be wrong? Or are they just like, no, I'm oppressed by the system,
and I'm a genius that no one else has ever been before? And so, I mean, that's a different kind
of domain-specific knowledge, right? It's almost like the psychological domain. Like, what are the
features that you're likely to have in a crackpot versus a respectable scientist?
Exactly. I think that's even, that's a nice example because it really gets at the un theorized version here, right?
So, you know, and then there's nothing wrong with the GeoCities webpage in the 1990s, like John Baez had a GeoCity's web page.
And he talked about like the fundamental theories of physics.
So, you know, when you turned on that page and it was, you know, I mean, John probably didn't have this right.
You know, it's the animated gif of like the flames and the under construction sign.
And it says, you know, how do you.
to understand Feynman diagrams, you're like, great, here we go, right?
The same, literally the same website in 2020, it's like, this is, you know, don't, right, stay away.
Yeah.
So, you know, and I think there's, you know, again, when I'm, well, and I'm not sure I want to put
Zach on the spot here, but, you know, my senses is that these domain dependent priors,
a lot of this is much more what we might call tacit knowledge, right?
The stuff you know, but you can't say, right?
So, you know, Julia, when she says, okay, I have to watch the person, you know, she's not crazy, right?
There's good reasons to do that.
But, you know, when, you know, Scott says, ah, category theory is just not powerful enough.
You're like, well, you know, can you can you tell me why?
And he's like, I just like, I feel, you know?
Like, I've been juggling these things for years.
So this is great.
It's funny.
You know, exactly I didn't spend too much time on this, this part, partly because we had a word limit.
But, you know, the domain dependent price are there and they matter, right?
The other piece, right?
This is where all the excitement starts showing up, right?
Because this is where we start judging what you might call the aesthetics of a theory.
So not how it does on the data to hand, not whether it fits your gut, right?
And your gut, meaning your experiences of empirical life.
but the ways in which the theory looks, right?
If you dig deep enough into this,
things get very strange and it's sort of beautifully strange.
You know, we talked about many different values
that fall under, let's say, the simplicity value,
succinctness, right?
Like literally, how short is the explanation, right?
You know, can you say it in five words?
or less.
You know, my dad used to say, if someone can't tell you what their job is in a sentence,
they don't have a real job, right?
That's maybe a little unfair.
But, you know, succinctness is something that might tell you whether the explanation is a good
one, right?
Why were you like, oh, okay, so probably this is not, you know, you believe this explanation
just because it takes a long time.
So unfair, maybe, right?
You know, concession, a slightly more advanced version that talks about, okay, maybe you switch languages here, are, you know, is it concise in this language?
You know, does a Laurent's Transform look particularly elegant and hyperbolic tantch universe?
We can talk about unification, for example, which is the way it links things together.
We can count the number of hidden causes, right?
We can say, you know, your example of there's a hundred things, and they're each point.
pairwise link together and then we link all the pairs together.
I mean, okay, fine.
It's log number of things, causes, roughly.
So the, you know, just counting causes, right?
Occam's Razor, you know, we debate this a little bit, but one simple thing is to count
parameters, right?
How many parameters are in your theory if you have a mathematical theory?
When I was a grad student, I gave a talk on my, you know, latest dumb scalar energy theory.
and who was it?
Some famous physicist said,
how many parameters does your theory have?
And I said, like, whatever, three.
And he just walked out, right?
Because I was just too many parameters for him, right?
It was, you know, didn't matter what I could explain.
You know, it didn't matter, you know, how everything linked everything together.
It's just that's too many parameters.
Yeah, I got to walk my dog.
So you're like, I'm leaving, I'm going to social science.
Right.
Well, and so, I mean, you know, there are some interesting,
we'll talk a little bit about the social science stuff.
because there's some interesting stuff that happens there with respect to simplicity.
You know, you can keep digging, though.
So take the value of succinctness, right?
One way is to say not just succinctness in English, you know, but like succinctness in,
and here we go, right, succinctness in the computer program that if you ran it would print the
explanation out and the language you can read, right?
This, you know, has claimed to being in some sense, you know, the right definition of simplicity or let's say, you know, sort of concision or succinctness, because it makes it sort of language independent, right?
We know, roughly speaking, that whatever language you write in, it won't change that value very much.
So you write your code to generate the model in Python versus list versus C.
You know, it's maybe a constant offset, right?
So this idea, and it's called Kolmogorov complexity, also called Chaitland Complexity.
It means many different names for it because partly it was invented during the Cold War.
We had many people in the West and they had Kolmogorov, and so he gets his name on literally everything.
But so let's call it, let's call it Calmogoraf Complexity.
So, you know, this is this in one sense is the ultimate value.
If we could perceive this value, right, we would know the true simplicity of an explanation.
Right.
Now, should we value that true simplicity?
Maybe, right?
Let's put that question aside and just say, you know, whether it's a virtue or not,
let's just say, how could we come to know that value?
And it turns out it's logically impossible that you could know this value, right?
We can say what it is, right?
but unless you're like Roger Penrose and you think that humans in some sense transcend, you know, the Turing world, if we're not, you know, if we can't be efficiently or inefficiently simulated by a computer, you know, unless you think that, we have no contact with this value.
It is uncomputable.
It's a value.
It's uncomputable, right?
And, you know, I go on about this in length.
Uncomputable means uncomputable and you can't compute it anyway, right?
So you can't approximate this value because any approximation you do will have unknown error.
And then you say, fine, I will compute the error, which, of course, is uncomputable, right?
And so actually, this is a very good opportunity for me to make sure I understand this.
Because, you know, Scott and I wrote a paper, Scott Aronson, and we need to mention the fact that Colmongrel of Complexity is uncomputable.
And I didn't understand it.
And he finally taught it to me.
So let me see if I remember.
I mean, because the obvious counter argument is, given any language, I will just write every computer program from the shortest one to the longest one.
I will keep writing, you know, longer and longer computer programs until I output the output I want to get.
And the reason why that fails is because of the halting problem, because you will eventually hit computer programs that never terminate and you don't know whether it will terminate or not.
So if you, if you, and you're in your enumeration of every computer program, if you don't actually by luck output what you're looking for, you will never be able to get to what you're looking for.
Right. Exactly. That's that's one way. It's, you know, all of the, you know, your way is blocked at every turn, right? It's like the, you know, the Dungeons and Dragons game and the, you know, the DM is logic and the DM like you can't get out of the room. So every door you try, there is.
some problem with it, right?
So your example, right, is, oh, if you just enumerate every computer program, then eventually
you'll hit one that will never stop.
This is the halting problem, right?
So, okay, the halting problem blocks you that way.
Some, you know, people have different sort of creative solutions for how to solve this.
Every creative solution runs into a kind of girdle-like problem.
Right.
Every girdle-like problem secretly is a problem of self-reference.
And so we're saying that simplicity is something that we hold in great value.
but we can't really quantify it.
Right.
It's like, you know, it's the, it's the, don't cancel when we try to.
It's the atheist God, right?
Like it's the negative theology of the ultimate theory.
Yeah.
We will never know.
We actually might have it already, right?
But we can never know that we have it.
Got it.
Okay.
You know, so, I mean, just to drive the intuition here, I love, you know, you can transform
this into the halting problem.
Another thing you can say is, and this is what's called Barry's paradox, right?
you know you you have some way to name all the numbers okay fine the shortest number that you can't
you know or the smallest number you can't name in less than 50,000 words right I have just named
that number in you know less than 50,000 words so there's some paradox here in talking about how
difficult it is to name things yeah in part because when you name things you can also talk about
names so that's the kind of self-referential aspect here um if we were somehow able to
able to ban all self-reference from our theories, we could actually compute the simplicity,
but I'm not sure we want to do that, right? Because most good theories in some sense can refer
back to themselves, right? In, you know, I guess in some very simple physics theories, that may not
be the case, right? If they're, you know, sitting purely as, you know, a set of, let's say,
discrete update equations, it may be possible to think about the shortest way to specify them.
Yeah.
But if you, you know, you could say, okay, look, what's the, you know, what's the context
reliant?
Oh, no, because those are uncomputable as well.
It's really hard, right?
It's really hard.
It's really hard to have theories that are boring enough such that you can know with absolute
confidence, their simplicity.
So I guess the only way I can think of is like a Markov model, right?
Markov models we actually do know, right?
We can sort of compute how simple they are.
Okay.
But at the end of the day, where we are here is you have enumerated.
denumerated,
four values.
So to remind everyone,
the descriptiveness,
the co-explanation,
the domain-specific knowledge,
was it domain-specific?
Prior.
Prides.
Domain-specific prior.
And the simplicity.
So these are the things
that we look for in an explanation.
And when I read your list,
it reminded me there was a famous
or semi-famous list
that Thomas Kuhn came up with.
I don't know if you're familiar with this.
But, you know,
when Kuhn wrote the structure
of scientific revolutions
and said,
well,
there are paradigm shifts and you can't even judge one paradigm from within another one.
He was accused by his detractors of being a relativist of saying no scientific knowledge or progress
is possible, etc.
And he didn't think of himself that way.
So he wrote a follow-up piece where he said, well, no, I'm just saying kind of there's no
algorithm for doing it, but there are values that we have.
And he listed seven values.
And I forget what they were.
But one of them was fruitfulness.
Like if the theory would not only explain what it's explaining, but it has the
promise of explaining other things.
So my question is, does your list of four values purport to be it?
Is it comprehensive and exhaustive?
Are these the values that we have when it comes to explanation?
Or are they some of them?
How should we think about that?
Right, right.
So I would say Coon's fruitfulness is probably our unification, unification being the co-explanation
you'd get if you observed lots of other stuff and the theory turned out to be true, right?
Okay.
So that's, you know, it's a piece there.
We give it a name.
The, you know, in the end, it would be nice if, you know, it would be nice if we had a normative
theory of explanation, meaning we know which ones we know when we've got it right.
Really what we have here is a psychological theory, right?
We're interested in the axes along which a theory can get better or worse.
that we perceive, right?
So it's a little bit, I mean, you know, the extreme version would be like, okay, like it can be salty.
It can be sweet, right?
Right.
How is, you know, how do we as explainers, human explainers, look at the world and look at explanations?
Then you can say, okay, well, maybe we're not so bad at it because, you know, as David Deutsch says, you know, we have, we're amazing, infinitely capable creatures.
You know, maybe we're on to something in having these values.
but, you know, we can also over and undervalue them.
So there's a nice, you know, align here, right?
Values can be both virtues and vices.
We can value the wrong things or we can value them too much or too little, right?
So, you know, Kuhn's list of seven, I wouldn't be surprised if many of them aligned with, you know, the pieces we have.
He may have found others that don't align that way.
way, you know, a couple of things to be going on.
One is he could be wrong.
Yep.
Right.
Another is that he could have a psychological value that for him is very real, but that he
has learned.
So another piece here that we have is that we can not only, not only do we have sort of,
let's say, baked in values.
So when you study children, you discover psychologists who study this, discover that,
you know, children like co-explanation, right?
They like sweet things and they like co-explanation.
So some of these are kind of baked in, but others are sort of trainable, right?
So, you know, it's probably the case that, you know, you and I as people who like physics, you know, had a heavy weight on certain values.
Let's say the unification value, the simplicity value.
But, you know, it was exaggerated over time, right?
Because all of our charismatic teachers, you know, gave us, you know, candy when we valued simplicity more.
you know, conversely, anthropologists, you know, value simplicity less.
And it's in part because they know the world is not that simple when it comes to people.
So I remember there was a simulation.
I saw people doing a simulation of, you know, the, you know, civilization developing in the American Southwest, you know, pre-contact.
And, you know, they had this model where there were people on a landscape and choosing where to walk and
choosing where to settle and build houses.
And I'm sitting there, I'm sort of boiling with upsetness as a physicist.
I was just new to the Santa Fe Institute where this was happening at the time.
I was like, this is terrible, right?
Like, there's two kinds of houses.
How many parameters of this theory have?
And then this great anthropologist raised his hand, you know, one of the big figures.
And he's like, but where are the turkeys?
Right.
Why don't you have the wild turkeys in the simulation?
Because that's important, right?
And he was right.
that matters, right? That's an important part of explaining what's going on where the turkeys are.
But, you know, with somebody with a different set of values would say, this is just getting too extreme.
Like, we need a different, like this, the fact that we're adding these things into the explanation is making it worse and not better.
Free is great, but only if it's useful.
Free credit scores from some apps can differ by as much as 100 points from your actual FICO score that 90% of top lenders use when you apply for a credit card, personal loan, car loan, or mortgage.
That can mean a higher interest rate, a bigger monthly payment, or worse.
Denied.
My FICO gives you your actual FICO score.
The score lenders use straight from the company that created it.
For the moments that matter, get the score that matters, your FICO score.
Visit MyFICO.com and get started for free today.
When people turn to telehealth or weight loss, they're looking for real support.
That's why more people are choosing orderly meds.com.
Orderly meds connects you with real doctors and access to proven GLP1 medications like semaglutide
and terseptatide. No guessing, just a more supportive experience, and all shift directly to your door
in discrete packaging. Do your research, ask questions, then visit orderlymeds.com slash podcast for an
exclusive offer. That's orderly meds.com slash podcast. Individual results may vary, now medical advice,
eligibility required, see-site for details. Well, I guess this is, I mean, this is one of the things I
wanted to ask because you have these different values, and as you just highlighted very clearly,
in the real world, they compete.
Sometimes, anyway.
Like, I mean, obviously, if there's one theory that is both simpler and more
co-explanatory and more descriptive, it will win.
But sometimes the theory is less simple, but more descriptive, et cetera.
And then you have to balance and that's harder.
So I guess two questions.
One is, does the right way to balance these values pop out of basis theorem or something
like that?
Have you mathematically proven the right way?
Or question number two, can we empirically figure it out?
Like, can you go back in the history of science and say, well, this person is valuing simplicity
and this person was valuing their domain-specific priors and look who won and sort of towed up a scorecard?
Mm-hmm.
Yes.
So, well, let's say partly.
We have a story about the proper weighting between descriptiveness and co-explanation.
right there's a proper ratio in which you should value these
ratio and units and the correct units is one right
so you know you should value these two things equally in a certain way
but you know the real challenge here is when it comes to the
theoretical values what we don't have is a normative let's say or the optimal
or the ideal way to talk about the theoretical value okay right
There are people who will tell you that, for example, simplicity has to be a value.
And you say, well, why does simplicity have to be a value?
And you talk to them long enough.
And it turns out it's because the universe is simple.
Right.
Okay.
Right.
How do you know it's simple?
Well, it turns out that's the simplest explanation for why.
Right.
Okay.
So there, you know, the, on that side, we don't have a, we don't have an answer.
But you ask, of course, the right question is, can we just go see how people do, right?
Can we see how well people who valued this kind of explanation over that one, how they've done in historical time?
So we're actually, we have a project on this.
It's really fun.
We have all the data from the proceedings of the Royal Society, the Royal Society of London.
So this is the first scientific institution.
It's formed in 1666, or at least the journal starts then.
1660.
It's, sorry?
The society started in 1660.
I know that because I'm literally reading about it yesterday.
Excellent.
Okay.
Journal starts a little bit later.
Maybe I can't remember now.
It's like 1663, right?
This is why I drive historians crazy.
You know, it starts on the order of 10 to the, you know, three years after the birth of Christ.
Cosmologist.
So.
So we have this data on essentially how scientists are putting ideas together over time.
And how do we track the ideas?
We do some magical pattern recognition on the text.
We look at the patterns we find.
We, as scientists, say, okay, these patterns are making sense, right?
So we can detect the, you know, magnetism idea.
We can detect the electricity idea.
We can detect the.
magnetic substances topic, which is a different one, right?
It's like, you know, magnetism, what's up with that, right?
And it's sort of sad because our data only goes to the late 1800s, 1887.
So we know they're not going to figure out why iron becomes magnetic until the 20th century.
Like, it's not, it's just not going to happen for you, right?
And so you sort of feel bad like you want to say, no.
Other things they do figure out, though, of course.
And famously what they figure out is that there is this.
this global conspiracy between the electric and the magnetic fields, which we call the electromagnetic field.
These forms, and it's tricky to call them co-explanation, because these are not, these topics or these
ideas are not just about the observed things, but also discussions of the ideas themselves.
But we can track how these ideas link together over time.
the first thing you find is that this value, at least in science, kind of appears out of nowhere, right?
So the first hundred years of science is people putting ideas together in somewhat arbitrary ways.
Now, it could be they, you know, it could be they know that ideas should be linked together and no one's agreed on how to link them together.
So they may have the value.
Or perhaps more likely, I would say, they haven't yet learned.
that what you should be doing is finding the ideas that tend to link together and working on those,
right? So preferring, and in fact, we can see this happening, preferring to work on ideas
that reliably connect to particular other ideas. So this is kind of wild, right? We can see
people moving towards, and it starts, this preference starts around early 1800s. Actually,
one of the first people, one of the issue in which it starts is the issue in which they
published Ben Franklin's kite experiment. Can we dated that precisely no, right? But that's
where the Bayesian model says, right? Great Pennsylvania physicist. But, you know, beginning
around the early 1800s, we have this era, which lasts maybe about 100 years, maybe 50 years.
We have this era where people start connecting ideas together.
So people know, oh, idea A has something to do with idea B and not C, right?
Whereas, you know, earlier you look 50 years before, 100 years before, they're like earthquakes.
Cows?
Maybe cows, right?
And you're like, no, right?
It's not, that's not going to happen.
But at some point, they start putting these ideas together.
the, let's say, the overall unification level in science starts to rise, we can also see people,
as I said, people choosing to work on areas that are linking together. So we see this emergence,
right, of a value, at least the value begins to articulate itself in the record.
Can I, with respect to that, this might be relevant to a very longstanding puzzle that I've wondered about,
which was because my first trade book
from eternity to hear was on entropy
and I read a lot about Boltzman
and Maxwell and their discussions, et cetera.
And one of the big objections to Boltzman
was he was deriving the second law of thermodynamics
that entropy increases as a probabilistic statement
but it wasn't absolute
and people thought it should be absolute.
They thought it was a law.
They thought it was a law separate
from Newton's laws of classical mechanics.
And that always puzzled me
Like, how were you allowed to think that?
Like, you know, there was the same stuff, right?
Like, how could a gas obey Newton's laws and the second law if they weren't compatible with each other?
And are you telling me that maybe that possible incompatibility just wasn't something that would throw itself in their faces and make them bothered by it at that point in scientific history?
That's great.
I mean, it's funny, Sean.
One of the papers in our data, I mean, it's been ironic, is Bays' original.
paper, right? So the Reverend Bays publishes his article. And it's an amazing article. It's actually
he died and somebody said, Bayes told me the following. It's an amazing article because actually
everything's in there, right? So the idea that models make probabilistic predictions,
the idea that you can go both directions, right, that you can go from model to data, data to
model. It's all sitting in there. But somehow this just didn't catch fire for people.
Right. The idea that knowledge could be probabilistic, right, that this was a good representation of what we know or how to know things, just didn't take off.
You know, Bayes is that, you know, those ideas are sitting there and don't get linked, which is sort of interesting, right?
So in one sense, I can tell you're right. No one connected these together.
You know, in that case, you know, how do you punt it? You might punt that to the domain priors, right? Newton is about precision, right?
Newtonian laws are about determinism.
The solar system will go forever running like a clock.
So somehow the idea that, you know, there would be some relationship between Newton's,
you know, that style and, you know, probabilistic reasoning.
It's a little bit like, you know, the Scott Aronson idea that that's just not powerful enough.
But in this case, it's like, no, that's just not the right thing.
We've been doing this for 200 years.
But they were just wrong, right?
So I think that's, that's a lovely.
example, Sean. I mean, it's easy for us to focus on the successes. You know, the obvious one is we can
see them put electricity and magnetism together, which is a beautiful thing. We also see them put
electricity and electrochemistry together, which is an interesting one, because electricity is
more of a theory, electrochemistry is the experiment so we can start to see people, you see what
Joel Moker calls this virtuous cycle between theory and experiments.
right better theories let you build better devices to get you better theories right so we see some of
these loops the one that I really love actually I should say it's not just about physics right so we
also see people connect demography and agriculture right you know births and deaths right
lifespans child mortality people start to realize this probably has something to do with how people
eat right they connect agriculture to
Right. Whether your crops grow probably has something to do with the underlying rocks, right?
We see them connect metabolism to actually to agriculture. Another one metabolism because it's like the cow eats stuff, right? And it processes it and it, you know, poops it out. And we should probably, if we understand that, that'll probably help us explain phenomena that we've noticed in agriculture, right? And so on and so forth. Yeah, okay. Good. So it isn't just the, you know, it isn't just what we might call the exact science.
that are linking together, but also, you know, these, we see paleontology connect to botany,
right, as they start realizing that they can learn about the, you know, deep history of plant life.
It's not just about dinosaurs. So, you know, this connection stuff is, is kind of all over the place.
And I'll just, I'll tell you this story. And we could, we could chat a little bit more.
But the, the one I really love is, okay, so they connect electricity and magnetism, right?
Right.
But as we may remember, right, light is a form of electricity and magnetism.
Hertz's paper is in like our final issue, right, before it goes under copyright or whatever, right?
So, you know, at the end, they've put this together, right?
They've linked electricity, magnetism, and light.
They realize this is all, these things all go together.
But we can see them make these connections.
We can see them start to connect.
magnetism and light, like 40, 50 years earlier, which is wild, right? Now, what are they doing?
They're like, there's this magnetic substance and I shine light through it and like something's
weird happening. Like, guys, help me out here. Right. Like, what is it about like magnetism seems to be
doing something to light? Like, what's, right? So you can see them start to make those connections.
And so one of the things that, you know, it brings up for us is can you sort of look into the future,
So can you see where the next advances are going to be?
Now, you know, that would be in some sense you can't really do that.
It's impossible to predict an unpredictable future and sciences in some sense
unpredictable.
But it maybe gives us a sense at least that we're on the right track here as to what's
making for good explanations for them.
And I do want to give you enough of a chance to talk about what makes for terribly bad
explanations as well because it's a very fun part.
of what you've done.
I mean, the different values that you've pinpointed,
like we said, they compete against each other,
and it can be in some sense not completely algorithmic
how you weigh them against each other.
So there's a failure mode where you overvalue
a particular kind of thing and undervalue the others.
So why don't you tell the Timothy McVeigh story?
I think that's a great example.
I really like that one.
Yeah, so there's, okay, I'll tell you two stories.
Timothy McVeigh is a really interesting one.
So this is a conspiracy surrounding the Oklahoma City bombing.
You know, this sort of the worst terrorist attack on American soil by that point,
1995, white supremacist attack.
So what happened?
Well, Timothy McVeigh and some co-conspirators built a fertilizer bomb,
put it into a U-Haul truck, drove it to the federal building in Oklahoma City,
set a bunch of timers, left it there.
It blew the building.
to pieces.
Many, many people died.
It was, I mean, the devastation is quite shocking,
actually reading about it.
In retrospect, we sort of forget how insane it was.
Just one example, just of the sort of horror of this,
is many people died just because of the broken glass
that flew out from the explosion, right?
So, you know, the building also collapsed.
But so this was crazy.
The other thing about this attack that's relevant here
is that no one,
knew who did it, right? This was actually an extraordinarily meticulously done thing, right? At least at first. You know, they couldn't, you know, who, you know, who drove the truck? Where did the bomb come from? There was, they had no leads. It was, you know, it was not, you know, there were not mistakes made, let's say, at least early on in this, in this investigation. So what happens? Well, McVeigh,
you know, sets this bomb off and, you know, he walks away.
It's on a timer.
You know, he's far enough away.
Five minutes later, the thing blows up.
McVeigh gets into car and leaves.
So he's in his car.
The car he's driving doesn't have license plates on it.
He gets on the highway and he starts speeding.
He gets pulled over by a cop for not having license plates and for speeding.
And the cop notices he's got a firearm and it turns out it's like an unregistered firearm.
So he gets thrown in jail.
And it's only when he's been in jail for three days that they figure out it's him.
So, you know, this just great puzzle, right?
How could somebody so, you know, able to pull off this plan, right?
This very elaborate plan.
Be so stupid, right?
You know, like, even I know this.
Like, don't drive a car without license plates.
And if you do, don't get on the highway in speed, right?
Don't blow past a cop, right?
So, you know, how do you put this?
together, right? The explanation, of course, you and I have about the Oklahoma City bombing and,
you know, spoiler, it's true, was that he was essentially an insane, you know, deeply evil
person who drew a few people in to help him blow up this building, you know, spurred by,
let's just call it white supremacist rhetoric, right? That's our explanation. The problem is,
is that it's low in what we might call descriptiveness, right? It, it, that explanation
postulates that Timothy McVeigh was not a moron, at least in certain relative,
future planning abilities.
And yet, he acts like a moron, right?
If you're not a moron, doing what Timothy McVave did after the bombing is a low probability
event, right?
So now our explanation is suffering on a certain value, right?
It's suffering on this empirical value of descriptiveness, right?
It's, you know, it's like, sag, to go back to our earlier example, why is the student
taking French and neuroscience together?
Ah, because they're a romance language major.
Okay, well, that actually makes the neuroscience less likely because they got other requirements, right?
But you're no, no, it's come on.
There's other reasons.
So some people look at this and, you know, they're told this story and they say, no, I can explain that.
It wasn't McVeigh.
McVeigh, yes, he's a moron.
McVeigh was a Patsy, right?
He didn't pull this off.
Actually, all right, let's go, right?
Actually, it's a government conspiracy and the, you know, the Bureau of Tobacco and Firearms is involved.
And so they have an explanation, which can actually account for these facts.
They're better at fitting the data.
It's, they're better fits to the data, right?
And so you know, of course, what's coming, right?
What's going wrong for them, right?
I can overfit to the data, right?
And so, of course, the theory they need not only is strange, not only does it, you know,
violate our domain dependent priors.
And the joke is our domain dependent priors, like the government's not that good at doing
anything.
So how could it do this, right?
But also it's violating these simplicity priors, because once,
you assume there's a conspiracy, okay, you know, who else is in on it? Why did the cops not see it?
Well, the cops are in on it and the cop who wasn't got shot in this mysterious way. And, you know,
the newspaper guy is, you know, he disappeared. So, you know, of course, this, this explanation
ramifies outwards. That's a case where, you know, we overvalue an anomalous point. Yeah, right?
Or we overvalue dealing with the anomalous point. That's a classic case from our point of view of going
extreme on that first value of descriptiveness, the desire to make sense of every last detail.
And this is probably not true, but I can't help but hypothesize that this might have something
to do with one's fondness for detective shows and novels, right? Because when you're in a mystery
fiction, there are no coincidences. You'll hear the detective say, I don't believe in coincidences.
And like every fact turns out to be really, really important later on. And I think that's partly why
Alex Rosenberg, who's another former guest on the show.
Oh, yeah.
He likes to say that we make a cognitive mistake by overvaluing stories, right?
We tell ourselves a story that makes everything fit.
Sometimes things just happen, right?
And it's hard to weigh those two values of admitting that sometimes things just happen
with the satisfaction you have of fitting it all together into a matrix.
I think that's right.
I mean, there's, you know, I can't remember if they let us keep this.
Zach and I talk about, one of the talk about perhaps,
yeah, there's this enormous pleasure in a detective novel
when all the facts are connected together, right?
There's just co-explanatory moment at the end.
And, you know, there's always the scene, right?
You know, Paro brings everybody into the room.
You know, there's a great counterciful.
So Imberto Echo in his book, Name of the Rose,
and this is not a spoiler, right?
But Name of the Rose is a great, this is mild spoiler.
Name of the Rose is a great book because, in fact,
there is no co-explanatory moment.
Yeah.
It doesn't. It's a detective story without co-explanation.
And of course, I think Echo actually, he sort of talks about this a little bit in a
maybe an interdoctrine essay ruined about it.
So that's a great example of how he breaks the convention.
But you're right.
The, you know, Alex says I think he's got a piece of the puzzle here when he talks about
stories because stories often, you know, contain this co-explanation.
That's what makes them appealing.
But there's also more.
So, you know, I would say, for example, you know, if we're right about how these empirical values work, you know, you would expect conspiracy theories to involve not just stories, but anomalous facts, right?
So, you know, this meme, you know, jet fuel can't melt steel beams, right?
Which also turns out not to be relevant, but it's a fact, right?
So people are, you know, that fact comes in as well as, you know, dramatic accounts and stories and narratives as well.
So there's this empirical side that I think, you know, we can't neglect.
These little pieces that people find a tractor at least seem to be part of the appeal.
And presumably things like Q&N or Flat Earth beliefs are of the same spirit, where you're explaining a bunch of things.
I mean, Flat Earth is not quite the same thing.
It's not a conspiracy theory.
But Q&N is like the classic.
It's the epitome of explaining everything by having a million moving parts in your theory.
Right. So let me, this is a, so, you know, we, we talked about one way to go wrong, right, which is this descriptiveness one. Let me talk about the other one, which is the co-explanation going wrong. Because this is a different way that things can break, right? So that little fragment of the McVeigh, Oklahoma City bombing conspiracy theory is clearly a case where people need to fix an anomalous piece, right? You know, jet fuel can't make, make, melt steel beams fixes an anomalous piece, right?
Co-explanation is a different appeal, and I think this is partly working in Q&ON.
I think I can tell this story, because I've told it once before, but I won't,
this would be the last time I tell this story because it's such a good story.
I don't want to overplay it, but I'll give you an example of co-explanation that I fell victim to.
Here we go.
You all have.
We all have, right?
So this was when I first moved to Santa Fe, and we,
I was in the cafe and Santa Fe is full of very interesting people, some of whom were crazy.
One of the jokes is, you know, the people in Santa Fe, like, they were so disorganized that their car broke down on the way to San Francisco, right?
So, you know, that's your group.
And so I'm in the cafe and my first week there and I meet this guy and, you know, he sort of buttonholes me and he starts telling me his conspiracy theory.
And, you know, I'm sort of, don't make enemies.
it's your first week in town.
So I'm listening, right?
And the conspiracy he's explaining to me,
and I think this guy is long out of this, right?
But at the time, he was telling me this conspiracy theory
known as the sovereign citizens movement.
So the sovereign citizens movement is a conspiracy theory
that is so elaborate, right, that, you know,
I could, if I remembered it, I could tell you the whole thing.
But just to give you a fragment of it,
it involves the idea that British common law,
some way meant that the United States government in the 1800s could not borrow money on the
credit of the citizens.
Like somehow this couldn't work, right?
So what they did was for every citizen, they created a fictitious identity called your U.S.
name.
So everybody's carrying around a fictitious identity called the U.S. name.
And it's the U.S.
name identity that, for example, has to obey the law, right?
Right. The U.S. name identity is the one that has to pay taxes. You yourself actually, you only, it turns out, are answer to like the sheriff of your town. I've never heard this one.
So, I mean, this is sort of funny, but also obviously, you know, the guy keeps going and eventually it turns into, you know, obviously this anti-Semitic features and all this, right?
One of the nice things about this movement is people know it very well because one of the things it tells you do is write a letter to the IRS telling them that you're not going to pay taxes.
So it turns out they keep those letters, right?
So, you know, this is, it's a movement that's relatively easy for the government to track.
So he's explaining this to me.
And I know at some point I am waiting for it to get dark.
But he says, look, I'll tell you something.
Sorry, but I'll tell you about your U.S. name.
You know, the government has to deal with you in your U.S. name capacity all the time.
When it does, you know, when you get a letter or something like that, your name will be printed in all capital letters.
Right?
So, this is, you know, take your wallet out, Sean.
Do you have your wallet?
I don't have it with me right now.
Okay.
Take your wallet.
Okay.
So, you know, if your listeners do this, right, you can test your, you can test your coexplanation problem here, right?
It's like, you know, your U.S. name of government is all capital letters.
Now take out your wallet.
He says, look at your driver's license.
And my name's in all capital letters.
Oh, my goodness.
What about the past?
And I was like, for this moment, Sean, I was like, oh, just for a moment.
Like, there's something.
Oh, my God.
There's something to them.
No other way.
This is a classic, yeah, it's a classic co-explanation moment because what he's done, of course,
is link all of these facts he's given me about British common law or whatever.
It's not that I believe this, right?
But it's like, you know, he's told me all about Jefferson.
And then he's given me this story that links with this totally unexpected fact that my driver's license has my name in all caps, right?
So this is now all connected.
And it's this kind of lovely feeling, right?
You're like the world very briefly got sort of brighter and, you know, the colors got a little brighter.
And then you sort of shake it off and you're like, no, this is this is crazy.
But, you know, maybe I think the message or the larger message, Shana, is that, you know, these are values, right?
We have them.
People who, let's say, fall victim to these conspiracy theories.
And even if people, even if someone doesn't go crazy, there are some very negative features of believing a conspiracy theory.
One of them actually being that we love to explain things to each other.
It's a human, like, it's one of the things we do all the time.
If your explanatory values go wrong, you can't enjoy this with other people.
Right.
Yeah.
So, you know, you and I sit around and it's like, I don't know, Sean, we would never have this conversation.
It's like, what about the Bulls?
You know, the Chicago Bulls are doing really well this year.
And it'd be like, what's your theory?
Well, let me explain it this way.
That way we can have a lot of fun.
But then the guy with the weird values is like, it's the Jews, right?
And you're like, hey, like, don't say that.
That's insane.
But also it's like, that's not how we, that's not a satisfying explanation, even if it wasn't creepy.
Right.
So you lose this, you lose this ability to spend time with others.
And people mention this.
So some studies of Q and on people, this is part of it, is they sort of get exiled from their friend groups, not even because, you know, because they're being weird or sexist or racist or anything, but because they're just no longer fun to do this fundamental human thing with, right?
You can enjoy a sunset with them, but you can't explain.
why, you know, Trump won the election or why, you know, Aunt Sally so upset this week.
So these, there are some real downsides.
But, you know, I think our message here is that those, you know, those stumbles, those falls that people have, you know, they're not some alien, you know, ridiculous axis that's completely orthogonal to you and I.
Yeah, exactly.
right, that, you know, their reasoning, right?
Their reasoning has gone wrong, but they are still reasoning.
They're not babbling, right?
And, you know, the question people always ask us is, okay, you've explained these things.
Can you predict what to do about them or what interventions will work?
And so the answer is, no, we don't do prediction.
But the explanation, I think, does potentially, you know, it gives us part of the puzzle.
Because if we see the membership in a thing like Q&N as in part a disorder of explanation making, well, how do we fix that, right?
How do we get people's values back into balance?
One piece, and this is work that we've been doing when Chloe Perry and I have been doing Chloe's now at University of Michigan, is the idea that, you know, you have weird explanatory values.
You can't hang out with your friends.
you go on the internet.
And what you do on the internet is not just talk about jet fuel can't make steel beams,
but you also share and reinforce these sort of malfunctioning values as well.
So you're surrounded by people who don't just believe crazy things,
but also have the wrong meta principle for adopting them.
It suggests that part of this is disconnecting people from an epistemic value system
as well as the particular beliefs, right?
So it isn't just saying it's ridiculous that you think Timothy McVeigh was part of this conspiracy,
you know, that people can be smart and idiots the same day,
but also making sense of the way that they're connecting things together on a larger scale.
But part of what I thought you were saying is that the actual set of epistemic values
that the conspiracy theorists have is the same set of values that we,
very level-headed natural scientists have,
they're just weighting them different.
And that sounds like a harder thing to,
or maybe it's an easier thing.
Like maybe since we rely on the same values,
we can sort of speak to those values
and bring people back?
I don't know.
Is there an optimistic message here?
So I gave a talk,
actually Zach and I together gave a talk
to the philosophers at the University of Pittsburgh, right?
So Pitt philosophy is like best philosophy in the universe.
you know, neo-Higalian pragmatism, sometimes.
But one of the people in that seminar made this lovely remark.
She's like, you have an Aristotelian theory of epistemic values, meaning, so, you know,
in Aristotle, it's all about this balance, right?
Don't be foolhardy, but don't be a coward, right?
Like, where do you find yourself on that continuum, right?
You know, like, you know, weakness versus strength.
you need to find some, like the intelligence here, the wisdom here is finding the correct location
on that line, not getting yourself killed, but not running from a fight you may need to fight.
We have an Aristotelian theory of these epistemic values.
They become virtues when, or you become, let's say, epistemically virtuous, when you're at the right point here.
The golden mean.
Now, does Aristotle tell us how to treat, you know, anger, maybe, right?
people who are too foolhardy, people who don't take enough risks, maybe.
But it tells us maybe one way in which these values are operating.
No, I mean, that's actually really good.
Like, I'm becoming more of a Aristotelian in that sense, myself, in the sense, I mean,
not only is it that you balance things and you look for a harmonious middle point,
but that there is no algorithm for doing it, right?
That there is some kind of human choice.
Wisdom is the word you used, phronasis or something like that.
I'm sure that the Greeks would say.
But okay, good.
So maybe let's wrap this up then.
Sure, yeah, yeah.
Put it to work.
Let's, like, do some worked example here.
How would we think about, let's say, I have lots of work examples I can pick from,
but let's say panpsychism versus physicalism about consciousness.
So here are two explanations for consciousness.
One is that the world is just protons and neutrons and electrons,
obeying the core theory, and there is some higher-level immersion description.
and we call that consciousness.
There's another explanation in which, no, no, no.
I mean, there's that stuff, and it obeys those laws,
but there's also intrinsically mental aspects of the physical stuff,
which are not captured by the standard laws of particle physics, et cetera,
and those extra intrinsically mental aspects are needed to explain conscious experiences.
So here's two explanations, and you have a bunch of values,
and I can kind of, I can imagine how I would think that the,
physics one is simpler maybe, but, you know, what would you, what would you say to someone who
wanted to evaluate these using your values? Really, right. I, I love this example so much,
because it's, it's wonderful. So, you know, let's, let's, let's deal with the, with the, you know,
the property dualism one, right? The panpsychism one that says, look, there's just this other
property we all have, which is consciousnessiness. You know, this would be, I would say, a highly
descriptive theory, right? You know, there's these things and then there's these other things and
physics does these things and we just have to stick in, right, this other story here, right?
That they're not connected, right? There's no co-explanation. You know, this conscious property
is in no way correlated with that physical property in any deep way. The, you know, it's the,
properties are live in distinct worlds of matter and spirit, right?
So it's winning on descriptiveness, right?
It's not winning so much on co-explanation.
But, you know, I want to flip this around now because I know what you like.
I know what I like, which is this emergent story, right?
You know, there's this, you know, there's this stuff on the bottom here and it's like bubbling up to produce these emergent phenomena, right?
But that's actually, it's not that simple, right?
Because how many layers between, you know, quarks and beliefs are there, right?
How many?
Okay, gosh, I guess you have to do the molecules and the molecules.
Okay, so now you got to get the, you know, the substances and the, right?
There's a lot of space between, you know, the standard model and conscious experience under that other one.
So in that case, you know, that almost, you could make the pitch.
Like, that's a real conspiracy theory.
Well, I think this is, I make this point in my recent quantum mechanics book about people who believe in, let's say, hidden variables.
or Pilot Wave-Bomian theories
versus people who believe in many worlds,
not only are they different theories
and they can argue out which one is right
and we don't yet know,
but also they both claim
they have the simpler theory, right?
But the sense of simplicity is different.
And I think that this is one of the reasons
why I like your set of values
because I can see them coming apart.
The Everettians will say,
look at my equations.
There's only one.
There's one equation, that's all,
and everything.
You just work on that equation.
and massage it and think about it really hard, and you get everything.
That's simplicity for me.
And the BOMians say, well, no, look at the world, and I can easily locate it in my theory.
Like, there's particles.
Like, there they are in my theory.
I don't need all these layers of explanation.
So that's what I call simple.
But maybe that's actually more descriptiveness.
I'm not sure.
I think that's actually, I mean, I think that's a great way to distinguish the many worlds
from these more, like, pilot wave things.
things, right? It's true. You have to grind through a lot of mathematics to get from the many
worlds to the classical one. Right. Now, in one sense, this is not simple, right? Like David Wallace's
book is 500 pages. But if you think about this as, let's say, a program that you run, right,
to derive these things, the program actually might be quite short in the sense that if you,
you know, you just have to be really smart, meaning you have to be able to run that program.
quote-unquote, but the program might be short.
Yeah, so, I mean, there's the shortness of the program, but there's also how long it's got to run, right?
Right, yeah, lots of depth they call, right?
How long the program runs.
All of these are, you know, it's these are wonderful.
I think one of the pieces, you know, Sean, we can talk about us forever, right?
But one of the pieces in the non-many world stories, right, like the boeemian story, I think a lot of this is domain dependent priors.
Oh, yeah.
Right?
Because I think one of the responses to the many worlds, it's like, that's just in, you know.
insane, right? Like, come on, right? And I think that's an appeal to, let's say, common sense,
right? In the same way, and I keep going back to this, you know, Aronson, Scott Aronson's
example of like reasons why I won't read your proof. And again, Scott, this is, you know,
this is a joke blog post, right? But Scott's like, it would be ridiculous if that's how you proved
not equal to M.P. Like, come on, right. I'm just not going to take it serious. So I think that's,
you know, that's a domain dependent story there. So I think that's another piece. Um, it
may also suggest why people have been so resistant to the many world's theory over the years
is that, you know, we can convince each other that something's beautiful, it turns out, right?
We can say, okay, this is more beautiful than that, and we learn these values.
It may be much harder to push around the tacit knowledge.
It may be much harder to push around these things that we've learned that we don't even know
we know.
Well, I think that's right.
Or we can't quite articulate.
You know, I think that's true, but I also think that even when people share the
tacit knowledge. This way they balance the different values is my favorite thing that I got out of
what you've been saying here. I'll give you one last example that you can run with or not as you
choose. Lee Smolin was very recently on the podcast. And he said something not on the podcast,
but years ago, that always really, really struck me because it was clearly true and I couldn't
explain it. And maybe you're helping me explain it. He said, isn't it weird how people who believe in
the Everett interpretation of quantum mechanics also always believe that computers will
someday be conscious.
And it's not because Everett implies that computers will be conscious, but the kind of person
who's like, yes, just give me the simple rules and I'll derive everything, is likely to
by both Everett and by that consciousness is substrate independent.
That's, I mean, you know, this is a lab experiment.
One could do on M-Turk.
If you could get enough physicists or the IRB to actually talk to one.
You know, I think this, I don't know, Sean, again, we could go on forever.
But one of the things that I think we've missed or it's a big opportunity is to look at these more,
let's call them exalted forms of reasoning, right?
We tend to look at sort of minute level snap judgments that people make.
This is, this tells us a lot.
But we're missing kind of this, we're missing sort of the culture of explanation making.
And that's, that's, I think, I mean, I, I,
love this example. I think it would probably hold up. We should run it at the next APS.
Do you know about the, um, to ask people the, the, the fill people.org, the website.
Yes. For philosophers. So David Chalmers and David Borgie, I guess. Uh, if you're a philosopher,
you can have a profile site on Phil people. And what, one of the fun things they do is they ask you
your opinions about all sorts of hot button philosophical issues. So you could totally cross-corlate
those. The data are there. Oh my God. That's amazing. Yeah. No, the data is there. I mean,
that's not, well, I will do that this afternoon, John, because that's a great example. I'm sure
there's like 50 questions. And, you know, philosophy tends to have this, you know, it's like,
do you believe an analytic, you know, identity or do you believe, who knows, right? Like, they've,
they have a vocabulary there that enables pretty simple binary answer. Well, yeah, and all the,
all the questions are multiple choice. So it's not like, there's no essay. So it's like, you know,
consciousness, physicalism, panpsychism, whatever it is, dualism, and, you know, quantum mechanics, Everett, da, da, da, da, da.
Yeah.
Well, that's good.
I always like to.
I'm sold.
I love it.
I love it, Sean.
I'd like to end the podcast on an optimistic note, and there is no more optimistic note than giving the podcast guest work to do as a research program.
So I'm glad we were able to do that.
Simon dea, thanks so much for being on the Mindscape podcast.
Thank you, Sean.
What if you could have even more and more and more help to pursue your goal?
At LPL Financial, we offer more ways for advisors and their clients to thrive.
So what if you could?
Paid advertisement, investing involves risk including potential loss of principal, LPL Financial LLC member FINRA SIPC.
