Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 309 | Christof Koch on Consciousness and Integrated Information
Episode Date: March 24, 2025Consciousness is easier to possess than to define. One thing we can do is to look into the brain and see what lights up when conscious awareness is taking place. A complete understanding of this would... be known as the "neural correlates of consciousness." Once we have that, we could hopefully make progress on developing a theoretical picture of what consciousness is and why it happens. Today's guest, Christof Koch, is a leader in the search for neural correlates and an advocate of a particular approach to consciousness, Integrated Information Theory. Blog post with transcript: https://www.preposterousuniverse.com/podcast/2025/03/24/309-christof-koch-on-consciousness-and-integrated-information/ Support Mindscape on Patreon. Christof Koch was awarded a Ph.D. from the Max Planck Institute for Biological Cybernetics. He is currently a Meritorious Investigator at the Allen Institute for Brain Science, where he was formerly president and chief scientist, and Chief Scientist at the Tiny Blue Dot Foundation. He is the author of several books, most recently Then I Am Myself the World - What Consciousness Is and How to Expand It. Web site Allen Center web page Google Scholar publications Amazon author page Wikipedia
Transcript
Discussion (0)
Warning, the following ZipRecruiter radio spot you are about to hear is going to be filled with F-words.
When you're hiring, we at ZipRecruiter know you can feel frustrated, forlorn even, like your efforts are futile.
And you can spend a fortune trying to find fabulous people, only to get flooded with candidates who are just fine.
Fortunately, ZipRecruiter figured out how to fix all that.
And right now, you can try ZipRecruiter for free at ZipRecruiter.com slash Zip.
With ZipRecruiter, you can forget your frustrations because we find the right people for your roles fast, which is our absolute favorite F word.
In fact, four out of five employers who post on ZipRecruiter get a quality candidate within the first day.
Fantastic.
So whether you need to hire four, 40, or 400 people, get ready to meet first-rate talent.
Just go to ZipRecruiter.com slash Zip to try ZipRecruiter for free.
Don't forget, that's ZipRecruiter.com slash Zip.
Finally, that ziprecruiter.com slash zip.
From the neon lights of the club to the harsh, buzzing lights of the office, don't let the wear show on your face.
Just swipe Mabeline instant eraser concealer to erase the night before, wherever that happens to be.
Instantly covered dark circles and under-eye bags for a brighter, more awake look.
This do-it-all formula also contours, corrects, and highlights, all while staying lightweight,
crease-resistant, and smooth.
It may be the world's greatest eraser.
Find your shade of instant eraser
concealer at your local retailer.
Hello everyone, welcome to the Mindscape podcast.
I'm your host, Sean Carroll.
Despite multiple episodes here on Mindscape
devoted to the topic,
we have still not figured exactly out
what consciousness is or how it works.
We've had philosophers on,
talking about what it means to have an experience,
we've had neuroscientists,
talking about what happens in the brain,
all to no avail.
It's not that there's not been progress.
I'm slightly tongue-in-cheek here,
But this is a hard problem. What exactly is consciousness? Because it's one of those things we're very, very familiar with. But it's kind of unique in that we're most familiar with it from the inside, right? Rather than at an objective stance measuring things with calipers or microscopes or whatever, we're experiencing it all the time. That's an opportunity, but it also creates certain unique problems. So today we're talking to someone who is a neuroscientist, but it's also very, very willing to mix it up.
with the big philosophical questions.
Christoph Koch is currently at the Allen Institute for Brain Science,
where he was originally the chief scientist and president of the institute.
Before that, he was a professor at Caltech for quite a while.
In fact, I met Christoph when, believe it or not, we were both consulting on a movie,
and the idea of consciousness came up,
and the idea of consciousness in a computer came up,
and Christoph pulls out his iPhone and points to it and says,
How do you know this isn't conscious? At the time, I did not take that seriously, but now I understand
the issue is a lot better, and I know that he was gesturing toward the idea of panpsychism,
which we've talked about before, of course, on the podcast. And Christoph is not quite a panpsychist,
but he's panpsychist adjacent as a proponent of the IIT or integrated information theory
approach to consciousness. It's a very down-to-earth theory in the sense that there are numbers and
equations and you try to measure the connectivity and the integration of the information in some
system. The system might be a human brain or it might be an AI system or it might be a pile of
rocks on the beach. You can measure its integrated information. But the point is you always get some
number. And Christoph's point was, well, that number is not going to be zero for most systems. It might
be very, very tiny. Nothing like what we consider to be consciousness, but maybe you can talk about it as a
wee tiny bit of consciousness without actually saying that electrons have feelings. So this is years
later and a lot has happened and we're going to talk about a number of things that Christoph has done.
He's been very involved in figuring out ever since his early work with Francis Crick, what are
called the neural correlates of consciousness. So forgetting about what consciousness is, what is it
that happens in the brain at the level of neurons when you're having conscious experiences,
doing very down-to-earth experiments in the brains of mice
and seeing how maybe that can be extended to human experiences
and then developing tools to understand
is someone in a coma conscious,
is an artificial intelligence, large language model, conscious, and so forth.
His most recent book has the interesting title,
Then I Am Myself the World,
what consciousness is and how to expand it.
So he's gotten into the questions of, you know,
Again, from the personal first-person perspective, are there things we can do through meditation or other forms of enhanced awareness to improve our own personal level of consciousness?
So Christoph is happy to be provocative about many things.
We cover a lot of ground in a short conversation, and I think you're going to find this one amusing.
So let's go.
Christoph Koch, welcome to the Mindscape podcast.
Thank you very much, Sean, for having me on Mindscape.
You know, you've been doing this for a while going back to your collaboration with Francis Crick
after he moved from molecular biology to thinking about consciousness.
I wanted to start by just asking, what is the major way, if there are any, that your views on
what consciousness is and how it works have changed since you started thinking about this?
Well, so when Francis and I started back when I was a young assistant professor at Caltech,
partially overlapping with you, consciousness was still a complete no-no among serious working-day
scientists, particularly if like me you hadn't obtained a holy state of tenure yet.
And so it was something that you did after hours and where grad students, you know, who are
always in the know, they routinely roll their eyes when, oh, yeah, that topic now, right?
But that's, and then what we instituted, this purely empirical, pragmatic program, okay, let's
forget about the philosophy because we haven't made much progress of the last two millennia there.
Let's focus on what we can do.
So we talked about certain model systems, in monkeys, in people, of course, in mice, how to
go about it, which techniques to use, which visual illusions to use, and where are some of
the basic question?
And that really caught on this purely empirical program and led to what's now known
the search for the NCC or the neuronal or the neural correlates of consciousness.
In other words, what are the footprints in the brain for anyone conscious experience?
Like right now, I see you and I hear you in my head, this voice inside my head.
Well, nothing in physics right now tells us why there should be voices or sights or smells
or feeling of being angry, upset in love, right?
Nothing in quantum mechanics, nothing in general relativity, nothing in periodic table of
chemistry, nothing in the endless ATGC chatter tells me that we have these things,
these voices, his experiences.
And so the search for the NCC is neutral with respect to your particular philosophical,
metaphysical, unopinning.
As long as you believe, and not even all philosophers, believe that consciousness is something
that needs to be explained.
Some philosophers, most famously Dan Dennett and the church lends, they claim it's all a big
confusion.
It doesn't really exist in any sort of way that you and I believe it exists.
and it's just a big distraction.
But among the vast majority of people
and even the majority of philosophers,
it cries out for an explanation
looking for the footprint as an empirical program.
However, and this is also what has changed
since I worked with Francis Creek for 14 years,
let's say in the fullness of time,
we will have an explanation about the neuronal footprint.
So anytime, Sean, that you feel bored,
the feeling, the experience of being bored,
It feels like something to be born, right?
Very different from being in love.
We know, ultimately, we will know it involves these neurons or maybe that mechanism or maybe even the collapse of the wave function, okay, whatever it is.
But then, of course, you want to know, well, why this mechanism and not that, why these neurons here and not those neurons?
If it's a collapse, why should the collapse feel like anything, right?
So this is, of course, also known as a heart problem by David.
Chalma. So ultimately, we need a theory of consciousness that precisely gets at the question
you asked earlier on. You warned me, you're going to ask, is a fetus conscious? And if so, when?
Is a machine ever conscious? Is a particle ever conscious? It's a paramedium ever conscious.
So for all of that, you need a theory of consciousness. You need an empirical, verifiable,
scientific objective theory that tells us which bits and pieces of matter, which bits and pieces of
organs like this, the most complex piece of matter in the known universe, have feelings.
And Francis and I, we purposely didn't go there, but that, of course, was, you know, 30 years
ago.
And so in the meantime, we have theories, in particular, one of the two most popular theories,
integrated information theory of consciousness that Francis would have liked because it's causal.
And in fact, he met the originator, Julia Ternone.
we had lunch. He came over twice to have lunch with Francis and myself at his house.
Yeah, so that's the biggest difference.
And perhaps the metaphysical assumptions, but we can leave that for later.
We might get there.
So in other words, from the start, we're looking for the things that happen in the brain
that correlate with the conscious experience.
Now you're more taken with the idea that that's important, but also we need a theory
so that we can ask about things we can't immediately quiz,
like the fetus or the AI?
Yeah, exactly.
We right now completely depend on our intuitions,
our religious or philosophical biases, right?
For some people, of course, the fetus is conscious, right?
Way back to inception.
Other people say, no, it's only born, only when it's born to,
is a dog conscious?
I know you're a cat lover, a cat conscious.
how far does consciousness go down the tree of life?
All of that right now we have intuition.
Everyone has a different intuition.
But that's not good enough, right?
We all have the intuition that whales are fishes.
Well, it turns out actually they're not fish, they're mammals.
Well, you mentioned the idea that you're talking to me,
you're seeing a little picture of me, you're hearing what I say.
What is the distinction between consciousness,
which seems so laden and philosophical with simple awareness of things.
Are they the same thing?
Yeah, so for us, so Francis and I wrote about it explicitly.
For us, they're just different words.
Some people, particularly early on, now you can use consciousness even in nature and, you know, in PIRL.
You couldn't do that 30 years ago, unless maybe you were Roger Penrose.
So people use the softer thing, awareness.
Awareness is just a more generalized sort of, you know, you are.
aware that you're alive. You're aware that you're awake. You're aware of, you know, that,
that, you know, there's a president here. So it's more background consciousness. But it's all about
ultimately, you can also call it mental states, subjective states, phenomenal. You know,
philosophers like to use the work, phenomenal. It's all the same. This, it feels like something to
be alive, to be awake, to be bored, to be hungry. And how much progress have we made on the literal
neural correlates. Do we know which little neurons are firing when I'm hungry?
When I'm feeling the feeling of being hungry?
Well, even if we knew, of course, we know a lot about neurons and we know a lot about brain areas,
but those are, of course, all correlation. Yeah, so we know, I mean, there are hundreds of
experiments. Right now, I see you and you see me. So we have a pretty good understanding
what are the neural pathways involved in vision, vision because it's the best studied modality
of all. But of course, that's different from, that's just correlation, which of those bits and pieces are
actually necessary. So, for instance, the eye. Clearly, you know, photons are entering my eye and then
are transformed ultimately into vision. Do I need my eyes? No, I can close my eyes and I can see you still,
ghostly. And of course, tonight, if I dream about you, you know, I dream in the dark and my eyes are
closed. So I don't need the eyes. So the challenge has been to sort of
disambiguous mere correlation from what is actually the causal agent.
And there it's still very controversial.
You may have heard I had this famous bet with the philosopher Dave Chalmers,
27 years ago now, where after a late night pub call in Bremen at a conference on consciousness,
you know, he challenged me, he says, look, even in a quarter of a century,
which, you know, we were all much younger, seemed forever, we won't find.
It's going to take us much longer.
He didn't say it's impossible.
He agrees the NCC is a purely empirical operational-defined project with enough people, money, funding, research.
We will figure it out.
And so we had this meeting two years ago where it turned out as part of this adversarial collaboration.
So the Templeton Foundation started this cool project where they pitted the two dominant theories of consciousness,
integrated information theory in global neuronal workspace.
theory directly against each other, where a little bit like, you know, the famous experiments
1919, you know, predicting, you know, the solar eclipse, doing the solar eclipse, whether the
shift of life follows Newtonian physics or Einstein general relativity. We directly pit the two theories
against each other trying to resolve empirically, well, where is it, what are the empirical
prediction which one is actually true.
And so at this meeting in New York in May of 2020,
the agreement was, well, none of the theories are totally correct,
at least the empirical manifestation of these theories in the brain
with respect to where is the neural correlate.
So IAT says neural correlate is in the back, the sensory cortices.
Well, global neuronal works base make the argument
it's primarily in the prefrontal cortex,
a part of the brain that's most expanded in humans compared to other mammals.
And the field still hasn't settled down on that.
That paper is finally coming out in nature in a couple of months from now.
Okay.
Because there was a lot of controversy about it.
It turns out, big surprise here, Sean, it turns out people who work for 20 years on a theory,
then if you go into this adversarial collaboration and the theory or its prediction
is disproven, they don't just say, ah, you got me. My theory is wrong. I admit 25 years of my life
was wasted. Sorry about that. I don't believe it. Yes, people actually don't do that. Surprise,
surprise. Newton wasn't around in 1917, 1917, otherwise he would have objected again.
So we still haven't converged, but we're getting closer. And what we do realize in what came out in
this debate that the prefrontal cortex, and this is relevant to your other question,
are computers that we're going to be conscious, is much more closely associated with doing,
with planning, with intelligence. This is the difference between consciousness and intelligence,
right? So also artificial consciousness and artificial intelligence. Consciousness is ultimately
about being, being in love, being happy, being angry, seeing things, hearing things, etc.
Well, intelligence is really about short-term, medium-term, long-term planning to act, right?
I have to save money now in order to collect it or retirement.
That's an intelligent action.
So ultimately, that's about doing stuff.
It's about functions, et cetera, and that's different from being.
And so therefore, it's not that surprising that the parts and bits of the brain that are involved in planning
and reasoning in thinking, in moral reasoning, in decision-making are different from the bits and pieces
of the brain that seem to be the substrate for feeling, for having experiences.
Hey, everyone, it's Cal Penn. I'm the host of Earsay, the Audible and I-Heart Audio Book Club.
This week on the podcast, I am sitting down with Ray Porter, the narrator of Andy Weir's
audiobook Project Hail Mary, massive sci-fi adventure about survival.
and science, and what happens when you wake up alone very far from Earth?
I really had to make a decision because I caught myself getting that frog in my throat and starting
to get teary as I'm narrating some of these sections, and it's like, okay, yo, yeah, yo, is this
indulgent? And I really thought about it. I was like, no, at this point, it would kind of be
betraying the trust the author and the listener have in telling this story if I don't go through
it. But there's places in this book that deeply emotionally affected me.
And I left it on the mic.
That's great.
Because it served the story.
People will say like, oh my God, I cried at the end.
It's like, yeah, dude, me too.
Listen to Earsay, the Audible and IHeart Audio Book Club.
On the IHeart Radio app or wherever you get your podcasts.
My best skin ever at 45?
Give me a theme song and a best skin care award.
Because it feels like this.
Right.
That's farmhouse fresh skin, all right?
I'm glowing, and everyone asks how.
The best skincare is Farmhouse Fresh, and the award is you, your best you.
Visit Farmhousefreshskincare.com and use code radio for a free starter routine with any purchase.
Well, I love the idea of the adversarial collaboration.
I think it should be more widely adopted, although some adversaries would just not be able to collaborate in my experience.
So congratulations to you, folks, for being able to do that.
But now I need to ask this question, even if it takes a long time to answer, what are these two theories?
What is integrated information theory, global workspace theory?
I had never heard the idea that they focus or they propose different parts of the brain as being central for consciousness.
Well, I mean, that was a good thing that came out of this meeting.
Well, let's step back.
Most people, in fact, I just attended just before a meeting at Google, I mean virtual, at Deep Mars.
in London about what's called computational functionalism and consciousness.
So most people who study consciousness, particularly everyone in AI and big tech, makes this
philosophical, metaphysical assumption that was proposed formally by Patnam, you know,
the American philosopher, called a Turing functionalism or computational functionalism,
i.e. consciousness has one or more functions, let's call it planning or samaray.
the current state of the world in my mind and acting on it, you know, long-term memory,
broadcasting information in the brain, it's probably a list of functions.
And any system that implements these functions will therefore be conscious, including a touring
machine.
So if we can get a chewing machine to mimic everything that people do that seems to involve
consciousness, like talking about consciousness and reasoning based on it, then machine.
like large language models will also be conscious.
And so now it's just a practical question we can discuss.
Is, you know, chat GPT 4.0 is 03, you know, is deep seek, is Gemini, are they conscious,
are they still missing?
Well, maybe they're still missing a little bit of something.
You know, maybe they have to take in more tokens or to do a little bit longer memory or whatever.
But it's really just a question around pragmatics.
So that's computational functional functionalism.
So, any system, so ultimately, consciousness is a computation.
It's a hack.
If I, if a program machine, it's substrate independent.
It can run in the cloud.
It can run on a quantum computer, whatever.
It's a clever hack.
And once you instantiate this hack, of course these machines are conscious.
You can ask them.
And they talk about it at great lengths, how conscious they are, how they feel.
Versus.
Sorry, that's according to that view, the Putnam View.
The Putnam View, which is very, very prevalent.
And of course, it is a dominant one in the industry.
And again, it's so dominant because if you interact with an LLM, they seem incredible, not only intelligent, but also, yeah, they talk about feelings.
Aware, yeah.
Now, of course they talk about feelings because they've been fed on every novels, humans have ever written.
And all novels are both the feelings of the protagonist, right?
Their love and hate and being slighted and being insulted and hurting and et cetera, et cetera.
And they've ingested all of that like vampire.
So of course they can reproduce it.
It's all deep fake.
That's what I believe.
Okay, so the other theory, on the other side, there's really only one dominant theory, which is integrated information theory, which says no.
Consciousness is not a clever hack.
It's not a computation.
It's not a process.
It's not a function.
Although it may be associated with all those things.
Ultimately, consciousness is, as I said, a state of being.
it's a structure in a very high-dimensional causal space.
So ultimately, consciousness is about a system, a substrate, like this brain,
having causal power upon itself.
And this is the particular way the system acts upon itself.
In other words, can determine its own future and be determined by its past.
I can unpack that.
The more this system feels like something.
So it's a little bit like saying complex systems that can act upon the,
themselves, in other words, that are not just randomly determined where the next state is a function of the previous state, any such system, if you look at the mathematical formulation in terms of its transition probability matrix, has what's called causal power.
The current state co-determines the next state. There may be some noise, or it may not be fully deterministic, but determines the next state, or the past determines the present and the present determines the future.
the more internal causal power the system has to determine its own fate, the more it is conscious.
And the theory describes two aspects of it.
Eight, it has a number called Phi, the Greek number five, which you can also think about the irreducibility of the system.
The more the system is above and beyond the sum of its part, the higher the phi, the more it is conscious.
So you can have a system that's phi zero, which means it's totally, it does not exist as a whole.
Its reducibility is zero.
It's not really a system.
It's more too independent system.
That system wouldn't be conscious.
The higher the phi, the more conscious the system is.
And most importantly, and this is never stressed by other theories.
You also have to have a theory that tells you.
why does being in love feel the particular way it does?
Why does time flow?
You know, we all experience time is flowing forward.
It never moved backward.
Why?
Space, you know, whether it's visual space or seen space or heard space feels extended.
Well, what is it about the underlying substrate that gives rise to the feeling of extendedness or boredness or, you know, being bored or being angry?
So the theory also explains by the structure of this unfolded causal space
why one experience feels the way it is very different from any other experience.
And so is the global workspace theory, the sort of descendant of the functionalism of Putnam?
Yeah, okay.
Sorry, you asked me that.
Yeah, so global workspace is a computer science metaphor from the 50s, right?
The idea is you have a central process and that writes,
information on a blackboard.
It's also called the blackboard architecture.
And then every local processes can access this blackboard.
So the idea here is my brain does many things, but unconsciously.
Like you and I, like all humans, we move our eyes four times a second.
Okay.
The regulation of eye movements is very sophisticated, highly controlled, but it totally
bypasses our consciousness.
just like the way I adjust my gate, I move my hands, I sort of infer syntax, right?
We speak in correct sentences, but we don't consciously put those things together.
It just happens.
Those are all local processes.
Every information that's conscious is globally accessible.
What's meant, and I think it's a correct insight from psychologists, once I'm conscious
of something, oh, there is something funny over there.
Then all the different processes in my brain I informed about it.
I can put it into long-term memory.
I, of course, have it into short-term memory.
I can use that information.
I just became conscious of to do long-term planning.
I can think about it.
I can reason about it.
So that's the idea that once information becomes global,
it's accessible to all the information processing system in the brain,
and that's what consciousness is.
So the metaphor is really you broadcast information.
And stand the hand in his collaborators have identified a set of neurons that are situated in the prefrontal cortex that project their information back to the rest of the brain.
So that is this broadcast.
So the claim is every time information percolates from, let's say, from the visual system that starts at the back of your brain,
It propagates forward. It's still local. It's still local. Then reaches the front of the brain.
And then that information, if it's important enough, and we attend to it, becomes, it's broadcast
to all the rest of cortex, to the neocortex, the outermost layer of the brain. That act of broadcasting,
that function is what constitutes consciousness. So any system that instantiates that broadcast will be
conscious. So if I understand it correctly, then the global workspace theory seems to focus on
the spotlight of attention that consciousness involves, whereas integrated information theory,
IIT is more about this sort of, well, the integrated information that we use to plan and control
our own destinies. Yeah, but it's not just destiny at a high level, you know, at a high level.
It's just looking out in, I mean, causal power is just the ability of, you know, let's see,
elements, whether neurons or transistors or whatever, to influence,
for electric charge has extrinsic causal power, right?
Because a positive charge here has the ability to influence the negative charge over here.
Gravity has causal power, right, due to curvature in space time.
So those are examples of extrinsic causal power.
Intrinsic causal power is just you have a little cellular network of neurons or cells or
transistors or whatever.
and if the neural or these elements are in this state,
then the next state will be this,
and if they're in that state, then the next state will be something else.
So causal power is something you can actually evaluate.
If you have a complete mathematical description of a system,
how its states evolve over time
and how the individual elements influence each other,
you can fully compute, explicitly compute all of its causal powers.
So it's not an airy-fairy.
It's an operational.
So in that sense, it's very operational.
It doesn't appeal to anything mysterious.
So it's not dualist.
Some people say IET is dualist.
Well, it's not because it doesn't appeal to any substance.
It's just the claim that fundamentally what experience feels like is this unfolded causal power.
So any system that is integrated, that's more than the sum of the individual parts,
maybe even a very simple system like a paramecium, will, because of its vast,
vast complexity of the, you know, in the paramedium, there are probably a billion different
molecules of maybe a thousand or two thousand different types, you know, proteins, etc.
They all interact causally with each other.
And this causal interaction feels itsy bits like something, like being alive maybe.
So this is why you are not, you know, running in fear from the idea of panpsychism,
even though you're not like a full panpsychist, but you kind of get,
why that would be a way of thinking about things. Consciousness is not something that pops up
at a threshold. It's like there's little bits of it everywhere. That's correct. I mean,
that's entirely correct. It's also parameter free, right? You don't have to say, well,
if you have five is 42, then you're conscious, but if below 42, sorry, you just didn't make it,
because that seems totally arbitrary. I mean, why 42? And particularly if you're, if you're, so, you know,
I'm also a biologist. So we study.
mouse brains that are, you know, a tiny fraction the size of human brain, in fact, almost exactly
a thousand times. Yet if you look at the hardware, it's almost impossible, like, you know,
if I focus in with a microscope on a tiny, you know, quinoa-sized grain of mouse cortex,
it's almost impossible to tell it apart from the human brain. And so there's no doubt,
you can go even down to smaller animals that if you just observe,
animals, they have complex behavior, they have memory that is quite likely that all animals,
certainly animalia, may well feel like something. And this is, of course, this very ancient
intuition of that's called panpsychism. But you would, you would, I should phrase this as a
question, would you classify yourself as a physicalist? Do you think that it's just physical stuff?
There's no spooky essences involved here? Well, so something that's always bothered me
about physicalism from way, way back,
the mental is clearly not physical.
My state of seeing, of being, or thinking, or whatever,
is not physical.
By definition, it's phenomenal.
In fact, Schrodinger, so I was recently rereading Erwin Schrodinger, right?
And he makes this very explicit that even as a physicist,
I have to look, I have to experience the trace of an oscilloscope.
What means I have to see, that's a conscious experience.
I have to hear other people saying something.
When like Einstein, I'm imagining some, you know, the elevator and free fall, et cetera,
while I use my imagination, that's consciousness.
So we cannot escape everything we have, the only thing, Sean, we have access to.
The only thing is our experiences of the world.
I don't have access to atoms.
I never had.
No one has.
Yeah, you can show me little pictures.
You can show me equations that are compatible with atomism and all of that.
But you don't have direct access.
All you have access to is the phenomenal.
All these beautiful shapes painted on the inside of your cage that you call your reality.
That's your bespoke reality.
That's the only thing everyone knows of.
That's the only thing philosopher has a phrase you are directly acquainted with.
So physicalism is an additional assumption.
It says, well, there's not only these phenomena, but then I infer there's something above and beyond.
So now inverting that and saying, well, now I'm going to do away with this observer altogether.
So there are no phenomena.
Everything is physical.
It's always struck me as ludicrous.
But until recently, you couldn't say that in polite academic society if you wanted to remain a scientist.
Yes. You can't say that because people say, oh, now we're talking about woo-woo, right?
Yep, I would say that, but I'm glad you're liberated. I'm glad that you feel the courage to admit these inclinations.
Yes, in fact, I have, after a particular type of experience I had, I became reacquainted.
So I grew up obviously in a Germanic household. And I, so I grew up around not only Richard Wagner, but also Otto Schopenhauer, who was probably one of the best known, at least.
modern Western idealist.
And now there's a resurgent in philosophy,
not only in Pampsychism, it's becoming more popular now,
but idealism, good old idealism.
And so I'm thinking of this computer scientist,
I think I would warmly recommend you interview.
I'm very smart guy, computer scientist and philosopher.
He has two PhDs, Bernardo Castro,
who has this, he calls it analytic idealism,
which is really sort of Schopenhauer for the modern world,
where essentially says, well, the simplest explanation,
we can all agree following, you know, Occam's Reiser and all of that,
the simplest explanation if we only postulate one thing.
Well, the only thing I've directly acquainted with is phenomenal.
It's phenomenal all the way to the horizon,
because that's the only thing I or you ever know.
So then everything is phenomenal.
And in fact, the physical has to be explained within,
within is ultimately arising from the phenomenon.
that even the physical stuff like atoms and charges and elementary particles and quarks and whatever you have ultimately has to be explained with respect to the phenomenon.
And then this philosophy now meets foundational physics where, you know, ever since Bell's inequality and the entangled, you know, particles and, you know, Einstein's spooky action at a distance, we now know there may be no truly observer independent events.
and then maybe the observer has to be right there central part of physics,
including maybe saying, well, that's really fundamentally what truly exists.
Because here's one point, Sean, which is really central to IAT.
IAT distinguished between absolute existence and relative existence.
Absolute existence is existence for itself.
You exist for yourself.
Tonight, when you're going to go to sleep,
three hours earlier than I am,
you will, particularly in the early phase of your night,
of your sleep, you'll go into deep sleep.
So if I awake you during your deep sleep
and I ask you, Sean, wake up, where did you just come from?
You would say, typically you would say from nowhere.
Because you were deep sleep, you know,
these delta waves are criss-crossing your brain.
You were not there.
You were not there to yourself.
your partner, your, you know, your bad partner can definitely see your body is there,
so you're there for others, but not for yourself.
Then later on, as you continue to, as your body continues to sleep,
you'll wake up inside your sleeping body, and suddenly you are something.
You are, you know, flying, you're meeting long lost, you know, dead friends, lovers, pets, whatever.
You're dreaming.
It's a conscious state.
And so this cup only exists for others.
this cup does not exist for itself.
Only conscious creatures, only conscious system exists for themselves.
So that's really the fundamental gap that runs straight through everything.
Are you on this?
Do you exist for yourself or do you only exist for others?
You can see that is the most critical distinction there is.
And so that really puts the onerous on the phenomenal, on experience.
My best skin ever at 45.
Give me a theme song and a best skincare award
because it feels like this, right?
That's Farmhouse Fresh Skin, all right?
I'm blowing, and everyone asks how.
The best skincare is Farmhouse Fresh,
and the award is you, your best you.
Visit Farmhousefreshskincare.com
and use code radio for a free starter routine with any purchase.
This is great.
It's wild stuff.
I'm very glad you're.
saying it. I could not possibly disagree more with everything that you're saying, but I love it.
Wait, wait, wait, wait, okay. Why? Why? I don't. What do you disagree? I'm a physicalist through and
through. I think that quantum mechanics doesn't say what you say it says. I think that as scientists,
we take in data from the world from the phenomenal experiences that we have. That's absolutely true.
Completely agree with everything you say that, of course, we, by construction, we get what we get
as are phenomenal selves by construction,
but then we use that to make a hypothesis about how the world works,
and the best hypothesis we have is the true existence of a physical world
of which we are emergent parts.
Okay, so I have no trouble with the hypothesis.
That's, of course, what I do every day in my daily work, you know, studying brains.
But I guess we can differ to what extent quantum mechanics now reintroduces the notion
often of or thinking of getting rid
you know there was his paper in nature physics
a year ago by Howard Wisman and people from Australia
right questioning the absolute
the absoluteness of events that every
event that facts there are no observer independent facts
now I agree that hasn't been resolved
you know it's ongoing but that's always been
challenge for quantum mechanics to say, what is the fact and what facts do not depend on an observer?
Well, I think that this is one of the difficulties in understanding quantum mechanics,
because it's the one theory that we have in physics, putting aside consciousness and psychology,
etc. But in physics, quantum mechanics is the one theory that introduces the notion of an observer
when it gives you the rules of the game, right? I just wrote my own paper in nature that appeared a week ago,
you know, sort of rehearsing the history of this.
I'll send it to you.
Oh, yes, please.
But of course, there are, since the 1950s,
straightforwardly physicalist models
that explain why observations in quantum mechanics
seem to be special without making observers
a part of the fundamental ontology,
and that it's an empirical question
if and which of these models are actually correct.
I agree. Ultimately, it's an empirical question.
Well, the metaphysics, of course, for better words, is immune from verification or falsification, right?
The metaphysical interpretation, yes. Ultimately, it's an empirical question.
What is the best theory within, is it a psionic theory or Bayesian theory or many-world theory, etc., within quantum mechanics?
Yes, I totally agree.
Yeah, I mean, my inclination, and I'll try not to go on too long because there's so much good stuff I want to talk about, so otherwise we should have a whole separate conversation.
But my impression is that assuming physicalism and deriving mentality from it is enormously more productive scientifically than biting the bullet of idealism and trying to derive the physical world from that.
I grant you that, but that's a purely pragmatic consideration.
And I want to know, before I die, I want to know what is the true state of the universe,
not which is the most pragmatic state to hold, right?
Well, that's an interesting distinction right there that we could talk about.
But good. Anyway, I completely am on board with the idea that idealism and its modern guise
is an intellectually respectable way to go.
whether it's epistemic approaches to quantum mechanics or idealism or panpsychism, et cetera.
I'm just not going there.
That's why I'm very glad to have such an articulate spokesperson for the idea.
But without getting too distracted, then, you can probably anticipate,
I'm going to ask a question about former Minescape guest Scott Aronson's famous objection
to integrated information theory.
I mean, the great thing about IIT, everyone agrees, is that it sticks its neck out, right?
It has a quantitative thing and says this.
This is the thing we're going to compute.
This number five.
It's going to help tell us where the consciousness is.
And Scott's objection is that he can come up with examples of things that on face value don't look consciousness at all,
like a large rectangular array of logic gates, which have a huge value for this number you're computing,
but don't seem to map on to our intuitive view of consciousness.
So what is your response to that?
Yeah, so he is correct.
IAT, like any good theory, if you extrapolate it, make some rather strange predictions.
In fact, I would argue this part of the brain, the posterior part of the neocortex that empirically
seems to be like the substrate of consciousness in mammals, including humans, is like a very large
array, not of neurons, and you can approximate neurons as a particular type of logical array,
that have a topographic connectivity.
So very, I mean, not unrelated to the type of arrays that he postulate.
Yeah, so I think he is right.
There's some very non-intuitive predictions.
And so now we have to do the science.
This has always been the case.
You know, people way back argued, you know, at the time of the Greeks and, of course, in the Renaissance,
that the earth cannot be a sphere because people would fall off.
Of course they fall off on the other side.
That's the most ridiculous things.
You can't be on the backside of a sphere without falling off, right?
So we have to be careful with things where we think, well, that's so ridiculous.
We have to, sometimes we have to take things seriously like black holes, right?
That were also laughed.
You know, people laughed about them and then actually try to do an experiment to say, is it true?
So, for instance, Sean, people can now start to build cerebral organauts.
You've heard about mini brains in a dish, right?
Yeah, yep.
So in principle, in 10, 20 or 30 years, we'll be able to build them like very large tissue.
So where I to take you or my neocortex, the outermost layer of the brain that's really most closely associated with vision and consciousness and intelligence in us.
It's really a pizza-like tissue.
It's 2 to 3mm thick like a pizza and it's 12 to 14 inch across.
And it's highly folded and you have two of them left in the right brain.
So in the fullness of time, in 20, 30 years, people will be able to grow these things in a dish.
Right?
Yeah.
I mean, it seems sort of ridiculous, but I think that's going to happen because you can reuse it to fix.
Let's say if you have Alzheimer or some other pathology, you can fix it.
Well, in principle, this piece of tissue may feel like something.
Maybe it just feels a vast spatial extendedness.
Like you get during certain meditative states when the meditators just talk about this vast,
luminosity, right? So consciousness may end up being found in very strange spaces, and we have to,
the only way we can verify any theory of consciousness is in us, in you and I and other people.
And once we have a theory verified, then we have to go where it takes us.
And, okay, so your answer is to bite the bullet and say, yes, these examples that don't seem to
map on to our intuitive idea of consciousness should nevertheless count as conscious. That's, that's
your resolution. And conversely things that look very conscious like LLM's same logic advice we have to test.
Are they really conscious or are they just faking it?
Can we, has anyone computed FI for an LLM?
Yeah. So there's a paper that's that's on bioarchive now that we're trying to submit that shows formally within, so this is only assuming IIT is true.
Yeah. Okay. You can, because it's very formal and it's very specific. So,
What we can formally show, you have a simple model of a phonoima machine.
It's a very simple with 116 gates or something like that.
And you can show an actual, I mean, it's all simulated.
So in one case, we have a simple automata that's heavily non-linear.
And the other case, we map this automata onto a simple but perfectly general,
four-bit computer.
And you can show that the input output states of these two systems, here a physical set
of four non-linear gate.
Here, 116 gates, as you would typically find them in a von Neumann architecture, functionally,
they're totally equivalent.
They perform the same input, give rise to the same output.
So you cannot distinguish them.
So by touring, they're exactly the same.
But you can show phenomenal, this has some causal power.
Well, this one doesn't exist at all at the level of the whole, at the whole system, 116 gates,
and only very small subset of them have a tiny bit of causal power.
Why is the difference?
Well, because machines are on a typical CPU, one transistor will talk to two or three other transistors.
But then, of course, you have endless billions of billions of these transistors arrays to give you universal logic.
while the way the brain is wired,
you have one neuron gets input from 50,000,
projects to 50,000 with heavily heavy overlap.
And so this notion of causal power is radical different in one from the other.
So you can show functional equivalent does not equate to phenomenal equivalents,
including in the limit.
You have two systems that are functionally identical.
This one is highly conscious.
this one isn't conscious at all, which I think is the case for LLMs.
This is not, you can't do such a proof for neuromorphic computers, nor for quantum computers.
So it may well be that you can build.
So there's no question.
IAT says there isn't anything supernatural about the brain.
So clearly you can build artifacts that are conscious, but just not the way we build them today,
not the computers running in the cloud.
Are you at all sympathetic to the idea just to finish up to Scott Aronson conversation?
that IIT might be better thought of as a necessary but not sufficient condition for consciousness to happen.
Like if you don't have this integrated information, this high quantity phi, you're not conscious,
but just because you do doesn't mean you are.
If you're not representing the world, if you have no semantics, et cetera,
then maybe we shouldn't count it as conscious.
Well, okay, so A, you can perfectly well, and in fact, we've done this,
there are a number of papers where you can evolve, you know, in a computer,
you can evolve simple creatures that have high five that represent the world
in a sense that there's a mapping between, you know,
these are creatures that you have 10,000 of them,
you let them run through mazes, you collect the best one,
you perturb the genome, you give rise to another brain,
you send them through that, you do that thousands of times,
you start with randomly connected brains,
and you end up with brains that have,
mapping from the outside, the labyrinth or whatever they have to work.
They have to deal with onto their internal brain.
So IAT doesn't preclude at all that there is this lawful mapping like you and I have
between the external world and the visual brain or the auditory world.
No, you can't, I mean, who knows?
You know, I cannot think about the space of all possible theories.
But within IIT, they are, in fact, there's a thing called the.
central identity as part of IATU that says your conscious experience is identical to or can be
fully accounted for.
That's a better formulation, one to one, with nothing left over on either side, by the totality
of the intrinsic causal power.
Every aspect of your experience, including the more, and every memory, every thought,
every dream can be fully accounted for.
Now, this may be wrong.
It's a theory, but that's what the theory states.
Hey, everyone, it's Cal Penn. I'm the host of Earsay, the Audible and I Heart Audio Book Club. This week on the podcast, I am sitting down with Ray Porter, the narrator of Andy Weir's audiobook Project Hail Mary, massive sci-fi adventure about survival and science. And what happens when you wake up alone very far from Earth?
I really had to make a decision because I caught myself getting that frog in my throat and starting to get teary as I'm narrating.
some of these sections. And it's like, okay, yo, yeah, yo, is this indulgent? And I really thought about it.
I was like, no, at this point, it would kind of be betraying the trust the author and the listener
have in telling this story if I don't go through it. But there's places in this book that
deeply emotionally affected me, and I left it on the mic. That's great. Because it served the story.
People will say like, oh my God, I cried at the end. It's like, yeah, dude, me too.
Listen to Earsay, the Audible and IHeart Audio Book Club
on the IHeart Radio app or wherever you get your podcasts.
My best skin ever at 45?
Give me a theme song and a best skincare award
because it feels like this, right?
That's Farmhouse Fresh Skin, all right?
I'm blowing, and everyone asks how.
The best skincare is Farmhouse Fresh,
And the award is you, your best you.
Visit farmhousefresh skincare.com and use code radio for a free starter routine with any purchase.
And I do want to get on other things, but maybe a quick opportunity to talk about like the nitty gritty of looking at brains.
You've mentioned mouse brains already.
Are we testing?
Does it even make sense to ask the question?
Christoph is showing us a little key ring with a mouse brain on it.
Yes.
Can you take the ideas from my IT and either test them in the mouse brain or learn about the mouse brain using these ideas?
And if so, how do we do that?
Yeah, I mean, the mouse brain, you know, people think a mouse while what's a mouse, it doesn't talk.
You know, I'll never have dinner conversation with it.
All of that's true.
But again, if I take a grain of mouse brain, dog brain, elephant brain, human brain, basic hardware is all the same.
it's not identical.
You know, we evolved the last common answer between us and Mises, you know, 60 million years ago or so.
But the components are remarkable the same to the extent that we just published a whole series of nature paper showing.
So the brain consists of on the other 5,000 different types of brain cells, pocaineal cells, perennial cells, varying different types of pyramidal cells, et cetera.
The same 5,000 cells can more or less be found in the human brain.
It's just like genes.
We, you know, our genome is on the order of 20,000 genes.
The mouse genome is on the order of 20,000 genes.
It's all very, very similar.
But the difference is, of course, in the mouse, you know, it's much easier to do
experiment and for ethical reasons.
There are certain questions.
You can't ask the mouse about language, of course, but you can do the basic.
They're highly tactile.
They're highly olfactory.
They're less visual.
They have vision, but they're less visual than us.
So there are lots of experiments that you can do in a mouse.
or in similar creatures that are really very similar or relate closely to experiments that people can do in humans,
where you, of course, limited.
Typically, you don't access the human brain.
You only see it indirectly, so you have to use e-gene, and fMRI.
So we are all closely related.
We're all nature children.
We have some specialization, like a hyper-developed sense of importance.
That's one big difference.
I don't know.
The mice might.
I just don't know.
but then, okay, so you're now still affiliated with the Allen Brain Institute.
Is that right?
Yes, yeah, correct.
And is the Allen Brain Institute a hotbed of IITism, or is it more academic?
No, no, no, it's purely, so, you know, we are now 1,000 people.
When I came, we are 100, when I was the chief scientist and the president, we went to 300.
I stepped down, and now we are 1,000 people.
So we focus on a few very large projects, like, like, Canada,
All the cell types in the mouse brain or all the cell types in the human brain,
doing this also doing development, you know, what happens in a very young, immature brain as it develops,
how do cell types change?
What about the Atlas?
We're doing these connectome projects where we do, you know, at the finest level possible,
where we don't image with photons, but with electrons, right, cutting up tiny slivers,
you know, two or three nanometer, I think, of brain and cutting, you know, millions of these slices,
putting them together. So we do a few very large projects that typically can't be,
are not going to be done by industry and can't be done at a university. By and large,
we don't think too much about consciousness and such things. We leave that to academics like
me or like many other academics at various universities. Well, I mean, it's good. I'm very glad
you said this because I think that it's fun to talk about the big picture philosophical questions.
and they're not the same as, but they absolutely do rely on this kind of empirical work
where you're trying to figure out how many different kinds of neurons there are in the brain.
Totally.
Otherwise, we still sit around like Plato and Aristotle at the Academy Days, right,
2,400 years ago in Athens, and shoot the breeze without ever making progress.
But that's a great thing about science, including about psychedelics, including quantum mechanics.
You can ask nature the right question in the form of the correct.
experiment, right? And you will get an answer. That's the best thing about science better than any
other human activity. I agree. I completely agree. And so given what we've learned and what we're
still hypothesizing about, there's a bunch of questions lying out there about consciousness
that are pretty down-to-earth and operational. As we've already alluded to, we want to know
are people conscious when they're dreaming? Are they conscious when they're in a coma? Are they
conscious when they're six weeks after conception. Do you think we've made progress of these questions?
Yeah. So in fact, I helped start. So one of them, very much, on all of those questions,
except maybe the final one. Let's come to that. So A, I has helped start a company called Intrinsic
Powers that brings a device that used to be a pure research prototype developed by Julia
the Trinone, the architect of Integrated Information Theory and a close medical colleague of his,
Marcello Massimini, to test for the presence of consciousness in behavioral unresponsive patients.
So if you or I have, after this conversation, a heart attack or bleeding or, you know, a car accident,
we get into the ICU, we are unresponsive.
We're clearly alive.
We're unaventilated.
We're unresponsive.
And they ask you, you know, can you hear me?
Can you see me?
Can you track a flashlight with your eyes?
You know, if I pinch you, will you moan or will you move a limb?
You don't do any of that.
So you're considered behavioral unresponsive.
This used to be called vegetative state.
Okay.
The tragic is four to five days out, if you remain in this day for four or five days,
typically the team, the medical team will initiate discussion with your loved one.
Well, what did he want?
It's the time to pull the plug, literally.
They pull ventilator support.
And up to 90%, up to 9 out of 10 of these patients die because of withdrawal of life critical care.
Okay.
Now, we do know that one quarter of these patients are conscious, but covertly conscious.
So what that means, for instance, if you ask them, so you have this person who's lying there,
you ask them, sir, imagine playing soccer for 30 seconds.
And then imagine just being quiet.
again ask
you ask him the second time
imagine playing soccer for
for 30 seconds
imagine lying quiet
then you can see
for instance the nice modulation
in your motor cortex response
so it means this patient
who is unable to communicate
where you have no idea
whether there's anyone home
still can lawfully
voluntarily regulate their brain activity
okay
and so
and together we develop this device
so essentially what it does
it knocks the brain
by sending in a magnetic pulse,
call it transcrenia magnetic stimulation,
and then you measure the response using high-density eG,
and essentially you compute the complexity of that.
And it turns out there's an absolute threshold.
Point three to it's normalized.
So zero would mean it's totally flatline.
You knock the brain and there's no response.
That's brain death.
Or one would mean every point,
every electrode is totally independent of the other.
that this doesn't happen in real brains.
So typically brain complexities between 0.6 and 0.8, typically in you and I, for instance, right now.
Or when we know, when you dream, same thing.
When you're in a deep sleep, it's very small complexity below a threshold, 0.31.
When you're in a dream state, your complexity is high.
When you are under psychedelics, your complexity is high.
When you are under anesthesia, your complexity is low.
When you're in an unambiguous coma where it's clear that you're not there, your complexity is low.
So it's a very nice threshold and with very high specificity of 0.95, we can determine whether you're actually,
so it's a primitive consciousness detector.
The first primitive conscious detector.
So again, this really shows independent of all these idealism, physicalism, panpsychism,
we can actually make progress on these questions.
We can build consciousness detectors.
Right now for us, in the fullness of time, we will, certainly we can develop them for any mammal, and maybe in the fullness of time for any system.
But right now, for humans, so that's real progress.
Does it help us with the prospect of brain computer interfaces and being able to talk with people who are in a coma?
No, so this is a purely device just to see, is the complexity of this brain, is it sufficient to support conscious?
Now, separately, you can then specifically take these patients and, you know, further do rehabilitation
or talk about if they remain in this state.
So typically what happens, so most people, the natural cause of events, people either die
or they recover some functionality.
Okay.
So if you remain in this state, a small subset, five to 10 percent, they become chronic.
And then they, you know, they are typically in a home or sometimes they get actually taken to their own home.
And they remain in the state where they have either no or only minimal.
Sometimes people sort of recover some ability to move their eyes.
In the worst case, they may not recover at all.
Yeah.
And okay, that's, I'm sorry to hear that, but I'm glad you're doing, I mean, I'm sorry to be reminded of this terrible fact about human life.
But I'm glad that you're making progress on distinct.
between the cases that really seem to be essentially gone and those that are recoverable.
Then what about the youthfulness question? What about the fetus and becoming conscious? Is that something that we can talk quantitatively about?
Well, so all we can say, in I, in fact, I was participant in Amicus brief in that anti-abortion lawsuit.
We know the cortex doesn't really fully develop until the second time.
So your nervous system develops, you know, at eight to ten week in the first trimester.
But it starts developing.
But then really sort of doesn't develop the longer, the connectivity and the connectivity
to the external world through the thalamus.
That doesn't happen until week 22 or 24.
EG is also pretty much flat until then.
And then you get the first so-called birth suppression, e.g., where you get activity.
and then quiet.
Activity and quiet.
And the typical pattern in you and I,
that doesn't happen until very late end of third trimester
where you get a more normal-looking EG
with all the waves developing.
So it's very difficult to say right now,
but in the first trimester,
probably may not feel,
I mean, it's very difficult, it's inference.
Yeah.
As far as we can tell,
it probably doesn't.
feel a lot to be a first trimester.
At the end of the second
trimester, you begin to get some simple
reflexivity.
So in premature babies, when
they need some operation, they do
already limb withdrawal reflexes.
But that doesn't tell,
you know, a fly, a
rosophila embryo does the
same thing. It curves away from
a source of heat like a match.
So is that reflex?
It's very difficult to be
certain. Is it exciting?
somewhat scary to be part of an amicus brief in front of the Supreme Court?
Well, it was exciting and, you know, we're trying to do the right thing, but, you know, it didn't amount too much.
It wasn't decided on the merits of the scientific case, right? It was just decided.
Of course.
We need to send this back to the states.
Okay, and then you already mentioned a little bit about LLMs and your opinions about that.
But is there from IIT or from any competing theory, do we suggest some kind of roadmap?
for making artificial computer programs that truly are conscious,
or is that a very far way off?
Well, first, why would you want to do that?
People want to do lots of things.
Okay, that's true.
Yeah, so you cannot simulate it.
Okay, that's a big claim.
Yeah, because, look, you can perfectly well simulate the black hole
at the center of our galaxy.
right, Secretarius A-star.
But have you ever worried, Sean, that if you turn on this simulation,
you're next to the computer program in the computer center that runs this,
you're going to be sucked into the black hole?
No, I've not worried about that.
Why not?
Where's the difference?
No, I kid you not, where's the difference?
Well, the simulated test particles in the computer
would be sucked into the simulated black hole.
Yes, but that's all simulation.
It's a difference between the real and the simulated, right?
So because this computation by itself does not have causal power to bend space time,
just like it never gets.
I mean, Sean Searle made this argument decades ago.
It doesn't get wet inside a rain simulation, right?
Same thing.
It doesn't have the causal power.
Yes, so you can perfectly well, even if you were to build a computer simulation of the human brain,
the complete human brain, like, you know, a Henry Markham Blue Brain Project wanted to do that.
In the future, we'll be able to do it.
But still, and this computer simulation, of course.
wake up and speak because it's you know it can do that but it won't feel like anything because
you can't simulate it you actually have to build it so if you want true conscience you have to build
it you either have to do neuromorphic engineering where you build hardware not simulate you actually
build hardware in the image of the brain people are trying to do that at iBM and intel etc
or possibly quantum computers possibly like you know willows at i at uh at quantum compute lab etc
So embodiment might be very important for this project.
Yes.
Yes.
It's not going to be substrate independent.
Right.
Okay, good.
So I don't believe, by the way, in this mind upload, right?
No, I agree.
Yeah.
You know, that I cut my brain, I get my brain's connectivity, I simulate it up in the cloud, and then this thing will be conscious.
No, it may be able to mimic me, including my accent and everything perfectly, but it doesn't feel like anything.
It's a deep fake.
You're not worried about the matrix?
No. I'm worried there were many things, but not The Matrix.
Well, you've written, I'm sorry that it's taken this long to get there,
but you've written a provocative book just last year.
Do you want to give the title or should I read it?
Then I am myself The World,
which is taken from the second act of Richard Wagner's opera Tristan Isolde,
where the eponymous lovers have this union where, I mean,
they make love on stage, basically.
but they want to overcome their own self.
And so they have what's in modern language called a mystical experience.
They lose the boundaries between themselves, between Tristan Isolde and the rest of the universe,
so they feel they are one with the universe,
which is one of the defining features of what's called a mystical experience.
Well, this is what we can talk about when you're at a certain stage of your successful academic career.
You're talking about expanding consciousness now,
which is certainly fraught territory.
Well, yeah, I mean, yes, I've been fortunate enough to have such an extraordinary experience,
and it leaves you totally unmoored, it leaves you completely flabbergasted.
It leaves you, you know, I had this when I was 65, and, you know, I thought my metaphysics,
my sense of what exists has been fully established, and, you know, at 65 isn't going to budge anymore.
and then suddenly you have this ontological earthquake where all your search, literally all the plates shift and everything you lived and you know, everything you did suddenly looks very, very different.
So it's for sure it's a transformative experience.
In a sense, if you undergo this, just a distinct before and after, you'll never look at things the same way again, which is another defining hallmark of a transformative experience.
So we're talking about some kind of psychedelics or other pharmaceuticals or a purely like meditative state.
No, this was with help.
Yeah, okay.
So, but you're a neuroscientist, you know that you had an experience that was caused by prodding your neurons with chemicals.
So how does that help you get insight into the fundamental.
nature of reality.
Okay, so you're totally right.
My brain was the substrate of this experience.
I don't doubt that for one second.
Helped or not.
But the...
So William James talks about it.
In this wonderful book, I can warmly recommend it to everyone read it.
It hasn't aged very well.
That he first wrote in 1906, you know,
the father of American psychology.
The varieties of religious
experience where he talks about mystical experience.
And he says they bring one of the defining hallmarks of them, this, what he calls
noetic quality, you know, from news knowledge, Greek.
You bring back this experience and it has powerful authority over you.
You cannot help but now try to seek, you know, I'm still a rational scientist in person.
So what I try to do is try to see how does.
what I experienced, how is that compatible with my view of everything else,
including science, including brain science,
including knowledge that my brain was a substrate of this particular experience.
So I think you can reconcile both of those things.
Look, it's a little bit like, imagine Sean the following scenario.
No one dreams.
Okay, people, you've never read about dream.
But when people go to sleep, they just sleep.
That's it.
And you have one experience, one.
How would that change your life?
If you only had one experience, one dream experience, you know, where you met your long-loss, parents or friends, etc., it would sort of profoundly affect you, right?
Absolutely.
I hope it would not lead me to change my ontological view of the world.
Well, because you haven't had, look, and I take no one, and James says it's explicitly,
you can't convince other people of your views, and I'm not trying to.
This is just my experience.
I do know that these types of experience that I write about are common in literature,
are common across all cultures, right?
Lots of people in a lot of different settings have written about them.
So they're not that rare.
It's not unheard of.
And so the challenge is if you accept them, you know,
if you accept them, what does this tell you about the world?
And in particular, what does it tell you about the metaphysical, the metaphysics about the world?
So you can continue to do, I can continue to do all my science, all my neural science, etc.
But it's really shook the ontological foundation of, which is why I'm now much more sympathetic
to idealism, which I hadn't thought about for 50 years.
Okay.
So my question was going to be, so what is the shift in your metaphysics?
but is that it that you're much more sympathetic idealism?
Yeah, because what I experienced there was effectively the world at large that there was no self anymore.
Self was completely gone.
Christopher was gone.
There wasn't a body.
There wasn't anything like that.
And I instead, I experienced the universe at large, literally.
The galaxy, I mean, the universe at large.
Yeah, I know it sounds corny and all of that.
That's okay.
But that's what you experience.
And you're in this time.
there's no passage of time. It's not too slow or too long this moment.
You know, and so, yeah, so you run around. This was at midnight on a beach somewhere in Brazil,
and you, you know, you're totally confused the next weeks and months, right?
Because you're trying to fit in, you know, how does this accord with everything else, you know, I know.
I know. And then sort of I thought that Schopenhauer came upon this remarkable quote of Schopmahua,
where he talks about 200 years ago in his book,
well, his only book he really wrote the world as well and representation,
where he talks about states like that.
And as far as we know, he was not a meditation.
I mean, meditation didn't exist at the time in the West.
Psychedelics really didn't.
He never had any experience like that.
There was, of course, before we encountered opium and other substances.
So he just thought about these things.
And then, yeah, I looked around at idealism,
and then I came across this philosopher computer scientist Bernardo Castro,
who espouses this modern form of idealism.
And in your book, you're going to suggest that people can understand consciousness better
and expand it through these kind of intense experiences?
I would certainly suggest, yes.
So I grew up at a time when, you know, I did, you know, I was heavily into alcohol.
like many of us in the West, but nothing else.
But that's changed over the last 10 years.
Yeah, they can reveal you.
So, A, they can reveal these states of self where your ego is dissolved,
ego dissolution, where there's no self.
And you can experience a profound beauty.
Like here I'm looking at the island, the forest, the green lush forest.
You can just see the transcendent beauty of it whole,
and there's no self to get in the way.
I mean, we need the self.
It's necessary to do long-term planning all of that, but it also constantly gets in the way.
It's always about me, me, me, me, and me.
I mean, look at their most senior political personality in this country who shall remain nameless, right?
The two of them, both of them, right?
Yes.
And it's all about me, me, me, me, me, me.
And so suddenly you have this experience of loss of self, and you realize, well, that's perfectly fine.
The universe is profoundly beautiful without me.
So I think that's really an essential experience that most everyone should have and can have in a safe, if you do it in a safe manner.
Now, not everyone, there's certain dangers.
Some of these substances are very powerful.
So you have to be very cautious, you know, you have to use all the proper safeguards, etc.
But I think for most people, they can reveal aspects of consciousness that they haven't thought about or they have never experienced or they have never experienced or they have never imagined.
imagined.
Good. Should we wind things up by talking about quantum mechanics?
Sure. It seems like a good thing to end on.
Well, I mean, we've talked about it already, but you have a paper out not too long ago
about the possibility that quantum mechanics does play a role in consciousness.
Yeah, so we initiated this collaboration with Hartmut Nevin, who is a physicist
and also his background with computational neuroscience like me. In fact, we had our same advisor
back in Germany, but since then, he's a vice president now at Google and heads the quantum
compute Google group in Santa Barbara building, busy building these large-scale quantum
quantum computers. And then together with a bunch of experimentalists, particularly Ken Kosek,
who's at University of California in Santa Barbara and Luca Turin, who's at a university in
UK. And the idea is, well, so there's theoretical.
work and then right now there's experimental work trying to test it that sort of inverting penrose really
you know penrose famously argued within his objective reduction that the collapse of of the wave
function you have a particular system it's in a superposition that collapsed because of interactions
you know with the environment and that gives rise to a little ping a little bit a little conscious moment
that's his you know that's his argument and then you got together with
with the anesthesiologist to Hammeroff,
you know, microtubli and all of that.
But let's divorce the instantiation of that microtubli from that idea.
It's controversial, but has remained irresistible to many, many people.
All right.
So we are inverting that because we're saying,
well, if you have a system that has consisted of two or three,
or more than one tubid that are all entangled,
something Roger Penrose never considered,
then if that's true, you could then use that to communicate faster than light information,
violating relativity theory, that no one really wants to violate.
So you can invert that by saying, well, no, it is when the system goes into superposition
that you create a conscious moment.
And if you have a system with 20, let's say, qubits, then they go into the superposition of 20 cubits.
But you, of course, the defining thing of consciousness is you only ever experience a definite experience, right?
Not a superposition.
And so this is where the many worlds interpretation come in.
I only travel down one of these branches of the two to the end possibility, you know, if I just have up, down states, two to the end universes.
And that's the one I consciously experience.
And what you experience depends on the way these interact.
And here you could use, for example, IAT to explain that.
So it sort of inverts Rogers' proposal.
And if that's true, you can then sort of build quantum systems that could interact with your consciousness,
as long as you can get a system, you know, if the latest iPhone has quantum computing
and is entangled with my cubits in my brain, then that would be one conscious mind.
So you could expand your consciousness.
if you have the right technology.
Now, it's, you know, it's one of many crazy-sounding ideas in the interface between consciousness and quantum mechanics.
But the great thing is we're trying to test it now.
And this, again, where we come back to this thing, if you ask the right experiment, you can get an answer.
So there have been since, you know, 30 years, Klaus Schulton's work, these hypothesizing,
Partises that biological system, in particular, bird navigation, avian navigation, uses a quantum compass, right?
In quantum, in the interaction in the eye, there you have the interaction between photons and the molecule,
and this depends, weakly seems to depend on magnetic field.
And that songbirds can use that to navigate across vast distances.
ultimately that's based on a radical pair mechanism.
That's one hypothesis or on nuclear spin interaction.
It's another one.
So we are trying to test that.
There has been one claim that xenon.
So you take the rare gas xenon.
It's an anesthetic.
This is known.
It's actually a very good anesthetic because it's rare gas.
It doesn't interact much with anything.
It's very safe.
It doesn't burn.
So it can be used in the clinic.
It's just very expensive.
So it's not really used in day-to-day practice.
but it is an anesthetic.
There's one claim there's an isotope dependency
that xenon 128, 129,
130 and 131 have different anesthetic potencies.
Now, the difference in atomic mass is minute,
is under 1%.
So the hypothesis is unlikely to be due to the difference in mass.
But the most critical difference is that 128 and 130 has spin zero,
while 129 and 131 has been respectively one half and three half.
So now to get a lucaturin is trying to test this very simple experiment in flies.
In other words, if you take a bunch of flies, you put them in a tube.
So now you see 30 drosophila fruit flies in a tube.
You introduce gas, various types, you know, different types of xenon, different isotopes,
dependent xenon gas.
And you compress.
And at some point you see when you.
you reach certain pressure that the flies are all immobile, they anesthetized, and then you release
them again. So you can do this experiment multiple times. So the very simple test is, is it true
that this dependency, how deep you have to plunge the plunger into that vial with xenon gas
until you achieve immobility that here stands in for anesthetic potency, does that depend
on the isotope of xenon? Good.
different model system that we're trying to do with Cancorsiak, what about these human
cerebral organoids made out of human pluripotent stem cells? If you can get them, if you put
xenon on, again, ultimately the tissue will, usually these tissue, these mini brains fire
action potential, if you put sufficient xenon in that ceases, that stops the firing, so does
that the point, the precise point when that firing stops, does that depend on
the isotope. Is it going to be different for Xenon 129 versus Xenon 130? That's the question we're asking.
It's certainly an experiment very well worth doing. I guess it's late in the podcast so I can ask one
technical question. The hypothesis that a system being in superposition is relevant for
consciousness somehow, that's what bugged me a little bit when I saw the paper, because being in
superposition is sort of not an objective fact, right? That is relative to what
basis you're using to describe your system. So is there a more physical criterion that we can replace for that?
No, not right now. Okay. That's why it's science. We've got to do it. Yes. Yes. What is your
thought? If you had to place Bayesian priors here, do you think the quantum mechanics is super important
for consciousness? Probably not in the human brain. Okay. But it would be cool. On the other hand,
look, evolution, you know, it's been around since four and a half billion years,
roughly, right?
And so evolution is very clever, has done all sorts of things.
If it's not outlawed by the laws of physics, you know, somewhere,
and if it's really beneficial for the organism, then it may well have been exploited.
Would I bet my house on it?
No.
Well, not an even one.
That's why we're doing the experiment.
Yeah, that's why we do the experiment.
And that's a very good philosophy to end with.
So, Christoph Koch, thanks so much for being on the Mindscape podcast.
Thank you very much for having me, Sean.
It was very enjoyable.
That was very enjoyable.
Good.
What is your paper about?
You said you just published a paper 10 days ago?
Oh, it was just a review article for Nature and essay about the 100th anniversary of quantum mechanics and why it's still controversial,
why it's still difficult to really figure out and get a consensus on what quantum mechanics actually says.
That's right.
1925.
It's the quantum year.
United Nations has said that this is the
year of the quantum, yeah.
And we still don't understand it. And it's not true for general relativity,
right? There are none of these controversies
swelling around GR. No other
theory has these controversies. There's not
like a whole subset of people doing
philosophy of electromagnetism, right?
It's quantum mechanics is the one
that, and I think it's an
embarrassing situation for
the physics community because we have not
addressed the problem. I think that's an issue.
Yeah.
But it's also an opportunity.
Exactly.
Well, I like to say, like, I personally am very slow,
so I'm perfectly happy with the rest of the community not racing me to do this.
I'm trying to figure it out myself.
Yeah, so please send it to me the article.
I will do that.
Thanks.
Thank you.
That was fun.
