Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 352 | Bing Brunton on Connecting the Connectome to the Body
Episode Date: April 27, 2026The connectome is the wiring diagram of a brain, a big matrix that tells us what neurons talk to what other neurons. Understanding it is an important step to understanding how brains work, but a... long way from the final answer. A big next step is understanding how neuronal circuits connect to and guide bodily behavior. Very recent work on mapping the fruit-fly connectome has brought us closer to that goal. I talk with neuroscientist Bing Brunton about the connectome, how we can study it to understand bodily motion in flies and other creatures, and where it's all taking us. Chubbies is here to keep you comfy and looking good year-round. Get 20% off with code MINDSCAPE at chubbiesshorts.com/MINDSCAPE! #chubbiespod Upgrade your denim game with Rag & Bone! Get 20% off sitewide with code MINDSCAPE at www.rag-bone.com. #ragandbonepod Support Mindscape on Patreon. Blog post with transcript: https://www.preposterousuniverse.com/podcast/2026/04/27/352-bing-brunton-on-connecting-the-connectome-to-the-body/ Bing Wen Brunton received her Ph.D. in neuroscience from Princeton University.. She is currently a Professor of Biology and the Richard & Joan Komen University Chair at the University of Washington, with affiliations at the eScience Institute for Data Science, the Paul G. Allen School of Computer Science & Engineering, and the Department of Applied Mathematics. Web site University of Washington web page Google Scholar publications YouTube channel Bluesky Artworks (Instagram)
Transcript
Discussion (0)
Hello, everyone. Welcome to the Mindscape Podcast. I'm your host, Sean Carroll. As you are listening to this podcast or listening to anything else or looking at anything else, your brain is processing information. We can argue about how much information is in the podcast or anywhere else, but in some sense, there are bites of information being sensory inputted into your brain and then processed and that affects what you do, how you behave. Now, as we've talked about it,
out in the podcast recently, there's other things going on in the brain and the nervous system
and the body as well.
It's not just information processing.
There is absolutely information processing happening, but that's an abstraction, right?
What there's actually happening are atoms, molecules, cells, doing various physical things,
and we find it very, very interesting and helpful to talk about those physical processes
in terms of information being processed.
And today we're not going to worry about deep questions
about whether or not that information processing
is efficient for consciousness or anything like that.
We're going to get our hands dirty a little bit
and think about the connection
between what goes on in our brains,
our nervous systems, and our bodies.
There's a constant interaction.
In fact, it's even, of course, a little bit of a mistake
to separate our brains from our bodies
because our brains are part of our bodies.
So in reality, we're going to be talking about interactions between two different parts of our bodies,
how we move around in the world, and how our brains send signals back and forth,
receiving signals and then transmitting them to the nervous system, which then does things.
We've also talked recently on the podcast about the connectome,
the idea that if you knew every neuron in a brain or maybe some coarse-grained version of groups of neurons,
and how they connected to each other, you would have the wiring diagram of the brain.
And so we have some wiring diagrams for simple organisms, nowhere close to human beings yet,
but we're working on that.
What does that give us, knowing the wiring diagram, knowing how that information flows around?
How does that then go into controlling our bodies and what we do and our behavior?
So that's what we're going to be talking about today.
Bing Brunton is a neuroscientist and biologist at the University of Washington.
And she has been leading the charge in very recent days.
We've mapped out the connectome of the fruit fly.
You might know that we've mapped out the connectome of sea elegans, the little worm that
biologists like to study.
It's only 300 neurons, right?
The fruit fly has over 100,000 neurons, and now we've mapped out that.
So that's a much more subtle system, a lot more intricate things going on, little subsystems
doing different things.
And so we're going to be talking about how we can learn about the relationship between the fruit fly brain, such as it is.
There is a brain there.
It's pretty impressive, actually, and how the fruit fly does things like walking around, flying, other kinds of things.
This is absolutely new stuff, less than a year old, and just the beginning of a forefront of really interesting research in biology and neuroscience.
So let's go.
Bing Brunton, welcome to the Mindscape Podcast.
Thanks, Sean. I'm glad to be here.
So I think that for this audience, it would be good to start pretty broadly because the brain,
the brain is kind of like time. I've written books about time.
And what I've noticed when I wrote books about time is that everyone has an opinion
about how time works, what it is, things like that.
And I think that maybe the brain has a little bit of that, right?
We all have brains.
People have their opinions about how it works.
I'm rather attached to mine.
Yes, exactly.
So, but the connectome in particular is something we have talked about in the podcast before.
But why don't you give us the high-level overview of what the connectome is, how the neurons work, all that fun stuff?
Yeah, that's actually, yeah, you went right for it.
I think there's actually a little bit of some of the confusion around connectomes is exactly
what it is because people use that word in a different way, and I'm sure you know, the terminology
actually does matter here, right? So I think the rough definition, and my colleagues actually
differ on this, and so I'm going to try to channel them a little bit. The rough idea is that
we all know that the brain is composed of cells because it's an organ, like every organ in your body,
so it has cells, and the cells work by electrical activity, and they talk to each other
through electricity. And so unlike an anonymous net of cells that are just kind of passing messages
forward and backwards, the cells actually have specific identities. Some of them have specific
jobs. And they also have specific localization. Some cells are found in different parts of the brain
and nervous system, and some parts are not. And so there's essentially a wiring diagram, so to speak,
of the brain. You can think about it in terms of, you know, if you're like building a really big
complicated building, right? You're building a skyscraper or something. You would have a wiring
diagram, you know, a literally engineering diagram of, okay, so this is where the transformers are,
I'm going to slip this switch, and this thing's going to turn on these lights over here, right? So you
can sort of have a diagram of that, and that's sort of the connectome, roughly speaking, is that
for all the cells and their connections and the identities in the brain. Now, the difficulty comes in
in terms of how do you actually define the units?
Like, do you want a connectome that's necessarily at the scale of individual cells
and how they're connected to other individual cells?
Okay.
Okay.
So that's one way people have used that term.
But they're sort of like more what we call meso scale connectomes that exist as well.
In particular, because there's certain animals that are so big, like humans, for example,
or even smaller rodents where we can't really get technologically.
We don't have the capability of getting the cell by cell connectome.
We just can't do it.
Some people think we should.
Some people think it's impossible.
Some people think even if we could have it, it's useless.
But nevertheless, we have these like, like if you hear about the human connectome,
the human connectome is not the scale of cells and how they connect to each other.
It's mostly like brain areas and the how the brain areas connect to each other.
So people use that term to mean like an area by area connectome as well.
So there's some coarse graining involved.
There's a lot of coarse graining.
And so people don't agree on how they use that term.
Okay.
Right?
Okay.
So the whole omics thing in biology,
so every word that ends in omics like genomes, proteome, trisputone, right?
It's supposed to mean comprehensive map thereof.
Hmm.
Okay.
Now, people usually agree.
If I tell you, hey, Sean, I got a genome of a new, I don't know,
spider that I found, you would expect that genome to be at the resolution of the base pairs,
the A, C, Gs, and T's.
Right.
Like, you have that expectation.
If I gave you something else, you were like, that's not a genome.
I don't know what this is, but it's not a genome, right?
So we don't have that in connectomes.
Like, we don't quite agree on the scale of description of like, what is the, what is the, what is, like,
do you need to have every single neuron in that spider for that to be the connectome of a spider, right?
But the human brain has like 85 billion neurons.
We do have some maps of connectomes of, of,
of more manageable creatures.
We do.
Some.
We'll get there.
I did notice you were
kind of very careful there
about talking about cells
rather than talking about neurons.
I presume that's because there are other cells.
There are other cells,
and they're clearly important.
So the rough estimate
in my understanding is that half of the
cells in your brain are not
neurons.
I mean, our word for not neurons
this is just glia, which doesn't mean anything except just the word for it.
And they're clearly important.
People used to think that they are just there to, you know, kind of like custodial staff or something,
but that's so trivializing.
They do a lot more than that.
They clearly are involving all kinds of vital functions and they have their own dynamics.
But we don't understand.
I think that's like a really, really exciting emerging field in neuroscience,
just understanding all of the other cells in your reign and what they do and what they do
in concert with the neurons.
Let me demonstrate how ignorant I am about biology.
I mean, you said the body is made of cells, et cetera.
Is it entirely made of cells?
Like, is everything in our body's cells?
There's got to be like just some liquids and solids and things in there.
Oh, for sure.
Yeah, there's definitely stuff in the extracellular space.
Yes.
But I think all I meant was that all of life, as we know it, is made of cells.
Right.
We can quibble about viruses later, but, you know, living organisms are completely,
pose of cells.
Yeah.
But I think one of the lessons that we're going to be bumping into over the course of
the podcast is biology is messy.
Things are more complicated than be squishy and interconnected and complex.
And I mean, maybe one of the things to keep in mind is that a macroscopic organism
is pretty much a matter of teamwork between different kinds of cells, but also cells
and non-cell substances.
Yep.
Mm-hmm.
Yeah.
All stuff, right?
For example, your bones, right, your skeleton, you probably know that it's made out of, you know,
lots of inorganic compounds. Like there's a lot of calcium in there, right? So you drink your milk.
Your mom tells you drink your milk. But your bones, even though the skeletal elements of it,
a lot of its material properties come from the calcium matrix and lots of other stuff that's
going on that's kind of complicated, it's also this really intricate meshy structure
that has blood vessels all inside it, right?
Right.
Because it needs to be vascularized, otherwise it's going to die.
It needs sugar to be fed.
It needs oxygen to stay alive.
And so even something that you think is structural,
like it's not like a stainless steel beam in a building.
It's not, it's alive, right?
And it's alive in a way that only cells can keep it alive.
And so there's cells all incited.
And if you just like zoom in, it's got very intricate structure.
I do think this is not what we're talking about,
but I do suspect that that's got to be a frontier of artificial organism building.
Like when we build robots, we make steel beams.
We don't make it out of cells, and that means it doesn't repair itself, etc.
We think about that quite a bit.
And so not only, I mean, this is relevant for our thinking of connectomes,
but really it's just a really great fundamental question of biology,
is how organisms are able to recover from injury and repair ourselves.
Or sometimes not.
Yes.
Well, you and your friends are going to figure out how to make all of my organs repair themselves and make it soon, okay?
We're going to try.
It's going to be fun.
Okay.
Just to follow up, the last little bit, very interesting that half of the cells in my brain are not neurons.
There are the other things, the glial cells.
So we are, again, we have this cartoon picture.
in our brain of the neurons firing signals back and forth to each other.
Is it that feature that distinguishes neurons from non-neurons?
It is, yeah.
And so the connectome is the fine-grained connectome, if you want to call it that,
the level of cells.
We can hold the cellular level one or the neural one.
Cellular-level connectome.
That would be just a big old matrix listing every single neuron and how it connects
to every other neuron. Yep, exactly right.
Yeah. Okay, good.
From a computational perspective, because I am a computational list, by the time it gets to me,
it's that gigantic connectivity matrix and it has structure, it's sparse, it's not an all random,
it's all kinds of cool. Is it, it's not symmetric either?
Not at all.
Talk to others, but they don't listen necessarily. That is correct.
Okay, some asymmetry there.
Yeah.
And in the, but okay, so is it, is technically the connection?
dome, just the wiring diagram, or is it that extra information about where information flows?
So there's a lot of extra information in it. And so this is the analogy I tried making earlier
about the genome as well. Like we don't even understand, we don't agree on the correct way of
representing the information. So that giant connectivity matrix you talked about, Sean, is
definitely a part of the information, but it's nowhere near all the information that we get
out of this technology.
So for instance, it matters the identity of the cells because the neurons are not,
they're, I mean, you probably heard about things like dopamine, serotonin, right?
Like, there's dopamine cells, there's serotonin cells.
And if they both fire an actual potential, they both say something, those messages are completely
different, right?
And so the identities of the cells matter.
Yep.
The other thing that really matters is how those messages are received, right?
And so, so, so in analogy with, uh, with kind of, it's, it's very like context dependent, um, language, trying to think of a, of, of an interesting social analogy. Like, if you say the same thing to two different people, depending on your relationship with them, they can hear very different messages. Right. Does that make sense? Yep. 100%. So when cell A speaks to cell B and the cell A says exactly the same thing to cell C, depending on the identities of B and C, they could hear very different. So, so when cell A says exactly the same thing, they could hear very different. And so, so when cell A says exactly the cell B and C, they could hear very different. And so
messages and do very different things with it.
Sure.
If you say you're a bonehead to your best friend, it's received differently than if you say that
to your graduate students, right?
That is entirely correct.
Right.
So messages are received differently.
Yeah.
So that's why we care.
Thank you, HEC.
Thank you for coming up with analogy.
Yeah.
So the the identities to the cells matter.
There's other, lots of other really interesting, but also very detailed, biophysical properties
of each cell.
that clearly do matter, but we don't know by how much.
So the thing that I usually try to tell my graduate students when I'm first introducing them to this type of modeling that we do is,
like say that I'm trying to, I'm a, you know, I'm a civil engineer, I'm trying to build a building, right?
And I need some materials to hold up the roof.
And I say I need to know the properties of this beam so that I can hold the roof up.
up. Now, the beam is made out of atoms, and I know that there's, you know, there's like
down there, some of there's quantum mechanics, right? But we are not solving short-dance equations
in order to design a roof. It's just, it's way too much. So like, it's super interesting and maybe
you'd be interested in the side, but you don't need it for the, for the task of building a roof.
So that's sort of where we are right now. Like, I know I don't need every single detail
that is known about these biophysical parameters of these cells. They get really funky.
They're a crazy non-linear and they're super special and they're almost impossible to measure.
People will spend an entire PhD measuring one cell and characterizing a lot of detail.
But do we need it for these very holistic models of the entire animal and nervous system?
Probably not.
Where do we stop?
It's hard to say right now.
Right.
Like I know I know I don't need every single detail, but I do not know which of them are
actually crucial.
Summer time is here, and it's time to finally break out the shorts and swim trunks.
But just because your wardrobe becomes more casual doesn't mean you shouldn't put thought into it.
That will become clear the first time you try Chubby's Trunks.
Chubbies make swim trunks, shorts, and summer shirts that are designed with intention to be
both functional and look great.
You might wonder, what does it mean for swim trunks to be functional?
How hard can it be?
Chubbies will convince you that it matters.
They're engineered with four-way stretch fabric that lets you transition effortlessly from swimming laps to lounging poolside.
They're seriously soft, dangerously flexible, and incredibly quick drying.
And you will look good.
The compliments that you start receiving will be proof of that.
There's no reason to dread beach season, nor to take it for granted.
Chubbies will make you start looking forward to 5 p.m. Friday and the weekend to come.
They're proof that when you get shorts right the first time, they never really go out of it.
style. And now for a limited time, Chubbies is giving our listeners 20% off with code
Mindscape at chubbies shorts.com. That's 20% off your order with code Minescape. Give your thighs
the VIP treatment they deserve with Chubbies. Support our show and tell them we sent you.
Whenever you get dressed in the morning, it's nice to not have to think too hard, but also nice
to look good. Rag and bone is here to make that possible. Clothes that feel good right out of the
box and look both stylish and effortless with a wide range of combinations.
The new infused line of denim at Ragginbone is a great example.
Ragginbone uses a proprietary eight-step over-dye process that gives each piece of rich
depth that gets better with every wash.
It looks like something special and you'll feel like that when you have them on.
I have both a Ragam Bone infuse jacket in gray denim and jeans in blue denim.
They go with everything and they fit perfectly without fuss.
You pick the size and style your look.
looking for, from slim and straight to athletic and relaxed. It's not just denim, of course,
rag and bone has soft t-shirts and comfy nits that pull your look together. It's premium wardrobe
staples made to last and made to live in. So it's time to upgrade your denim with rag and bone.
For limited time, our listeners get 20% off their entire order with code Mindscape at rag-dashbone.com.
That's 20% off at rag-dashbone.com with promo code,
Mindscape. When they ask where you heard about them, please support our show and let them know
we sent you. And the individual neurons are different not only sort of structurally or biologically,
but even in terms of information processing, right? Like they have different, I don't know,
I want to say algorithms for turning input into output. Is that fair? I think that's fair. Yeah. So if you
think of it computationally in terms of just maps, right? If you are able to define exactly what
its inputs are and what its outputs are, then you can infer some kind of function that maps
it from the inputs of the outputs, right?
I think that's a totally valid way of saying it.
And I think that might be one of the clues, computational clues as well, in order to be able
to run some of these simulations, is that you don't need every single detail of how that
map is implemented to approximate its function.
But is the specification of how each neuron maps inputs to outputs part of what we call
the connectome or is that a next step?
It's not.
It's not.
Okay.
So, I mean, I don't know.
It's hard to say, right?
But I feel like this is partially why I, among some of my colleagues, I'll admit, I'm,
you can't, you know, the audience can't see, but I'm raising my hand right now.
I was skeptical.
Okay.
So this whole thing started, I don't know, I feel like I was in grad school.
I first heard about these, like, really large efforts to produce more connectome data sets.
and whatever, it was like, whatever, 15, 20 years ago.
And I remember thinking that's like, well, I won't tell you what I actually thought.
But I was skeptical.
I was skeptical.
I was skeptical on a couple of different fronts.
I was skeptical that it was even going to work at all, right?
Like, can we actually reconstruct one of these things at sufficient scale?
Because it involves, I don't know, like running a transmission like Chrome Mexico for six months straight,
making zero mistakes.
And so I was skeptical it was possible.
even to do it in the first place.
And then I was further skeptical that if we could have it, right?
Like if somebody just hand it to you magically tomorrow, like what would you do with that?
Right.
Like how could you even make sense of this giant spaghetti monster that somebody just handed you?
And so, so I think, I think some of our, I mean, it's only been pretty recently that some of the work that my lap has been doing with some collaborators has started to convince me that, hey, this might actually, I think we might actually be able to do that.
Now, the reason I was skeptical, and lots of other people were skeptical, so there were essays written, I don't know, ballpark 10, 15 years ago by lots of people in the field, including like Eve Martyr, Corey Bargman, is because they knew that there were so many other details that are not observable by the connectome.
Like this information about all of the channels, the biophysical properties of some of these cells, we can't get them from the connecto. We know we can't. We never thought we could. Nobody thought that we could, right?
So the disagreement was whether or not the stuff that you can measure, effectively, these, these, these connectivity matrices, is that sufficient to teach us something?
Is that good enough to do something? Yeah. Yeah. Versus sort of the other logical extreme would be it's utterly useless because you actually need all of the other stuff, right? And so there's a giant continuum of opinions. And I was, you know, I was somewhere in the middle, but, you know, kind of in the little skeptical side. But I never actually worked in the connect room. I was simply fascinated by these.
by these efforts that some of my friends were undertaking.
And my current opinion is swaying a little bit closer to the,
I think we can actually do something useful with this dataset.
Having done useful things with them,
I think that's a good opinion for you to have.
So what are the connectomes that we do know something about,
even if the human cellular level connectome is far away?
What do we know?
What animals do we have the connectomes of?
So the first one we got was actually,
like 30 years ago, we have a full
connectivity matrix of the sea
elegance nematode worm.
It's not an earthworm,
like the kind you see sometimes attempting
to cross the sidewalk and perishing in the middle.
It's not those. They're much smaller.
They're flatworms, their nematode flatworms.
They're about a millimeter long,
and they live in the soil.
So if you got, if you scooped up any soil in your garden
and looked it onto a microscope, you're very likely
to be able to see them there.
fucking everywhere.
Okay.
And so they're a millimeter long, and they have, this particular species has been studied
a lot in molecular biology because they breed really quickly, and so we have tons of tools.
They have about 1,000 cells and about 300 neurons.
And so the connectivity matrix of those 300-ish neurons has been mapped out decades ago, many
decades ago.
And so if you talk to people in connectomes, one of the first things they always bring up
It's like, but we've had the connectome of the Cieligan's worm for so long,
and yet we still understand it.
We do not understand it.
Right.
And there's actual good technical reasons why C.L.
against worms are actually really difficult from a connectomics perspective to understand.
And so the one that has come out much more recently in the last year or two is a couple of efforts by lots of giant collaborative teams.
I was not involved in any of these teams.
I was simply cheering them on from the sidelines to mapped the full connectivity matrix of a Drosophila fruit fly.
Fruit fly.
Fruit fly.
Yeah.
So this is a kind of fruit fly that every year at the end of the summer, my kitchen gets infested with fruit flies.
And I can't get rid of them.
So you've seen them too in your kitchen.
They buzz around.
Anytime you have a little bit of rotten fruit or a pile of compost or something in your kitchen, that's where they live.
So these little guys are, they're more like three millimeter, millimeters long.
And so they're like the size of a grain of rice.
And their entirety of their nervous system is more like the size of a sesame seed.
Okay.
And so they're small enough that it has been possible to reconstruct the entirety of their brain
and nervous system. So we have a brain in our heads, and we also have a spinal core. So that constitutes
our central nervous system. So the brain and spinal cord of humans and mammals, right, and vertebrates.
They have an analogous structure, so they have also a central brain that's inside their head.
It goes down their neck, just like ours. And then the remainder of, instead of a spinal cord,
insects and invertebrates have this thing called eventual nerve cord. It's actually remarkably similar
in terms of its structure and how it's organized to our spinal cord.
But instead of being on their back, it's actually in their stomach side.
So it's on their belly side.
It's why it's called Ventral NurbCord.
Anyway, so that's, that whole thing has been mapped out.
And there's two of those datasets for one male and one female fruit fly,
and that was only published in the last half a year or so.
Wow. And how many neurons?
So the brain has 150K, and then the, and the ventral nerve cord
it has an additional 22K.
Okay, good.
So a much bigger matrix than our little C. elegans.
There's a much bigger matrix.
And I think the important thing about the size of it,
paradoxically, is that it's actually a little bit easier to understand
from the connectivity matrix.
Now, the reason that the C. elegance connectivity matrix
has been so hard to understand is it took us a while to figure this out as a community.
They do a lot of,
computation not using that kind of connectivity matrix.
There's a ton of chemical communication.
They're constantly squirting out neurotransmitters and other chemicals at each other.
There's all the mechanical computation.
So it's a, it's a squishy thing that crawls around in a matrix,
in a not a mathematical matrix, a soul matrix.
And so there's a lot of mechanical stretching and reflexes that go on like that.
You know the thing the doctor does when they like, yeah.
They have those reflex loops that are mechanically.
coupled with their body, which is squishy, right? And so the physics of that is like pretty
complicated. So, so the short way of saying it is that the way that they function as an animal
is, is taking advantage of lots of other computational properties. So they do chemical communication,
they do mechanical computation, in addition to neural computation. So the fact that we had the
neuroconnectivity matrix was just not quite good enough to understand.
what they do. In contrast, it is some of our current understanding and perhaps hope that the
connectivity matrix of the fruit fly, because of that is a little bit bigger, it has jointed limbs,
just like humans do, and it has enough cells that are actual cell types. Like, not every single
cell is just like its own little snowflake. Like, they actually have types of cells. All of those,
we are hoping, makes it so that that connectivity matrix is,
more helpful, more directly helpful,
like helping us understand what the heck's actually going on.
In other words, because individual neurons, et cetera,
might be more specialized or something like that,
rather than just like every neuron pitches into every task.
Right, yeah.
So the CL against neurons, some of them are, I mean,
they're like, they're so not, they're so not specialized that,
you know, how we have, you know, we have a visual system.
So there's cells that detect photons.
And we have a, we have olfactory systems,
cells that detect smells, right?
Like, they have single cells that have multiple sensory modalities going into it because it's just so
tiny, it's so compressed, right?
They've had to multiplex in that way.
And we don't see that as much in our understanding in the worm, in the worm nervous system.
And that's a feature, it's a computational feature of how their nervous system works that's in
common with ours.
And with the fly connectome, the fly neurons.
I saw in one of your videos these images of these neurons.
And I think that people, certainly I have this image of a neuron,
like a little blob with a couple little spikes.
But these are very spindly things.
They're stretching across some non-trivial fraction of the size of the fly.
Right.
Do you know the longest cell in your body?
I do not know the longest cell in my body.
It's about as tall as you are.
That's a little freaky.
I don't want to think about that.
It's a little freaky.
So you have these cells that actually the same cells we were talking about in the ventral.
So in the insects, in the ventral nerve cord, in your body, it's in your spinal cord.
Okay.
You have these cells that are responsible for how, this is how you know you stopped your toe.
Okay.
So there's a cell that detects when you've stepped your toe.
So one end of it is at your big toe.
Okay.
And the other end of it, it goes all the way up to your brain stem.
So the very base of yourself.
So talk about long and spindly.
Why does it need one cell to do that?
Can't like a bunch of cells hand off the message?
You can do it?
No, this is the actual, this is the normal architecture.
Okay.
There are other cells involved and you can hand off the message.
The advantage of having one cell do it is that you can do it really fast because as it happens,
if you stub your toe, your brain really wants to know about it very quickly.
Stupid brain.
I don't think I want to know about it.
I just want to get all that.
Well, this is how you don't fall over.
It's all the shit that your body does that, like, you don't think about, right?
You don't have to think about not falling over.
If you're hiking and you kick a rock, you don't fall over.
And you also don't want to waste your precious time thinking about how to not fall over.
You simply want it done, right?
You want to keep on having that conversation about number theory you're having with your buddy, right?
You don't have to think about how to not fall over just because you kicked a rock.
Which segues very nicely into the,
actual work you've been doing with the fruit fly connectome. So you have the connectome. That's good.
And then there's this open question that you elucidated very nicely. Is it good enough to help us do
anything? And you've been asking, what is the relationship between the connectome and walking in the
fruit fly? Is that right? That's right. So I don't know. How do you even start with that? What do you do?
Well, so the slightly longer story is that this is a long time collaboration I've had with a friend, a friend and collaborator of mine, John Tetthill.
And John is a fly experimentalist. His lab does neurophysiology, and they study the ventral nerve cord and the sensors that come in as well as the motor control that goes out, right?
Like that's what his lab does. And we've been collaborating for, you know, like a decade now and have co-advised a series of,
of graduate students and postdocs, doing some combination of theory and modeling.
And it's been super fun.
And so John's also been really involved in some of these connectomics efforts.
So a lot of what I said, the stuff that I know that is not wrong is because I learned
from John.
Stuff that is wrong.
I made that up.
I take responsibility.
And so I remember a couple of years ago, John and I were taking a walk, and we had a brand-new
PhD student who was thinking about joining our labs.
And we're like, oh, what do we, what do we have them do?
Like, we got to think of something, right?
And, and John and I were talking, and he's like, well, we have, like, we're, we almost have
have eventual nerve cord connectome.
It's like, it's almost ready because they were like in the process of cleaning it up,
curating it, trying to write it up, right?
He's like, what if we just, like, simulated it?
And I said, that's, that's never going to work.
Let me tell you all the ways this is not going to work.
So I told them all the ways it was not going to work, some of which I summarized earlier,
you know, the biophysics, all the parameters we don't know, blah, blah, blah.
There's tons of stuff.
There's lots and lots of reasons that wouldn't work.
But by the end of this talk, we had come to, well, you know what, let's try it anyway.
You know, it's not going to, we don't lose anything.
We're like, let's just, let's give it a good old grad school try.
I do, I do, by the way, think that like half of the secret to succeeding in graduate school
is listening to your advisor tell you that won't work and distinguishing when they're right from when they're wrong.
Absolutely.
So, so our student, Sarah Puclisi,
listened to us and she said, okay, he went off and wrote some code. So I'm, of course, long
story short, it took a couple of years, but we kept at it, partially because some of the preliminary
stuff was actually, it was kind of interesting. There were some hints, right? And what ended up
happening is that we went after a question that biologists and neuroscientists have been asking for
over 100 years, which is this question of how does the
nervous system generate rhythms from not-thinoms. How does this happen? And to tell you, give you a
context a little bit about why this is such an important question, all animal movements are rhythmic.
Actually, not just animals, like even bacteria move by spinning their phlegelum, right? So basically
all biological movements are cyclic in some way. So you can be walking, running, swimming,
slithering, crawling, like basically all locomotion is rhythmic, right?
And so the fact that your nervous system needs some way of generating the instructions
for your muscles to move in a circle, that's fundamental.
Okay.
This is like one of the – and so we've been – ever since the 1910s, some of the first experiments
demonstrated that the generation of these rhythms is not by reflex only, is that your central nervous
system, somewhere in your brain and spinal cord, was capable of generating these cycles.
But we didn't know exactly where. We didn't know which cells did it. We didn't know how they did it.
And this, so just by the way, like the idea of some system of mechanical things, cells or anything else,
vibrating in periodic ways, that's one that appears all over the place.
All over the place.
We understand that, yeah.
We understand this in general.
And if we have time, I'll come back to, like, I love dynamical systems.
We can nerd out about the dynamical systems of oscillator equations a little bit later
and actually has connections to our work in the connectum as well.
But yes, absolutely, yeah.
And so in the intervening 100 years or so, lots of people have studied
this, this, this, the idea of these circuits.
And so the ability of your nervous system
generate rhythms is not only important for locomotion.
It's also important for things like breathing.
All right?
Because you have like inhale, exhale, inhale, exhale.
You can control it, but if you don't think about it, it just happens.
And so that's generated by what we call a central pattern generator,
a CPG circuit as well.
Digestion is cyclic.
All right?
So you have to turn the stuff in your digestive system.
So there's a, yeah, so there's a sequence of muscle contractions that gets your, gets the food go down.
I see.
Okay.
And in your stomach, especially the stomachs of, so the most studied CPG circuit,
centropodininary circuit is actually in the crab digestive system.
There's a couple of these like adorable little neurons that are responsible for churning what's in the crab stomach goes,
It's called, go, go, go, go.
And it makes that rhythm.
And you know which neurons are in charge?
This is the work of Eve Marger.
She is known for having studied this for decades,
and that system is so extraordinarily well understood.
It's probably sometimes people are a little snarky,
and we say, like, the crab digestive circuit
is, like, the only neural circuit we actually understand in all of our neurobiology.
It's a bit of an exaggeration, but it's not untrue either.
Like, we actually understand that circuit.
And the thing we're looking at, so the idea of central pattern generators, these are little sub-circuits within the connectome that are responsible for, is it always cyclic rhythm motions or is there a more general definition?
That's probably the plainest definition of it.
And then so the CPG is, I mean, like roboticists love the CPG.
So a lot of modern robotics is built on these oscillator equations.
So they don't even, like, I've talked to roboticists who, like, actually have no idea about the neurobiology of central phatogenators because for them it doesn't, they don't care.
They just write an equation.
We've done the same.
So a lot of these, like, computational models of locomotion in animals and robotics, it's just based on a, you just write an oscillator equation.
It just goes around in a circle.
It's not, you write.
There's not, lots of them you can write.
It doesn't really matter how it's implemented by cells.
You just care that there exists a thing that goes in a circle, right?
But we didn't know what actually were the cells and their connections in an actual nervous system that generated these rhythms for any animal that walks.
So that's where we were a couple of years ago.
It's like nobody had ever actually found what are the cells, what are their names, how do they work?
So in other words, you knew from prior experience with digestive systems and breathing that there had to be these CPGs, central pattern generators that would do these rhythmic motions.
You also know that walking is kind of a paradigmatic rhythmic motion,
but we hadn't quite identified.
We hadn't quite defined the actual cells.
And so, to be fair, people have so that need lots and lots of walking systems.
People, like, there's tons of, like, just, like, whole bookshelves in the library
about spinal circuits of walking.
Invertebrates have these ventral nerve cores.
How do they generate their wing flapping?
How do they walk?
Like, people have tried, and there's tons of information.
Uh-huh.
But we didn't know precisely which one, which cells they were and how they worked.
All right.
So what are you going to do?
So we had an opportunity.
It's not like we were smart and all of these other people who have worked on it.
It's just that we had an opportunity of having the complete connectivity map.
Right.
Of the eventual nerve cord of a fruit fly.
Right?
And we figured, whatever it is, it's got to be in there somewhere.
Uh-huh.
Right?
Like, we don't know.
like instead of starting from building it up from individual components that I can actually do experiments on,
we talk the reduction of approach.
We're like, it's in here somewhere.
You know, we got it down to, you know, a network of 4,000 cells or so.
We're like, it's got to be in here somewhere.
So wait, when you say you got it down, you're basically like saying, okay, we have 150 or 170,000 neurons.
And you like eliminate, like you say, like if I didn't have this one, it could still walk fine.
Precisely. So we simulated, okay, so first thing we did is that we, we, we, to make it a little more manageable, we focus on only two front legs. So in sex of six legs, so we just got rid of the other four, we're like, okay, let's just have two legs, the two front legs. We got rid of all of the parts of the nervous system that don't control the two front legs. So we just have two front legs. That's how we got to 4,000 ish. Okay. Okay. So then we simulate that and we were able to demonstrate that that those four,
4,000 neurons were able to generate a cycle. They can generate motor rhythms and actuate the muscles
that would have to move the leg. Again, you can't see me, but I'm moving my arm forwards and backwards.
It actuates these muscles right here on your shoulder, like the ones that move your shoulder forwards
and the ones that move your shoulder back. Okay, so just by simulation, again, we're doing no
reinforcement learning. There's no machine learning here. There's actually no deep learning going on at all.
We're just doing brute force numerical simulations of this giant connective matrix.
Shallow learning.
Regular numerical simulations.
It's not that we've been doing for a long time.
You write a lot of code and you run it a million times.
We can get these rhythms to come out, right?
So then we asked, now that we have these rhythms,
now that it's actually in here somewhere,
now let's try to reduce it.
Now let's cut away one at a time.
We basically just started getting rid of cells.
We're like, do I need this one?
No. Do I need this one? No.
And you just keep going until you've thrown away
as many cells as you possibly
could without losing the rhythm and what you have left over is the minimal circuit. Does that logic
makes sense? I think it does. And so this is just one leg or I guess it's symmetric. The front
two legs are doing the same thing. By the way, let's just take an aside to explain the fascinating
question, which is the wings. Yeah. Yeah, I know. It's wild. So I would have thought from my
mammalian-centric point of view, that wings are just like, you know, arms that have
own wing leg, but flies are very different.
Not so. Not so. So, so this is something my friend in collaborating Michael Dickinson is very
fond of saying. The insect wings are actually novel limbs. I'll explain what that means.
So for every other animal that flies, like bird wings are modified arms. Bat wings are modified
arms, right? Other animals that fly have wings that used to be not wings.
not so of insect wings.
They're not modified legs.
There's theories about exactly how they evolved,
but they're actually novel structures.
It's not like they took a pair of legs.
It's not like they used to have eight legs,
and two of them became wings.
These are just actual new things.
And this is reflected in the nervous system.
Say it again, please.
This is reflected in the nervous system.
It's very much reflected in nervous system.
So just like there's these little parts of your spine that correspond to it.
Like you have parts of your spine that's like, this goes to the left leg, this goes to the right leg, this goes to your trunk, right?
Like same thing.
They have parts of their ventral nerve cord that go to each of the six legs.
And you can actually see them.
They're like little balls that kind of stick out.
They're a little bit bigger because they have more cells.
And then they have the same thing.
Like there's little clumps of cells that correspond to the wings.
Cool.
Okay.
So there's a whole separate future of a research project understanding how flies fly.
you're trying to understand how they walk.
Yes, just walking for now.
And how did that go?
It worked great.
So the pruning study that I briefly described earlier
where we took a functioning system
that was able to generate these CPG rhythms
and then we started just pruning it.
We started cutting away everything computationally
that didn't seem necessary for it to be there.
I remember I was sitting in actually this office
with Sarah and with John,
the day we figured out, okay, let's give it a try, you know, like, let's do this pruning study.
So remember we started out with 4,000 cells.
And I remember telling Sarah, Sarah, just go give it a try.
You know, if you get it down to a few dozen cells leftover, like that, if that's the minimum
circuit, you need a few dozen cells to do this, I would be ecstatic.
Like, that would be a really cool result.
She went off and did it.
The answer was three.
Three cells.
Three cells.
That's the minimum you need.
and they have names.
We know who they are in the fly nervous system.
Tell us their names.
That would be fun.
That is a great question,
because I actually have no idea
where their actual names are.
Their names are known.
Their names are known,
and their lineages are known.
So we sort of know where they came from.
The names are, I can't handle this.
The names are like a series of letters and numbers,
and I can't remember what they are.
You're the one who said we know their names.
That's the only reason I ask.
Okay, we, the royal we.
The Royal Vane.
Like John knows what their names.
So I have no idea what their names are.
We gave them pet names, though.
Of course.
Of course, we had to give them pet names.
And they're not too cute.
But so there's three cells.
And remember I told you earlier, the cells have identities.
It kind of matters like what type of cell they are.
So two of the cells are excitatory.
They make other cells more excited.
And one of the cells is inhibitory.
It makes other cells less excited.
And so they're called E1 and E2, because they're two excitatory cells.
And the last one is I-1, because they're
is an inhibitory cell. And they are connected in a particular, very understandable architecture
motif that explains why this tiny little circuit is capable of generating cycles.
Well, maybe this is the place then to get into dynamical systems theory a little bit. I mean,
because my next question was, how do three tiny neurons manage to tell the leg how to walk?
So, okay. So I will, I will be a slightly more precise to say that they are, they are, we believe the three neurons are sufficient to generate the rhythm.
Okay, the rhythm. They can generate the rhythm. They're not sufficient to actually control them. They have, I don't know, like dozens of individual muscles that need to be coordinated in their legs to be able to walk. Like we have many more, but you can get the idea, right? Like there are many more muscles and there are degrees of freedom in a limb.
So actually controlling them to do something coordinated and not super clumsy is a little more complicated.
But we believe these three neurons are hypothesis, is that these three neurons generates the basic rhythm.
And then there's other cells involved to make it actually walk.
Does that make sense?
And that's just the lesson we're learning over and over again.
There's a lot of teamwork in biology.
A lot of responsibility shared among different subcommittees.
I certainly don't feel like the nervous system is wasting.
cells.
Right.
Like, we have all these cells.
They're doing something, right?
Like, I just don't, I don't, I don't, I don't, I don't, I don't, I don't, I don't, I mean,
people have these ideas about like low dimensional structures and neuromansopholes and I don't know.
There's words thrown around if you talk to some, some other neuroscientists.
I just don't, I don't, I don't think biology is wasteful in that way.
There's redundancy and that has, there's a good reason for the nervous system to be redundant in case
it gets injured, et cetera, right?
Mm-hmm.
I don't think there's waste.
I don't think we have cells for no reason.
If it's there, there's probably a pretty good reason it's there, where it wouldn't be there.
Well, it's possible, like, what do I know?
But I can imagine that it used to be useful, and then the evolutionary use of it sort of went away, but the cell lingered for a while.
Because the cells are so expensive to maintain, neurons are some of the most expensive cells to maintain in your body.
I think my hypothesis would be that if a cell is actually not necessary,
it would, the body would find a way for it not to be there over a longer time frame.
So it's actually more plausible to have vestigial organs in the body than vestigial neurons?
If you're thinking with the vestigial organs that I'm thinking about, there's actually just like,
I mean, we can go off in a super long tangent if we wanted to of, that's a different cycle we can go on,
about why those vestigial organs didn't go away. And there's usually a good reason because they got stuck,
basically.
Not that we had a use for them,
but just because the way that evolution works,
just they got stuck.
Okay.
Let's go back to our three neurons, E1E2, I1.
Right.
And so there's a like really oversimplified spherical cow version of this
where it's literally a circuit.
It is.
And it is constructing a rhythm.
And then there's the slightly more,
complicated version where there's external inputs and outputs and other influences going on.
And, you know, how do you learn about all those?
Yeah. So, so to learn about all of the other stuff, I think what my lab, our vision,
and there's tons of collaborators who are involved in all of this because we, this is kind of a giant
team effort, is to then actually embody the nervous system, the connect home and all of its glory,
actually put it inside a body where it belonged all along, right?
Like a mechanical body or?
A simulated body, more like a video game body.
Yeah, a video game body, okay.
Yeah, so my son's been playing like Red Dead Redemption.
He rides a little horse around in this virtual little environment.
It's a clump, clump, clump, clump, right?
That's just an animation, right?
Like, it doesn't really matter if it is biomechanically realistic,
physically realistic, biologic interpretable, whatever.
It's just a video.
So we want to do that, but actually have it be biologically interpretable
and then also physically realistic.
as far as we can.
But it would be a physics engine, right?
Models F equals M.A.
Right.
Good.
So, sorry, is that going on?
Does that exist?
Did that help?
Did that teach you anything?
It's in progress.
I think it's in progress.
I'm really excited about it.
It's, I mean, this is a bit superlative,
but I feel like I rarely in my career felt so much conviction
that something is the right thing to do.
Like I just, I feel, I, it's so obvious to me.
that the brain does not live in a jar.
Right.
It always controlled a body, and it always controlled a specific body,
with these limbs and these muscles and these joints and these sensors, right?
Yeah.
In order to move around the world and eat and collect information
and do all the things that animals do.
And so it's just so obvious to me that we need to be understanding the brain and nervous system
in the context of the body that it interacts with
to produce the behaviors that the animal actually does.
And so that's the grand overall vision of what we're doing.
I'd love to be able to, I mean, we are.
We're like, it's early days, right?
But it's just, this is, this is, I'm really excited about it.
Is there any usefulness and imagine doing it in good old fashion physical reality as well as virtual reality?
Yeah, either a robot or can you like hijack the nervous system of an actual fly?
For sure.
Super easy to hijack the nervous system will fly.
As part of the reasons we're working in the flies because it was the kind of the genetic organism of choice for a very long time.
And so our ability to hijack every aspect of its nervous system, do gene engineering, to put proteins in it, to shine lasers at it, all of that stuff already exists.
And that is the reason we're working in flies is because the wealth of knowledge that has accumulated over the many decades of people working on the fly.
Like we just know so much more about their everything than a spider, for example.
Right.
So, yeah, we can hijack it.
So a lot of the things that, I mean, we're neuroscientists, we love lasers.
So there's a lot of lasers going on.
We shine lasers at them and we can make them do things.
We can shine lasers at them when they're walking, flying, trying to sniff, stuff like that.
I don't think that the sentence, we're neuroscientists, we love lasers.
Is that obvious to the outside world?
I didn't realize that.
We love lasers are the thing.
Yeah.
love lasers.
I don't know if we,
I think we might love lasers slightly more than physicists,
Sue,
because we just play with them.
Yeah,
well,
physicists are going to join you there.
That's okay.
And it sounds like,
maybe I didn't quite get it right,
but it sounds like rather than
learning about these three neurons
by experimenting on the neurons,
you almost guessed
or you almost sort of figured out
they have to be doing this
in order to make it work?
It is a guess at the moment.
We do need to do the validation experiments.
We need to also corroborate our predictions
and our hypotheses by doing experiments
on these actual neurons.
For technical reasons, that stuff is ongoing.
We haven't done it yet.
So that's why this is still, I would say,
a very strong hypothesis in my mind.
It's our, we have good reason to make this guess,
but it's still a guess at this point
until we can confirm it biologically.
But I think, like, one of the things that's kind of cool about this result is that as a computational modeling person,
I've spent the majority of my career fitting data.
Like, somebody has an observation, something they already know.
And we're like, oh, sure, I can, like, write some equations in code, and we can recapitulate it.
We can, like, make a model that does the same thing that you already know.
This is one of the few instances where I feel like the model actually came before the experiment.
We were agnostic going in.
We had this giant data set.
We're like, let's just simulate it.
And then we made a prediction of things we didn't know before.
And so part of this result I haven't talked about is that we haven't quite gotten to the three cells that we predicted to be the core CPC circuit.
But there's other parts of the nervous system that we did predict.
Like we made some predictions of, there's this one pathway that comes down from the neck.
And in our model, it was a cell that has a name, right?
And doesn't remember, I do actually know the name of this.
It has fewer letters and numbers. I know what it is.
But this neuron that comes down from the central brain, and our model said, oh, okay, if you zap it with a laser, it should make the leg tap.
It should go back and forth.
Okay.
And nobody has ever even studied this neuron before because there's a lot of them.
But somebody did actually make a cell line.
Like there was a fly we could order that somebody had already made that had the correct proteins in it
so that we can shine a laser at it and activate that cell.
So we ordered it, we grew it, we cut his head off, and we glued it to a stick, and we shined a laser at it.
Yeah.
And it tapped its link.
Oh, there you go.
It's adorable.
It's like it was an actual model-driven prediction.
Right.
Like we had no idea, nobody had any idea what this neuron did.
It was just in the nervous system.
Most cells in nervous system are like that.
We're like, oh, we can give a name because we kind of know where it came from.
We have a nomenclature.
We have systematics.
We don't know what it does.
Well, I guess that was an obvious next question.
If you have three neurons per leg controlling the rhythm, and there are six legs,
that's 18 neurons, that leaves 150,000 minus 18 neurons to figure out what they do.
Is there an obvious roadmap to what we're,
were able to do? I sure hope so. So part of it is this idea of the embodied brain that I talked about.
And it goes by a couple of different names. So drawing analogies between what we're doing with these
virtual models of animals with the nervous system and the biomechanics of the body, we and some other
people have been calling them digital twins, which is a word that we're borrowing from industry
and from industrial engineering.
So the digital twins that existing industry
are digital twins of things like airplanes and cities.
Like there's a digital twin of the city of Singapore, right?
Okay.
And it's a simulation.
It doesn't have every single light bulb.
But it has many of the important parts of the city of Singapore,
including its morphology, its connectivity.
And it's hooked up to real live sensors in the city
so they can sort of update the status of the city,
and the city planners kind of use it to do things like predict disaster response, right?
Or to in real time shift, if they have to shift traffic patterns or whatever to relieve some congestion
because of an emergency in one place, stuff like that, okay?
So that's what people in industry have used these digital twins for.
And in close analogy of that, the thing that we're thinking about building,
I think would be considered a digital twin of an animal, a behaving animal.
So it would have a simulation of the nervous system and the interfaces between the nervous system and the body so that we know how information goes in and how information comes out.
And it would be situated in a virtual reality environment that's capable of interacting with things, right, like surfaces that are not flat, right?
You can walk-up you physics.
Yeah, just physics, right?
They can also interact with other agents.
So this would be an agent-based model.
and so you can have two animals interacting with each other.
They can even touch each other, for example, stuff like that.
And so in that way, if we have a set of simulations
that are developed in very close collaboration
with our experimental collaborators,
we should be able to come to a set of models
that can predict what's going to happen in parts of these circuits
that are hard to predict otherwise.
Because the thing is like the whole thing has just mad, mad feedback and recurrence.
And if it's one thing that I've learned about,
humans and our ability to reason through rational thought is humans are really terrible at
reasoning through what happens with feedback circuits and recurrence. We can go forward. We can follow a path,
like A to B to C to D. That we can do. That we can do. As soon as there's recurrence, when D goes back
to B and then C goes back to A, our intuition for what's going to happen is really poor.
Okay. And that's one of the arguments that I make in motivating why we need these
complicated computational models.
We can't do it, but we have computers.
Well, I guess an obvious issue that floats to mind is when you are simulating the biology
on the computer, you have to make some choices about what to include, what not to
include, what to model, what not to model.
Is there any danger you'll get sort of get the right answer for the wrong reason?
Yes.
so many, probably more than more than not.
I think we need to be really careful.
So this is, I mean, this is something that I think maybe we talked about briefly in person at some point is this idea of the digital sphinx paper that we wrote a couple of weeks ago.
And the brief intro to that is that there's a lot, I was, I was, I was.
was starting to see a lot of work and conversation in the field, including by my lab and our
collaborators, where because the whole thing is so overwhelming and there's so many details and we know
we can't possibly measure them all, it's literally impossible. We know we have to make a lot of
assumptions, right? Well, a lot of people, and again, occluding us, we've been doing the same
thing. The thing that one thing that we can measure with a lot of fidelity and relatively
easily is just the behavior output of the animal. We can get cameras and we can track what it's
doing. We can see how it's moving his legs around. We can see where it's like pointing its head.
Yeah. That we can do. Anything external with cameras we can do because we have we have cameras
and we have really good computer vision. And so a lot of people are are basically saying that,
okay, this is this is the grounding, right? Like if we can get a model that
looks like it's behaving like the animal
in that it matches
what the animal was observed to do with a camera
then we've certainly we've gotten something right.
Sure.
I know, I know.
I'm I'm glossing over lots of details.
Of course, lots of people are doing this
in a really careful way,
but what I was a little afraid of
was that people were starting to do this
in a not careful way.
And in particular,
there was some stuff coming out
on social media by
some startup companies
trying to fundraise
putting out work
that I looked at it and
lots of our friends looked at it and was like
that's not, you're overselling this, right?
You're not doing what you said you did.
And what they said they did
was that they had uploaded
a flybrain. That was the headline.
They've uploaded a brain.
They claim they did it.
And of course, you have to read the details.
You looked at it.
And I was like, okay, this is not.
They didn't actually do that.
But that's what they said they did, right?
Yeah, okay.
But this thing got a lot of, it kind of went viral and it got a lot of attention and not just among non-scientists.
It actually, I think a lot of, I got a couple of friends who are not neuroscientists, like chemists.
I was like, I heard this thing.
They, like, they uploaded a fly brain, right?
Like, that sounds really cool because they didn't know exactly the, you know.
Yeah, exactly.
And so as an exercise, just as an exercise,
I was sitting around with one of my postdocs,
Elliot Abe, and I was like, Elliot, this is just, this is nuts.
Like, why are people, this is bananas, right?
Like, this is not the right way of doing it.
But to explain why it was not the right way of doing it,
took a lot of technical words, right?
You have to understand reinforcement learning.
You have to kind of understand the architecture of the nervous system.
It's a lot of stuff to explain, and it just takes a long time.
And so Ellie and I were sitting around,
And we were like, well, what is the, what is the, what is the thing that we can do that to point out how ridiculous is?
What is the logical extreme of what they're effectively doing?
We're like, well, you know, they're not actually even using the fly brain connectome.
This could be anything.
Could be a random matrix.
In fact, it might as well be a worm matrix.
It might as well be a C.L. against worm matrix.
And so.
Sorry, what did they upload?
They uploaded a portion of, they simulated a portion of the fly brain.
Okay.
Yeah. And crucially, since we spent so much time earlier talking about the ventral nerve cord and how that controls like movements, they did not simulate the ventral nerve cord.
Okay.
But, you know, even me saying that, right, like, that took that conversation about eventual nerve cord lawyers and how that actually controls your limbs, right?
Anyway, that was one of the things that they did not have. They did not have eventual nerve cord, even though their animation definitely had little legs that were like moving around, right? That was the animation part.
So, so Ellie and I were like, okay, well, what if we, what if we upload a worm brain and get it and train it to control the fly body?
We're like, we can totally do this.
And so, and so he and another graduate student lab, they just, they did it.
They downloaded the C.L. against worm connectome, all 300 cells in its glory.
And we popped it into a reinforcement learning algorithm that we've been using for lots of other things to control a biomechanicine.
realistic fruit fly body walking around in a physics engine to imitate 3D kinematics of flies.
And it works.
It all runs around just like we know the flies do.
The worm connectome in the fly body wriggles around the right way.
Yeah.
Yeah.
I mean, like if you use enough deep learning, if you use a little deep learning and you can train it with good enough data,
it is perfectly possible to get a worm brain to control a fly body.
Okay.
And so what we're learning from all of this is this is just, I mean, it's silliness, right?
Like if you basically use that much deep learning in there and you're allowing all of these parameters to change in ways that are not obvious, the fact that you have a connectome and the fact that you have a hyper-realistic biomechanical body doesn't mean anything.
Like this is not biologically meaningful.
Right.
you can get behavior fidelity without any biological fidelity.
Well, and especially because you said that we're not even talking about the sort of identities of the individual neurons or, you know, their maps from inputs to output.
So how in the world can you expect to get something believable, realistic?
I don't know what you want to call it.
Yeah, so we actually even, we even try it a little bit.
So the worm connectome also has motor neurons.
It has the neurons that would be controlling.
their muscles. And we use that population of motor neurons to wire it up to the fly body actuators
just for fun. Yeah, okay. Basically. But that's sort of, that's where the deep learning comes in,
right? Like if you have an artificial neural network that maps, that does that mapping between
the motor neurons and how it produces torque in the body, that's where the neural network was.
And we trained that. But this is kind of just showing that I can run the same.
software on, you know, a Mac or a PC?
Yeah, if you have the right interfaces, yes.
I think that's a great analogy.
I can emulate an engine and a different computer.
It's an emulator.
Right.
It's totally an emulator.
It's exactly what it is.
It's like if you have the right, if you have, if you're, if you, if you, if you, if you,
don't care about meaningful interfaces, you can get lots of things to plug together.
Right.
Okay, good.
Right.
So that's the, you know, like, HDMI matters, right?
And the real trick to get something meaningful out of it is to actually engineer those interfaces.
Right. Yeah. Okay. So that's a good cautionary tale. We should all read the popular science literature with a little bit of caution.
But since we're at the end of the podcast, let's, you know, think big a little bit about the implications of everything that you're telling us.
you know, I'm getting the, one of the messages I'm getting is the embodied nature of all of these neurons, all the brain and so forth.
These days, forgetting about wild claims from startup companies, but there's still a lot of interest in AI and consciousness.
And, I mean, consciousness, both artificial and real.
We've had a couple of podcasts recently that talked about whether biology,
was intrinsically important to the idea of consciousness.
Okay.
And not because of like antifysicalism or mystical woo stuff,
but because all, maybe, maybe all of the little processes
going on underneath the hood of a biological organism,
the respiration, the metabolism, and the signals going forth,
maybe all of those matter in some way over and above
just the algorithm that is being run on the hardware.
Are there, do you take any lessons from your work for these kinds of ideas?
Yeah, I think so.
I maybe try, I'll maybe state what I'm about to say a little more strongly than I actually believe for the, for the sake of conversation.
Sure.
We have, we have no examples that we all agree on of agents that are intelligent and conscious except the ones that are embodied.
We don't agree, right?
Like the other ones may or may not.
be intelligent and conscious, but we don't agree yet. So the only ones who actually agree on
are embodied agents. Furthermore, the nervous system, all nervous systems, evolved starting about 500 million
years ago to control a body, to sense from the environment and respond to those senses in
order to move around in the world and seek food and mates and et cetera, et cetera. That's what
animals do, right? And everything that we think of as we
reasoning as consciousness.
I mean, there's all of these words.
I'm not going to list them all, right?
All of that machinery, all of the capabilities for doing so,
evolved on top of the neural computations required for sensorimotor control,
for sensing from the environment and moving the body around.
And so in my guess, like I'm going to guess that understanding the
the platform, the substrate on which all of those other capabilities were built
would be important for understanding the stuff above,
as well as a strong constraint in how it could possibly have gotten there.
I think that, you know, for claiming to say things stronger than you actually believe,
that was incredibly reasonable claim.
You've been all the copyouts in there.
All right.
All right.
I am a scientist.
But the sort of the, to turn that around a little bit, if we are interested in artificial
approaches to thinking, consciousness, whatever, there's a lot we still have to learn from
the biological reality of it.
That I actually don't feel that strong about.
I don't think it's actually important to understand the details of high biology implement
something to build an artificial system.
that takes advantage of some of those insights.
I mean, I feel like the field of bio-inspired engineering is full of these examples,
where there's the concept that biology might do something was sufficient to inspire a perfectly good solution.
Without understanding the details, I mean, like, bird flight is the only, is the first one everyone always thinks of, right?
Like, we knew that birds can fly, therefore we were inspired to fly.
It turns out imitating the way that birds fly was an utter failure.
We had to throw it out all the window and start over.
right, fixed swing aircraft, that's where it's at, right?
And so the details of how a bird actually flies is fascinating and we continue to study it,
but understanding it was not necessary for us to fly.
Very enough.
Right?
So it's just that we can do it.
I think that's a lot of times where the bio-inspiration comes from.
The inspiration is sometimes just more like, isn't that cool?
Like the central pattern generator circuits that I talked about earlier, same example, right?
The observation that there must be something inside your spinal cord,
the genera's rhythms, that's all the roboticists took.
They didn't need exactly how it worked, exactly what the cells are and how it works
in an actual biological system.
They're like, oh, I can implement this chromato oscillator on my onboard computing ship.
Great, perfect.
This looks great.
That's all they needed, you know?
So I'm not sure we need to know the details of biological intelligence to get to artificial
intelligence.
I don't think that's necessary.
However, concept that it may be necessary.
for that agent, for that intelligent system
to be actually embedded in something that's interactive
that has a physics, so to speak.
It doesn't have to be our physics.
But I think it should have maybe some rules and constraints,
some notion of energy, some notion of conservation laws,
like not just limitless everything.
Maybe that's important.
I don't know.
This part I'm speculating, but I don't think it's necessary
to understand how biology works to get artificial intelligence.
I guess I would completely agree with you there.
The difference, the failure of the analogy a little bit is,
we all know what flying is.
We don't really know what consciousness is.
And maybe there's a little bit more to be learned
than just inspiration from the biological side of things.
I think that's absolutely true.
Yeah, I don't know.
I think the biology of consciousness is difficult.
There's the psychology and the philosophy of consciousness.
Getting at the biological basis of consciousness is pretty difficult as far as I understand.
Of course, famously, it has been labeled the easy problem of consciousness.
But to be fair, David Chalmers always said, the easy problem is hard.
Yeah.
Well, there's, I mean, it is, I don't know.
In biology, there are no easy problems.
There are no easy problems.
There are no easy problems.
Every time you come up with that economy, oh, surely it must be A versus B.
30 years later, it's both.
It's both or C, yeah.
I guess, okay, then the last question will be,
are there any potential therapeutic aspects of this?
Are we learning enough about how connectomes work that we can help figure out ways to fix them when they're broken?
I sure hope so.
I think one of the most interesting applications that I actually think about a lot
in building our embodied models of the, like, except brains not in a jar,
right, actually connect to a body, is exactly that interface between the nervous system and the
musculoskeletal system, of which there are tons of pathologies and dysfunctions that are pretty
terrible when they happen to you. We can think about, for example, spinal injury. So that affects
both your nervous system as well as your neuromuscular control, right? You can have an injury,
like if I have a bum ankle on one side, I start limping. That's a different neural strategy. And
And then over time, I might adopt a different gate and walk differently.
And then a little bit longer, maybe the legs on one side of my body gets stronger.
So it's adapting at a different time scale as well.
So understanding those interactions between how your nervous system controls movement
in compensation to injury and attempting to repair it.
Or if you have an amputation, you can't repair the amputation, but you can repair the function, right?
So all of those interactions are very important.
important and poorly understood because they're holistic.
Like our ability to understand those points of holistic, longer term adaptations is very poor because we just haven't had the tools to be able to do so.
And so that's one of the things we hope to be able to do in building these embodied models is to understand not just does it walk.
That's kind of, you know, hopefully that works, right?
But after it walks, what happens when it breaks?
What happens when we break it in different ways?
How does it compensate?
What is the role of plasticity?
What is the role of growing new muscles versus growing new tendons versus growing new neuropathways, right?
And if we understand that, perhaps we'll have some new clues about how to design therapeutics to help that process work better, right?
Like your PT does a lot of crazy stuff, but not all PTs agree on how to rehabilitate after some kind of injury.
Is there any guidance that we might be able to come up with by understanding the interactions between nervous system and the musculoskeoscelotry system a little bit better?
This all sounds very complicated.
biology is complicated
that's why it's the science of the 21st century I guess
it's it's it's squishy and it's fun and
and it's I just feel so I feel so privileged
to be able to do it
and to like you know spend my time hang up my friends talking about
brains of biomechanics I like
sometimes I wake up and I like I can't believe this is a real job
I think that is the perfect place to
end because that's an inspiration for everyone. So Bing Brunton, thanks so much for being on the
Mindscape podcast. Thank you, Sean. This is super fun.
