Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 352 | Bing Brunton on Connecting the Connectome to the Body

Episode Date: April 27, 2026

The connectome is the wiring diagram of a brain, a big matrix that tells us what neurons talk to what other neurons. Understanding it is an important step to understanding how brains work, but a... long way from the final answer. A big next step is understanding how neuronal circuits connect to and guide bodily behavior. Very recent work on mapping the fruit-fly connectome has brought us closer to that goal. I talk with neuroscientist Bing Brunton about the connectome, how we can study it to understand bodily motion in flies and other creatures, and where it's all taking us. Chubbies is here to keep you comfy and looking good year-round. Get 20% off with code MINDSCAPE at chubbiesshorts.com/MINDSCAPE! #chubbiespod Upgrade your denim game with Rag & Bone! Get 20% off sitewide with code MINDSCAPE at www.rag-bone.com. #ragandbonepod Support Mindscape on Patreon. Blog post with transcript: https://www.preposterousuniverse.com/podcast/2026/04/27/352-bing-brunton-on-connecting-the-connectome-to-the-body/ Bing Wen Brunton received her Ph.D. in neuroscience from Princeton University.. She is currently a Professor of Biology and the Richard & Joan Komen University Chair at the University of Washington, with affiliations at the eScience Institute for Data Science, the Paul G. Allen School of Computer Science & Engineering, and the Department of Applied Mathematics. Web site University of Washington web page Google Scholar publications YouTube channel Bluesky Artworks (Instagram)

Transcript
Discussion (0)
Starting point is 00:00:00 Hello, everyone. Welcome to the Mindscape Podcast. I'm your host, Sean Carroll. As you are listening to this podcast or listening to anything else or looking at anything else, your brain is processing information. We can argue about how much information is in the podcast or anywhere else, but in some sense, there are bites of information being sensory inputted into your brain and then processed and that affects what you do, how you behave. Now, as we've talked about it, out in the podcast recently, there's other things going on in the brain and the nervous system and the body as well. It's not just information processing. There is absolutely information processing happening, but that's an abstraction, right? What there's actually happening are atoms, molecules, cells, doing various physical things, and we find it very, very interesting and helpful to talk about those physical processes in terms of information being processed.
Starting point is 00:01:02 And today we're not going to worry about deep questions about whether or not that information processing is efficient for consciousness or anything like that. We're going to get our hands dirty a little bit and think about the connection between what goes on in our brains, our nervous systems, and our bodies. There's a constant interaction.
Starting point is 00:01:22 In fact, it's even, of course, a little bit of a mistake to separate our brains from our bodies because our brains are part of our bodies. So in reality, we're going to be talking about interactions between two different parts of our bodies, how we move around in the world, and how our brains send signals back and forth, receiving signals and then transmitting them to the nervous system, which then does things. We've also talked recently on the podcast about the connectome, the idea that if you knew every neuron in a brain or maybe some coarse-grained version of groups of neurons,
Starting point is 00:01:57 and how they connected to each other, you would have the wiring diagram of the brain. And so we have some wiring diagrams for simple organisms, nowhere close to human beings yet, but we're working on that. What does that give us, knowing the wiring diagram, knowing how that information flows around? How does that then go into controlling our bodies and what we do and our behavior? So that's what we're going to be talking about today. Bing Brunton is a neuroscientist and biologist at the University of Washington. And she has been leading the charge in very recent days.
Starting point is 00:02:32 We've mapped out the connectome of the fruit fly. You might know that we've mapped out the connectome of sea elegans, the little worm that biologists like to study. It's only 300 neurons, right? The fruit fly has over 100,000 neurons, and now we've mapped out that. So that's a much more subtle system, a lot more intricate things going on, little subsystems doing different things. And so we're going to be talking about how we can learn about the relationship between the fruit fly brain, such as it is.
Starting point is 00:03:05 There is a brain there. It's pretty impressive, actually, and how the fruit fly does things like walking around, flying, other kinds of things. This is absolutely new stuff, less than a year old, and just the beginning of a forefront of really interesting research in biology and neuroscience. So let's go. Bing Brunton, welcome to the Mindscape Podcast. Thanks, Sean. I'm glad to be here. So I think that for this audience, it would be good to start pretty broadly because the brain, the brain is kind of like time. I've written books about time.
Starting point is 00:03:56 And what I've noticed when I wrote books about time is that everyone has an opinion about how time works, what it is, things like that. And I think that maybe the brain has a little bit of that, right? We all have brains. People have their opinions about how it works. I'm rather attached to mine. Yes, exactly. So, but the connectome in particular is something we have talked about in the podcast before.
Starting point is 00:04:19 But why don't you give us the high-level overview of what the connectome is, how the neurons work, all that fun stuff? Yeah, that's actually, yeah, you went right for it. I think there's actually a little bit of some of the confusion around connectomes is exactly what it is because people use that word in a different way, and I'm sure you know, the terminology actually does matter here, right? So I think the rough definition, and my colleagues actually differ on this, and so I'm going to try to channel them a little bit. The rough idea is that we all know that the brain is composed of cells because it's an organ, like every organ in your body, so it has cells, and the cells work by electrical activity, and they talk to each other
Starting point is 00:04:57 through electricity. And so unlike an anonymous net of cells that are just kind of passing messages forward and backwards, the cells actually have specific identities. Some of them have specific jobs. And they also have specific localization. Some cells are found in different parts of the brain and nervous system, and some parts are not. And so there's essentially a wiring diagram, so to speak, of the brain. You can think about it in terms of, you know, if you're like building a really big complicated building, right? You're building a skyscraper or something. You would have a wiring diagram, you know, a literally engineering diagram of, okay, so this is where the transformers are, I'm going to slip this switch, and this thing's going to turn on these lights over here, right? So you
Starting point is 00:05:39 can sort of have a diagram of that, and that's sort of the connectome, roughly speaking, is that for all the cells and their connections and the identities in the brain. Now, the difficulty comes in in terms of how do you actually define the units? Like, do you want a connectome that's necessarily at the scale of individual cells and how they're connected to other individual cells? Okay. Okay. So that's one way people have used that term.
Starting point is 00:06:04 But they're sort of like more what we call meso scale connectomes that exist as well. In particular, because there's certain animals that are so big, like humans, for example, or even smaller rodents where we can't really get technologically. We don't have the capability of getting the cell by cell connectome. We just can't do it. Some people think we should. Some people think it's impossible. Some people think even if we could have it, it's useless.
Starting point is 00:06:30 But nevertheless, we have these like, like if you hear about the human connectome, the human connectome is not the scale of cells and how they connect to each other. It's mostly like brain areas and the how the brain areas connect to each other. So people use that term to mean like an area by area connectome as well. So there's some coarse graining involved. There's a lot of coarse graining. And so people don't agree on how they use that term. Okay.
Starting point is 00:06:56 Right? Okay. So the whole omics thing in biology, so every word that ends in omics like genomes, proteome, trisputone, right? It's supposed to mean comprehensive map thereof. Hmm. Okay. Now, people usually agree.
Starting point is 00:07:09 If I tell you, hey, Sean, I got a genome of a new, I don't know, spider that I found, you would expect that genome to be at the resolution of the base pairs, the A, C, Gs, and T's. Right. Like, you have that expectation. If I gave you something else, you were like, that's not a genome. I don't know what this is, but it's not a genome, right? So we don't have that in connectomes.
Starting point is 00:07:29 Like, we don't quite agree on the scale of description of like, what is the, what is the, what is, like, do you need to have every single neuron in that spider for that to be the connectome of a spider, right? But the human brain has like 85 billion neurons. We do have some maps of connectomes of, of, of more manageable creatures. We do. Some. We'll get there.
Starting point is 00:07:54 I did notice you were kind of very careful there about talking about cells rather than talking about neurons. I presume that's because there are other cells. There are other cells, and they're clearly important. So the rough estimate
Starting point is 00:08:09 in my understanding is that half of the cells in your brain are not neurons. I mean, our word for not neurons this is just glia, which doesn't mean anything except just the word for it. And they're clearly important. People used to think that they are just there to, you know, kind of like custodial staff or something, but that's so trivializing.
Starting point is 00:08:29 They do a lot more than that. They clearly are involving all kinds of vital functions and they have their own dynamics. But we don't understand. I think that's like a really, really exciting emerging field in neuroscience, just understanding all of the other cells in your reign and what they do and what they do in concert with the neurons. Let me demonstrate how ignorant I am about biology. I mean, you said the body is made of cells, et cetera.
Starting point is 00:08:57 Is it entirely made of cells? Like, is everything in our body's cells? There's got to be like just some liquids and solids and things in there. Oh, for sure. Yeah, there's definitely stuff in the extracellular space. Yes. But I think all I meant was that all of life, as we know it, is made of cells. Right.
Starting point is 00:09:12 We can quibble about viruses later, but, you know, living organisms are completely, pose of cells. Yeah. But I think one of the lessons that we're going to be bumping into over the course of the podcast is biology is messy. Things are more complicated than be squishy and interconnected and complex. And I mean, maybe one of the things to keep in mind is that a macroscopic organism is pretty much a matter of teamwork between different kinds of cells, but also cells
Starting point is 00:09:42 and non-cell substances. Yep. Mm-hmm. Yeah. All stuff, right? For example, your bones, right, your skeleton, you probably know that it's made out of, you know, lots of inorganic compounds. Like there's a lot of calcium in there, right? So you drink your milk. Your mom tells you drink your milk. But your bones, even though the skeletal elements of it,
Starting point is 00:10:04 a lot of its material properties come from the calcium matrix and lots of other stuff that's going on that's kind of complicated, it's also this really intricate meshy structure that has blood vessels all inside it, right? Right. Because it needs to be vascularized, otherwise it's going to die. It needs sugar to be fed. It needs oxygen to stay alive. And so even something that you think is structural,
Starting point is 00:10:29 like it's not like a stainless steel beam in a building. It's not, it's alive, right? And it's alive in a way that only cells can keep it alive. And so there's cells all incited. And if you just like zoom in, it's got very intricate structure. I do think this is not what we're talking about, but I do suspect that that's got to be a frontier of artificial organism building. Like when we build robots, we make steel beams.
Starting point is 00:10:53 We don't make it out of cells, and that means it doesn't repair itself, etc. We think about that quite a bit. And so not only, I mean, this is relevant for our thinking of connectomes, but really it's just a really great fundamental question of biology, is how organisms are able to recover from injury and repair ourselves. Or sometimes not. Yes. Well, you and your friends are going to figure out how to make all of my organs repair themselves and make it soon, okay?
Starting point is 00:11:25 We're going to try. It's going to be fun. Okay. Just to follow up, the last little bit, very interesting that half of the cells in my brain are not neurons. There are the other things, the glial cells. So we are, again, we have this cartoon picture. in our brain of the neurons firing signals back and forth to each other. Is it that feature that distinguishes neurons from non-neurons?
Starting point is 00:11:53 It is, yeah. And so the connectome is the fine-grained connectome, if you want to call it that, the level of cells. We can hold the cellular level one or the neural one. Cellular-level connectome. That would be just a big old matrix listing every single neuron and how it connects to every other neuron. Yep, exactly right. Yeah. Okay, good.
Starting point is 00:12:17 From a computational perspective, because I am a computational list, by the time it gets to me, it's that gigantic connectivity matrix and it has structure, it's sparse, it's not an all random, it's all kinds of cool. Is it, it's not symmetric either? Not at all. Talk to others, but they don't listen necessarily. That is correct. Okay, some asymmetry there. Yeah. And in the, but okay, so is it, is technically the connection?
Starting point is 00:12:44 dome, just the wiring diagram, or is it that extra information about where information flows? So there's a lot of extra information in it. And so this is the analogy I tried making earlier about the genome as well. Like we don't even understand, we don't agree on the correct way of representing the information. So that giant connectivity matrix you talked about, Sean, is definitely a part of the information, but it's nowhere near all the information that we get out of this technology. So for instance, it matters the identity of the cells because the neurons are not, they're, I mean, you probably heard about things like dopamine, serotonin, right?
Starting point is 00:13:21 Like, there's dopamine cells, there's serotonin cells. And if they both fire an actual potential, they both say something, those messages are completely different, right? And so the identities of the cells matter. Yep. The other thing that really matters is how those messages are received, right? And so, so, so in analogy with, uh, with kind of, it's, it's very like context dependent, um, language, trying to think of a, of, of an interesting social analogy. Like, if you say the same thing to two different people, depending on your relationship with them, they can hear very different messages. Right. Does that make sense? Yep. 100%. So when cell A speaks to cell B and the cell A says exactly the same thing to cell C, depending on the identities of B and C, they could hear very different. So, so when cell A says exactly the same thing, they could hear very different. And so, so when cell A says exactly the cell B and C, they could hear very different. And so messages and do very different things with it.
Starting point is 00:14:13 Sure. If you say you're a bonehead to your best friend, it's received differently than if you say that to your graduate students, right? That is entirely correct. Right. So messages are received differently. Yeah. So that's why we care.
Starting point is 00:14:26 Thank you, HEC. Thank you for coming up with analogy. Yeah. So the the identities to the cells matter. There's other, lots of other really interesting, but also very detailed, biophysical properties of each cell. that clearly do matter, but we don't know by how much. So the thing that I usually try to tell my graduate students when I'm first introducing them to this type of modeling that we do is,
Starting point is 00:14:55 like say that I'm trying to, I'm a, you know, I'm a civil engineer, I'm trying to build a building, right? And I need some materials to hold up the roof. And I say I need to know the properties of this beam so that I can hold the roof up. up. Now, the beam is made out of atoms, and I know that there's, you know, there's like down there, some of there's quantum mechanics, right? But we are not solving short-dance equations in order to design a roof. It's just, it's way too much. So like, it's super interesting and maybe you'd be interested in the side, but you don't need it for the, for the task of building a roof. So that's sort of where we are right now. Like, I know I don't need every single detail
Starting point is 00:15:34 that is known about these biophysical parameters of these cells. They get really funky. They're a crazy non-linear and they're super special and they're almost impossible to measure. People will spend an entire PhD measuring one cell and characterizing a lot of detail. But do we need it for these very holistic models of the entire animal and nervous system? Probably not. Where do we stop? It's hard to say right now. Right.
Starting point is 00:16:01 Like I know I know I don't need every single detail, but I do not know which of them are actually crucial. Summer time is here, and it's time to finally break out the shorts and swim trunks. But just because your wardrobe becomes more casual doesn't mean you shouldn't put thought into it. That will become clear the first time you try Chubby's Trunks. Chubbies make swim trunks, shorts, and summer shirts that are designed with intention to be both functional and look great. You might wonder, what does it mean for swim trunks to be functional?
Starting point is 00:16:33 How hard can it be? Chubbies will convince you that it matters. They're engineered with four-way stretch fabric that lets you transition effortlessly from swimming laps to lounging poolside. They're seriously soft, dangerously flexible, and incredibly quick drying. And you will look good. The compliments that you start receiving will be proof of that. There's no reason to dread beach season, nor to take it for granted. Chubbies will make you start looking forward to 5 p.m. Friday and the weekend to come.
Starting point is 00:17:02 They're proof that when you get shorts right the first time, they never really go out of it. style. And now for a limited time, Chubbies is giving our listeners 20% off with code Mindscape at chubbies shorts.com. That's 20% off your order with code Minescape. Give your thighs the VIP treatment they deserve with Chubbies. Support our show and tell them we sent you. Whenever you get dressed in the morning, it's nice to not have to think too hard, but also nice to look good. Rag and bone is here to make that possible. Clothes that feel good right out of the box and look both stylish and effortless with a wide range of combinations. The new infused line of denim at Ragginbone is a great example.
Starting point is 00:17:45 Ragginbone uses a proprietary eight-step over-dye process that gives each piece of rich depth that gets better with every wash. It looks like something special and you'll feel like that when you have them on. I have both a Ragam Bone infuse jacket in gray denim and jeans in blue denim. They go with everything and they fit perfectly without fuss. You pick the size and style your look. looking for, from slim and straight to athletic and relaxed. It's not just denim, of course, rag and bone has soft t-shirts and comfy nits that pull your look together. It's premium wardrobe
Starting point is 00:18:17 staples made to last and made to live in. So it's time to upgrade your denim with rag and bone. For limited time, our listeners get 20% off their entire order with code Mindscape at rag-dashbone.com. That's 20% off at rag-dashbone.com with promo code, Mindscape. When they ask where you heard about them, please support our show and let them know we sent you. And the individual neurons are different not only sort of structurally or biologically, but even in terms of information processing, right? Like they have different, I don't know, I want to say algorithms for turning input into output. Is that fair? I think that's fair. Yeah. So if you think of it computationally in terms of just maps, right? If you are able to define exactly what
Starting point is 00:19:06 its inputs are and what its outputs are, then you can infer some kind of function that maps it from the inputs of the outputs, right? I think that's a totally valid way of saying it. And I think that might be one of the clues, computational clues as well, in order to be able to run some of these simulations, is that you don't need every single detail of how that map is implemented to approximate its function. But is the specification of how each neuron maps inputs to outputs part of what we call the connectome or is that a next step?
Starting point is 00:19:37 It's not. It's not. Okay. So, I mean, I don't know. It's hard to say, right? But I feel like this is partially why I, among some of my colleagues, I'll admit, I'm, you can't, you know, the audience can't see, but I'm raising my hand right now. I was skeptical.
Starting point is 00:19:54 Okay. So this whole thing started, I don't know, I feel like I was in grad school. I first heard about these, like, really large efforts to produce more connectome data sets. and whatever, it was like, whatever, 15, 20 years ago. And I remember thinking that's like, well, I won't tell you what I actually thought. But I was skeptical. I was skeptical. I was skeptical on a couple of different fronts.
Starting point is 00:20:17 I was skeptical that it was even going to work at all, right? Like, can we actually reconstruct one of these things at sufficient scale? Because it involves, I don't know, like running a transmission like Chrome Mexico for six months straight, making zero mistakes. And so I was skeptical it was possible. even to do it in the first place. And then I was further skeptical that if we could have it, right? Like if somebody just hand it to you magically tomorrow, like what would you do with that?
Starting point is 00:20:44 Right. Like how could you even make sense of this giant spaghetti monster that somebody just handed you? And so, so I think, I think some of our, I mean, it's only been pretty recently that some of the work that my lap has been doing with some collaborators has started to convince me that, hey, this might actually, I think we might actually be able to do that. Now, the reason I was skeptical, and lots of other people were skeptical, so there were essays written, I don't know, ballpark 10, 15 years ago by lots of people in the field, including like Eve Martyr, Corey Bargman, is because they knew that there were so many other details that are not observable by the connectome. Like this information about all of the channels, the biophysical properties of some of these cells, we can't get them from the connecto. We know we can't. We never thought we could. Nobody thought that we could, right? So the disagreement was whether or not the stuff that you can measure, effectively, these, these, these connectivity matrices, is that sufficient to teach us something? Is that good enough to do something? Yeah. Yeah. Versus sort of the other logical extreme would be it's utterly useless because you actually need all of the other stuff, right? And so there's a giant continuum of opinions. And I was, you know, I was somewhere in the middle, but, you know, kind of in the little skeptical side. But I never actually worked in the connect room. I was simply fascinated by these. by these efforts that some of my friends were undertaking.
Starting point is 00:22:08 And my current opinion is swaying a little bit closer to the, I think we can actually do something useful with this dataset. Having done useful things with them, I think that's a good opinion for you to have. So what are the connectomes that we do know something about, even if the human cellular level connectome is far away? What do we know? What animals do we have the connectomes of?
Starting point is 00:22:32 So the first one we got was actually, like 30 years ago, we have a full connectivity matrix of the sea elegance nematode worm. It's not an earthworm, like the kind you see sometimes attempting to cross the sidewalk and perishing in the middle. It's not those. They're much smaller.
Starting point is 00:22:51 They're flatworms, their nematode flatworms. They're about a millimeter long, and they live in the soil. So if you got, if you scooped up any soil in your garden and looked it onto a microscope, you're very likely to be able to see them there. fucking everywhere. Okay.
Starting point is 00:23:06 And so they're a millimeter long, and they have, this particular species has been studied a lot in molecular biology because they breed really quickly, and so we have tons of tools. They have about 1,000 cells and about 300 neurons. And so the connectivity matrix of those 300-ish neurons has been mapped out decades ago, many decades ago. And so if you talk to people in connectomes, one of the first things they always bring up It's like, but we've had the connectome of the Cieligan's worm for so long, and yet we still understand it.
Starting point is 00:23:39 We do not understand it. Right. And there's actual good technical reasons why C.L. against worms are actually really difficult from a connectomics perspective to understand. And so the one that has come out much more recently in the last year or two is a couple of efforts by lots of giant collaborative teams. I was not involved in any of these teams. I was simply cheering them on from the sidelines to mapped the full connectivity matrix of a Drosophila fruit fly. Fruit fly.
Starting point is 00:24:15 Fruit fly. Yeah. So this is a kind of fruit fly that every year at the end of the summer, my kitchen gets infested with fruit flies. And I can't get rid of them. So you've seen them too in your kitchen. They buzz around. Anytime you have a little bit of rotten fruit or a pile of compost or something in your kitchen, that's where they live. So these little guys are, they're more like three millimeter, millimeters long.
Starting point is 00:24:41 And so they're like the size of a grain of rice. And their entirety of their nervous system is more like the size of a sesame seed. Okay. And so they're small enough that it has been possible to reconstruct the entirety of their brain and nervous system. So we have a brain in our heads, and we also have a spinal core. So that constitutes our central nervous system. So the brain and spinal cord of humans and mammals, right, and vertebrates. They have an analogous structure, so they have also a central brain that's inside their head. It goes down their neck, just like ours. And then the remainder of, instead of a spinal cord,
Starting point is 00:25:28 insects and invertebrates have this thing called eventual nerve cord. It's actually remarkably similar in terms of its structure and how it's organized to our spinal cord. But instead of being on their back, it's actually in their stomach side. So it's on their belly side. It's why it's called Ventral NurbCord. Anyway, so that's, that whole thing has been mapped out. And there's two of those datasets for one male and one female fruit fly, and that was only published in the last half a year or so.
Starting point is 00:25:55 Wow. And how many neurons? So the brain has 150K, and then the, and the ventral nerve cord it has an additional 22K. Okay, good. So a much bigger matrix than our little C. elegans. There's a much bigger matrix. And I think the important thing about the size of it, paradoxically, is that it's actually a little bit easier to understand
Starting point is 00:26:20 from the connectivity matrix. Now, the reason that the C. elegance connectivity matrix has been so hard to understand is it took us a while to figure this out as a community. They do a lot of, computation not using that kind of connectivity matrix. There's a ton of chemical communication. They're constantly squirting out neurotransmitters and other chemicals at each other. There's all the mechanical computation.
Starting point is 00:26:47 So it's a, it's a squishy thing that crawls around in a matrix, in a not a mathematical matrix, a soul matrix. And so there's a lot of mechanical stretching and reflexes that go on like that. You know the thing the doctor does when they like, yeah. They have those reflex loops that are mechanically. coupled with their body, which is squishy, right? And so the physics of that is like pretty complicated. So, so the short way of saying it is that the way that they function as an animal is, is taking advantage of lots of other computational properties. So they do chemical communication,
Starting point is 00:27:23 they do mechanical computation, in addition to neural computation. So the fact that we had the neuroconnectivity matrix was just not quite good enough to understand. what they do. In contrast, it is some of our current understanding and perhaps hope that the connectivity matrix of the fruit fly, because of that is a little bit bigger, it has jointed limbs, just like humans do, and it has enough cells that are actual cell types. Like, not every single cell is just like its own little snowflake. Like, they actually have types of cells. All of those, we are hoping, makes it so that that connectivity matrix is, more helpful, more directly helpful,
Starting point is 00:28:05 like helping us understand what the heck's actually going on. In other words, because individual neurons, et cetera, might be more specialized or something like that, rather than just like every neuron pitches into every task. Right, yeah. So the CL against neurons, some of them are, I mean, they're like, they're so not, they're so not specialized that, you know, how we have, you know, we have a visual system.
Starting point is 00:28:29 So there's cells that detect photons. And we have a, we have olfactory systems, cells that detect smells, right? Like, they have single cells that have multiple sensory modalities going into it because it's just so tiny, it's so compressed, right? They've had to multiplex in that way. And we don't see that as much in our understanding in the worm, in the worm nervous system. And that's a feature, it's a computational feature of how their nervous system works that's in
Starting point is 00:28:57 common with ours. And with the fly connectome, the fly neurons. I saw in one of your videos these images of these neurons. And I think that people, certainly I have this image of a neuron, like a little blob with a couple little spikes. But these are very spindly things. They're stretching across some non-trivial fraction of the size of the fly. Right.
Starting point is 00:29:21 Do you know the longest cell in your body? I do not know the longest cell in my body. It's about as tall as you are. That's a little freaky. I don't want to think about that. It's a little freaky. So you have these cells that actually the same cells we were talking about in the ventral. So in the insects, in the ventral nerve cord, in your body, it's in your spinal cord.
Starting point is 00:29:42 Okay. You have these cells that are responsible for how, this is how you know you stopped your toe. Okay. So there's a cell that detects when you've stepped your toe. So one end of it is at your big toe. Okay. And the other end of it, it goes all the way up to your brain stem. So the very base of yourself.
Starting point is 00:30:05 So talk about long and spindly. Why does it need one cell to do that? Can't like a bunch of cells hand off the message? You can do it? No, this is the actual, this is the normal architecture. Okay. There are other cells involved and you can hand off the message. The advantage of having one cell do it is that you can do it really fast because as it happens,
Starting point is 00:30:26 if you stub your toe, your brain really wants to know about it very quickly. Stupid brain. I don't think I want to know about it. I just want to get all that. Well, this is how you don't fall over. It's all the shit that your body does that, like, you don't think about, right? You don't have to think about not falling over. If you're hiking and you kick a rock, you don't fall over.
Starting point is 00:30:46 And you also don't want to waste your precious time thinking about how to not fall over. You simply want it done, right? You want to keep on having that conversation about number theory you're having with your buddy, right? You don't have to think about how to not fall over just because you kicked a rock. Which segues very nicely into the, actual work you've been doing with the fruit fly connectome. So you have the connectome. That's good. And then there's this open question that you elucidated very nicely. Is it good enough to help us do anything? And you've been asking, what is the relationship between the connectome and walking in the
Starting point is 00:31:22 fruit fly? Is that right? That's right. So I don't know. How do you even start with that? What do you do? Well, so the slightly longer story is that this is a long time collaboration I've had with a friend, a friend and collaborator of mine, John Tetthill. And John is a fly experimentalist. His lab does neurophysiology, and they study the ventral nerve cord and the sensors that come in as well as the motor control that goes out, right? Like that's what his lab does. And we've been collaborating for, you know, like a decade now and have co-advised a series of, of graduate students and postdocs, doing some combination of theory and modeling. And it's been super fun. And so John's also been really involved in some of these connectomics efforts. So a lot of what I said, the stuff that I know that is not wrong is because I learned
Starting point is 00:32:13 from John. Stuff that is wrong. I made that up. I take responsibility. And so I remember a couple of years ago, John and I were taking a walk, and we had a brand-new PhD student who was thinking about joining our labs. And we're like, oh, what do we, what do we have them do? Like, we got to think of something, right?
Starting point is 00:32:33 And, and John and I were talking, and he's like, well, we have, like, we're, we almost have have eventual nerve cord connectome. It's like, it's almost ready because they were like in the process of cleaning it up, curating it, trying to write it up, right? He's like, what if we just, like, simulated it? And I said, that's, that's never going to work. Let me tell you all the ways this is not going to work. So I told them all the ways it was not going to work, some of which I summarized earlier,
Starting point is 00:32:58 you know, the biophysics, all the parameters we don't know, blah, blah, blah. There's tons of stuff. There's lots and lots of reasons that wouldn't work. But by the end of this talk, we had come to, well, you know what, let's try it anyway. You know, it's not going to, we don't lose anything. We're like, let's just, let's give it a good old grad school try. I do, I do, by the way, think that like half of the secret to succeeding in graduate school is listening to your advisor tell you that won't work and distinguishing when they're right from when they're wrong.
Starting point is 00:33:25 Absolutely. So, so our student, Sarah Puclisi, listened to us and she said, okay, he went off and wrote some code. So I'm, of course, long story short, it took a couple of years, but we kept at it, partially because some of the preliminary stuff was actually, it was kind of interesting. There were some hints, right? And what ended up happening is that we went after a question that biologists and neuroscientists have been asking for over 100 years, which is this question of how does the nervous system generate rhythms from not-thinoms. How does this happen? And to tell you, give you a
Starting point is 00:34:05 context a little bit about why this is such an important question, all animal movements are rhythmic. Actually, not just animals, like even bacteria move by spinning their phlegelum, right? So basically all biological movements are cyclic in some way. So you can be walking, running, swimming, slithering, crawling, like basically all locomotion is rhythmic, right? And so the fact that your nervous system needs some way of generating the instructions for your muscles to move in a circle, that's fundamental. Okay. This is like one of the – and so we've been – ever since the 1910s, some of the first experiments
Starting point is 00:34:53 demonstrated that the generation of these rhythms is not by reflex only, is that your central nervous system, somewhere in your brain and spinal cord, was capable of generating these cycles. But we didn't know exactly where. We didn't know which cells did it. We didn't know how they did it. And this, so just by the way, like the idea of some system of mechanical things, cells or anything else, vibrating in periodic ways, that's one that appears all over the place. All over the place. We understand that, yeah. We understand this in general.
Starting point is 00:35:30 And if we have time, I'll come back to, like, I love dynamical systems. We can nerd out about the dynamical systems of oscillator equations a little bit later and actually has connections to our work in the connectum as well. But yes, absolutely, yeah. And so in the intervening 100 years or so, lots of people have studied this, this, this, the idea of these circuits. And so the ability of your nervous system generate rhythms is not only important for locomotion.
Starting point is 00:35:59 It's also important for things like breathing. All right? Because you have like inhale, exhale, inhale, exhale. You can control it, but if you don't think about it, it just happens. And so that's generated by what we call a central pattern generator, a CPG circuit as well. Digestion is cyclic. All right?
Starting point is 00:36:20 So you have to turn the stuff in your digestive system. So there's a, yeah, so there's a sequence of muscle contractions that gets your, gets the food go down. I see. Okay. And in your stomach, especially the stomachs of, so the most studied CPG circuit, centropodininary circuit is actually in the crab digestive system. There's a couple of these like adorable little neurons that are responsible for churning what's in the crab stomach goes, It's called, go, go, go, go.
Starting point is 00:36:49 And it makes that rhythm. And you know which neurons are in charge? This is the work of Eve Marger. She is known for having studied this for decades, and that system is so extraordinarily well understood. It's probably sometimes people are a little snarky, and we say, like, the crab digestive circuit is, like, the only neural circuit we actually understand in all of our neurobiology.
Starting point is 00:37:12 It's a bit of an exaggeration, but it's not untrue either. Like, we actually understand that circuit. And the thing we're looking at, so the idea of central pattern generators, these are little sub-circuits within the connectome that are responsible for, is it always cyclic rhythm motions or is there a more general definition? That's probably the plainest definition of it. And then so the CPG is, I mean, like roboticists love the CPG. So a lot of modern robotics is built on these oscillator equations. So they don't even, like, I've talked to roboticists who, like, actually have no idea about the neurobiology of central phatogenators because for them it doesn't, they don't care. They just write an equation.
Starting point is 00:37:57 We've done the same. So a lot of these, like, computational models of locomotion in animals and robotics, it's just based on a, you just write an oscillator equation. It just goes around in a circle. It's not, you write. There's not, lots of them you can write. It doesn't really matter how it's implemented by cells. You just care that there exists a thing that goes in a circle, right? But we didn't know what actually were the cells and their connections in an actual nervous system that generated these rhythms for any animal that walks.
Starting point is 00:38:26 So that's where we were a couple of years ago. It's like nobody had ever actually found what are the cells, what are their names, how do they work? So in other words, you knew from prior experience with digestive systems and breathing that there had to be these CPGs, central pattern generators that would do these rhythmic motions. You also know that walking is kind of a paradigmatic rhythmic motion, but we hadn't quite identified. We hadn't quite defined the actual cells. And so, to be fair, people have so that need lots and lots of walking systems. People, like, there's tons of, like, just, like, whole bookshelves in the library
Starting point is 00:39:02 about spinal circuits of walking. Invertebrates have these ventral nerve cores. How do they generate their wing flapping? How do they walk? Like, people have tried, and there's tons of information. Uh-huh. But we didn't know precisely which one, which cells they were and how they worked. All right.
Starting point is 00:39:23 So what are you going to do? So we had an opportunity. It's not like we were smart and all of these other people who have worked on it. It's just that we had an opportunity of having the complete connectivity map. Right. Of the eventual nerve cord of a fruit fly. Right? And we figured, whatever it is, it's got to be in there somewhere.
Starting point is 00:39:40 Uh-huh. Right? Like, we don't know. like instead of starting from building it up from individual components that I can actually do experiments on, we talk the reduction of approach. We're like, it's in here somewhere. You know, we got it down to, you know, a network of 4,000 cells or so. We're like, it's got to be in here somewhere.
Starting point is 00:39:57 So wait, when you say you got it down, you're basically like saying, okay, we have 150 or 170,000 neurons. And you like eliminate, like you say, like if I didn't have this one, it could still walk fine. Precisely. So we simulated, okay, so first thing we did is that we, we, we, to make it a little more manageable, we focus on only two front legs. So in sex of six legs, so we just got rid of the other four, we're like, okay, let's just have two legs, the two front legs. We got rid of all of the parts of the nervous system that don't control the two front legs. So we just have two front legs. That's how we got to 4,000 ish. Okay. Okay. So then we simulate that and we were able to demonstrate that that those four, 4,000 neurons were able to generate a cycle. They can generate motor rhythms and actuate the muscles that would have to move the leg. Again, you can't see me, but I'm moving my arm forwards and backwards. It actuates these muscles right here on your shoulder, like the ones that move your shoulder forwards and the ones that move your shoulder back. Okay, so just by simulation, again, we're doing no reinforcement learning. There's no machine learning here. There's actually no deep learning going on at all.
Starting point is 00:41:05 We're just doing brute force numerical simulations of this giant connective matrix. Shallow learning. Regular numerical simulations. It's not that we've been doing for a long time. You write a lot of code and you run it a million times. We can get these rhythms to come out, right? So then we asked, now that we have these rhythms, now that it's actually in here somewhere,
Starting point is 00:41:27 now let's try to reduce it. Now let's cut away one at a time. We basically just started getting rid of cells. We're like, do I need this one? No. Do I need this one? No. And you just keep going until you've thrown away as many cells as you possibly could without losing the rhythm and what you have left over is the minimal circuit. Does that logic
Starting point is 00:41:43 makes sense? I think it does. And so this is just one leg or I guess it's symmetric. The front two legs are doing the same thing. By the way, let's just take an aside to explain the fascinating question, which is the wings. Yeah. Yeah, I know. It's wild. So I would have thought from my mammalian-centric point of view, that wings are just like, you know, arms that have own wing leg, but flies are very different. Not so. Not so. So, so this is something my friend in collaborating Michael Dickinson is very fond of saying. The insect wings are actually novel limbs. I'll explain what that means. So for every other animal that flies, like bird wings are modified arms. Bat wings are modified
Starting point is 00:42:31 arms, right? Other animals that fly have wings that used to be not wings. not so of insect wings. They're not modified legs. There's theories about exactly how they evolved, but they're actually novel structures. It's not like they took a pair of legs. It's not like they used to have eight legs, and two of them became wings.
Starting point is 00:42:55 These are just actual new things. And this is reflected in the nervous system. Say it again, please. This is reflected in the nervous system. It's very much reflected in nervous system. So just like there's these little parts of your spine that correspond to it. Like you have parts of your spine that's like, this goes to the left leg, this goes to the right leg, this goes to your trunk, right? Like same thing.
Starting point is 00:43:15 They have parts of their ventral nerve cord that go to each of the six legs. And you can actually see them. They're like little balls that kind of stick out. They're a little bit bigger because they have more cells. And then they have the same thing. Like there's little clumps of cells that correspond to the wings. Cool. Okay.
Starting point is 00:43:30 So there's a whole separate future of a research project understanding how flies fly. you're trying to understand how they walk. Yes, just walking for now. And how did that go? It worked great. So the pruning study that I briefly described earlier where we took a functioning system that was able to generate these CPG rhythms
Starting point is 00:43:51 and then we started just pruning it. We started cutting away everything computationally that didn't seem necessary for it to be there. I remember I was sitting in actually this office with Sarah and with John, the day we figured out, okay, let's give it a try, you know, like, let's do this pruning study. So remember we started out with 4,000 cells. And I remember telling Sarah, Sarah, just go give it a try.
Starting point is 00:44:15 You know, if you get it down to a few dozen cells leftover, like that, if that's the minimum circuit, you need a few dozen cells to do this, I would be ecstatic. Like, that would be a really cool result. She went off and did it. The answer was three. Three cells. Three cells. That's the minimum you need.
Starting point is 00:44:34 and they have names. We know who they are in the fly nervous system. Tell us their names. That would be fun. That is a great question, because I actually have no idea where their actual names are. Their names are known.
Starting point is 00:44:45 Their names are known, and their lineages are known. So we sort of know where they came from. The names are, I can't handle this. The names are like a series of letters and numbers, and I can't remember what they are. You're the one who said we know their names. That's the only reason I ask.
Starting point is 00:45:01 Okay, we, the royal we. The Royal Vane. Like John knows what their names. So I have no idea what their names are. We gave them pet names, though. Of course. Of course, we had to give them pet names. And they're not too cute.
Starting point is 00:45:13 But so there's three cells. And remember I told you earlier, the cells have identities. It kind of matters like what type of cell they are. So two of the cells are excitatory. They make other cells more excited. And one of the cells is inhibitory. It makes other cells less excited. And so they're called E1 and E2, because they're two excitatory cells.
Starting point is 00:45:30 And the last one is I-1, because they're is an inhibitory cell. And they are connected in a particular, very understandable architecture motif that explains why this tiny little circuit is capable of generating cycles. Well, maybe this is the place then to get into dynamical systems theory a little bit. I mean, because my next question was, how do three tiny neurons manage to tell the leg how to walk? So, okay. So I will, I will be a slightly more precise to say that they are, they are, we believe the three neurons are sufficient to generate the rhythm. Okay, the rhythm. They can generate the rhythm. They're not sufficient to actually control them. They have, I don't know, like dozens of individual muscles that need to be coordinated in their legs to be able to walk. Like we have many more, but you can get the idea, right? Like there are many more muscles and there are degrees of freedom in a limb. So actually controlling them to do something coordinated and not super clumsy is a little more complicated.
Starting point is 00:46:35 But we believe these three neurons are hypothesis, is that these three neurons generates the basic rhythm. And then there's other cells involved to make it actually walk. Does that make sense? And that's just the lesson we're learning over and over again. There's a lot of teamwork in biology. A lot of responsibility shared among different subcommittees. I certainly don't feel like the nervous system is wasting. cells.
Starting point is 00:46:59 Right. Like, we have all these cells. They're doing something, right? Like, I just don't, I don't, I don't, I don't, I don't, I don't, I don't, I don't, I mean, people have these ideas about like low dimensional structures and neuromansopholes and I don't know. There's words thrown around if you talk to some, some other neuroscientists. I just don't, I don't, I don't think biology is wasteful in that way. There's redundancy and that has, there's a good reason for the nervous system to be redundant in case
Starting point is 00:47:24 it gets injured, et cetera, right? Mm-hmm. I don't think there's waste. I don't think we have cells for no reason. If it's there, there's probably a pretty good reason it's there, where it wouldn't be there. Well, it's possible, like, what do I know? But I can imagine that it used to be useful, and then the evolutionary use of it sort of went away, but the cell lingered for a while. Because the cells are so expensive to maintain, neurons are some of the most expensive cells to maintain in your body.
Starting point is 00:47:51 I think my hypothesis would be that if a cell is actually not necessary, it would, the body would find a way for it not to be there over a longer time frame. So it's actually more plausible to have vestigial organs in the body than vestigial neurons? If you're thinking with the vestigial organs that I'm thinking about, there's actually just like, I mean, we can go off in a super long tangent if we wanted to of, that's a different cycle we can go on, about why those vestigial organs didn't go away. And there's usually a good reason because they got stuck, basically. Not that we had a use for them,
Starting point is 00:48:29 but just because the way that evolution works, just they got stuck. Okay. Let's go back to our three neurons, E1E2, I1. Right. And so there's a like really oversimplified spherical cow version of this where it's literally a circuit. It is.
Starting point is 00:48:49 And it is constructing a rhythm. And then there's the slightly more, complicated version where there's external inputs and outputs and other influences going on. And, you know, how do you learn about all those? Yeah. So, so to learn about all of the other stuff, I think what my lab, our vision, and there's tons of collaborators who are involved in all of this because we, this is kind of a giant team effort, is to then actually embody the nervous system, the connect home and all of its glory, actually put it inside a body where it belonged all along, right?
Starting point is 00:49:28 Like a mechanical body or? A simulated body, more like a video game body. Yeah, a video game body, okay. Yeah, so my son's been playing like Red Dead Redemption. He rides a little horse around in this virtual little environment. It's a clump, clump, clump, clump, right? That's just an animation, right? Like, it doesn't really matter if it is biomechanically realistic,
Starting point is 00:49:45 physically realistic, biologic interpretable, whatever. It's just a video. So we want to do that, but actually have it be biologically interpretable and then also physically realistic. as far as we can. But it would be a physics engine, right? Models F equals M.A. Right.
Starting point is 00:49:59 Good. So, sorry, is that going on? Does that exist? Did that help? Did that teach you anything? It's in progress. I think it's in progress. I'm really excited about it.
Starting point is 00:50:09 It's, I mean, this is a bit superlative, but I feel like I rarely in my career felt so much conviction that something is the right thing to do. Like I just, I feel, I, it's so obvious to me. that the brain does not live in a jar. Right. It always controlled a body, and it always controlled a specific body, with these limbs and these muscles and these joints and these sensors, right?
Starting point is 00:50:36 Yeah. In order to move around the world and eat and collect information and do all the things that animals do. And so it's just so obvious to me that we need to be understanding the brain and nervous system in the context of the body that it interacts with to produce the behaviors that the animal actually does. And so that's the grand overall vision of what we're doing. I'd love to be able to, I mean, we are.
Starting point is 00:50:59 We're like, it's early days, right? But it's just, this is, this is, I'm really excited about it. Is there any usefulness and imagine doing it in good old fashion physical reality as well as virtual reality? Yeah, either a robot or can you like hijack the nervous system of an actual fly? For sure. Super easy to hijack the nervous system will fly. As part of the reasons we're working in the flies because it was the kind of the genetic organism of choice for a very long time. And so our ability to hijack every aspect of its nervous system, do gene engineering, to put proteins in it, to shine lasers at it, all of that stuff already exists.
Starting point is 00:51:42 And that is the reason we're working in flies is because the wealth of knowledge that has accumulated over the many decades of people working on the fly. Like we just know so much more about their everything than a spider, for example. Right. So, yeah, we can hijack it. So a lot of the things that, I mean, we're neuroscientists, we love lasers. So there's a lot of lasers going on. We shine lasers at them and we can make them do things. We can shine lasers at them when they're walking, flying, trying to sniff, stuff like that.
Starting point is 00:52:09 I don't think that the sentence, we're neuroscientists, we love lasers. Is that obvious to the outside world? I didn't realize that. We love lasers are the thing. Yeah. love lasers. I don't know if we, I think we might love lasers slightly more than physicists,
Starting point is 00:52:24 Sue, because we just play with them. Yeah, well, physicists are going to join you there. That's okay. And it sounds like, maybe I didn't quite get it right,
Starting point is 00:52:36 but it sounds like rather than learning about these three neurons by experimenting on the neurons, you almost guessed or you almost sort of figured out they have to be doing this in order to make it work? It is a guess at the moment.
Starting point is 00:52:51 We do need to do the validation experiments. We need to also corroborate our predictions and our hypotheses by doing experiments on these actual neurons. For technical reasons, that stuff is ongoing. We haven't done it yet. So that's why this is still, I would say, a very strong hypothesis in my mind.
Starting point is 00:53:10 It's our, we have good reason to make this guess, but it's still a guess at this point until we can confirm it biologically. But I think, like, one of the things that's kind of cool about this result is that as a computational modeling person, I've spent the majority of my career fitting data. Like, somebody has an observation, something they already know. And we're like, oh, sure, I can, like, write some equations in code, and we can recapitulate it. We can, like, make a model that does the same thing that you already know.
Starting point is 00:53:40 This is one of the few instances where I feel like the model actually came before the experiment. We were agnostic going in. We had this giant data set. We're like, let's just simulate it. And then we made a prediction of things we didn't know before. And so part of this result I haven't talked about is that we haven't quite gotten to the three cells that we predicted to be the core CPC circuit. But there's other parts of the nervous system that we did predict. Like we made some predictions of, there's this one pathway that comes down from the neck.
Starting point is 00:54:11 And in our model, it was a cell that has a name, right? And doesn't remember, I do actually know the name of this. It has fewer letters and numbers. I know what it is. But this neuron that comes down from the central brain, and our model said, oh, okay, if you zap it with a laser, it should make the leg tap. It should go back and forth. Okay. And nobody has ever even studied this neuron before because there's a lot of them. But somebody did actually make a cell line.
Starting point is 00:54:41 Like there was a fly we could order that somebody had already made that had the correct proteins in it so that we can shine a laser at it and activate that cell. So we ordered it, we grew it, we cut his head off, and we glued it to a stick, and we shined a laser at it. Yeah. And it tapped its link. Oh, there you go. It's adorable. It's like it was an actual model-driven prediction.
Starting point is 00:55:07 Right. Like we had no idea, nobody had any idea what this neuron did. It was just in the nervous system. Most cells in nervous system are like that. We're like, oh, we can give a name because we kind of know where it came from. We have a nomenclature. We have systematics. We don't know what it does.
Starting point is 00:55:23 Well, I guess that was an obvious next question. If you have three neurons per leg controlling the rhythm, and there are six legs, that's 18 neurons, that leaves 150,000 minus 18 neurons to figure out what they do. Is there an obvious roadmap to what we're, were able to do? I sure hope so. So part of it is this idea of the embodied brain that I talked about. And it goes by a couple of different names. So drawing analogies between what we're doing with these virtual models of animals with the nervous system and the biomechanics of the body, we and some other people have been calling them digital twins, which is a word that we're borrowing from industry
Starting point is 00:56:08 and from industrial engineering. So the digital twins that existing industry are digital twins of things like airplanes and cities. Like there's a digital twin of the city of Singapore, right? Okay. And it's a simulation. It doesn't have every single light bulb. But it has many of the important parts of the city of Singapore,
Starting point is 00:56:31 including its morphology, its connectivity. And it's hooked up to real live sensors in the city so they can sort of update the status of the city, and the city planners kind of use it to do things like predict disaster response, right? Or to in real time shift, if they have to shift traffic patterns or whatever to relieve some congestion because of an emergency in one place, stuff like that, okay? So that's what people in industry have used these digital twins for. And in close analogy of that, the thing that we're thinking about building,
Starting point is 00:57:01 I think would be considered a digital twin of an animal, a behaving animal. So it would have a simulation of the nervous system and the interfaces between the nervous system and the body so that we know how information goes in and how information comes out. And it would be situated in a virtual reality environment that's capable of interacting with things, right, like surfaces that are not flat, right? You can walk-up you physics. Yeah, just physics, right? They can also interact with other agents. So this would be an agent-based model. and so you can have two animals interacting with each other.
Starting point is 00:57:38 They can even touch each other, for example, stuff like that. And so in that way, if we have a set of simulations that are developed in very close collaboration with our experimental collaborators, we should be able to come to a set of models that can predict what's going to happen in parts of these circuits that are hard to predict otherwise. Because the thing is like the whole thing has just mad, mad feedback and recurrence.
Starting point is 00:58:03 And if it's one thing that I've learned about, humans and our ability to reason through rational thought is humans are really terrible at reasoning through what happens with feedback circuits and recurrence. We can go forward. We can follow a path, like A to B to C to D. That we can do. That we can do. As soon as there's recurrence, when D goes back to B and then C goes back to A, our intuition for what's going to happen is really poor. Okay. And that's one of the arguments that I make in motivating why we need these complicated computational models. We can't do it, but we have computers.
Starting point is 00:58:40 Well, I guess an obvious issue that floats to mind is when you are simulating the biology on the computer, you have to make some choices about what to include, what not to include, what to model, what not to model. Is there any danger you'll get sort of get the right answer for the wrong reason? Yes. so many, probably more than more than not. I think we need to be really careful. So this is, I mean, this is something that I think maybe we talked about briefly in person at some point is this idea of the digital sphinx paper that we wrote a couple of weeks ago.
Starting point is 00:59:26 And the brief intro to that is that there's a lot, I was, I was, I was. was starting to see a lot of work and conversation in the field, including by my lab and our collaborators, where because the whole thing is so overwhelming and there's so many details and we know we can't possibly measure them all, it's literally impossible. We know we have to make a lot of assumptions, right? Well, a lot of people, and again, occluding us, we've been doing the same thing. The thing that one thing that we can measure with a lot of fidelity and relatively easily is just the behavior output of the animal. We can get cameras and we can track what it's doing. We can see how it's moving his legs around. We can see where it's like pointing its head.
Starting point is 01:00:10 Yeah. That we can do. Anything external with cameras we can do because we have we have cameras and we have really good computer vision. And so a lot of people are are basically saying that, okay, this is this is the grounding, right? Like if we can get a model that looks like it's behaving like the animal in that it matches what the animal was observed to do with a camera then we've certainly we've gotten something right. Sure.
Starting point is 01:00:41 I know, I know. I'm I'm glossing over lots of details. Of course, lots of people are doing this in a really careful way, but what I was a little afraid of was that people were starting to do this in a not careful way. And in particular,
Starting point is 01:00:57 there was some stuff coming out on social media by some startup companies trying to fundraise putting out work that I looked at it and lots of our friends looked at it and was like that's not, you're overselling this, right?
Starting point is 01:01:15 You're not doing what you said you did. And what they said they did was that they had uploaded a flybrain. That was the headline. They've uploaded a brain. They claim they did it. And of course, you have to read the details. You looked at it.
Starting point is 01:01:32 And I was like, okay, this is not. They didn't actually do that. But that's what they said they did, right? Yeah, okay. But this thing got a lot of, it kind of went viral and it got a lot of attention and not just among non-scientists. It actually, I think a lot of, I got a couple of friends who are not neuroscientists, like chemists. I was like, I heard this thing. They, like, they uploaded a fly brain, right?
Starting point is 01:01:52 Like, that sounds really cool because they didn't know exactly the, you know. Yeah, exactly. And so as an exercise, just as an exercise, I was sitting around with one of my postdocs, Elliot Abe, and I was like, Elliot, this is just, this is nuts. Like, why are people, this is bananas, right? Like, this is not the right way of doing it. But to explain why it was not the right way of doing it,
Starting point is 01:02:18 took a lot of technical words, right? You have to understand reinforcement learning. You have to kind of understand the architecture of the nervous system. It's a lot of stuff to explain, and it just takes a long time. And so Ellie and I were sitting around, And we were like, well, what is the, what is the, what is the thing that we can do that to point out how ridiculous is? What is the logical extreme of what they're effectively doing? We're like, well, you know, they're not actually even using the fly brain connectome.
Starting point is 01:02:41 This could be anything. Could be a random matrix. In fact, it might as well be a worm matrix. It might as well be a C.L. against worm matrix. And so. Sorry, what did they upload? They uploaded a portion of, they simulated a portion of the fly brain. Okay.
Starting point is 01:02:58 Yeah. And crucially, since we spent so much time earlier talking about the ventral nerve cord and how that controls like movements, they did not simulate the ventral nerve cord. Okay. But, you know, even me saying that, right, like, that took that conversation about eventual nerve cord lawyers and how that actually controls your limbs, right? Anyway, that was one of the things that they did not have. They did not have eventual nerve cord, even though their animation definitely had little legs that were like moving around, right? That was the animation part. So, so Ellie and I were like, okay, well, what if we, what if we upload a worm brain and get it and train it to control the fly body? We're like, we can totally do this. And so, and so he and another graduate student lab, they just, they did it. They downloaded the C.L. against worm connectome, all 300 cells in its glory.
Starting point is 01:03:47 And we popped it into a reinforcement learning algorithm that we've been using for lots of other things to control a biomechanicine. realistic fruit fly body walking around in a physics engine to imitate 3D kinematics of flies. And it works. It all runs around just like we know the flies do. The worm connectome in the fly body wriggles around the right way. Yeah. Yeah. I mean, like if you use enough deep learning, if you use a little deep learning and you can train it with good enough data,
Starting point is 01:04:26 it is perfectly possible to get a worm brain to control a fly body. Okay. And so what we're learning from all of this is this is just, I mean, it's silliness, right? Like if you basically use that much deep learning in there and you're allowing all of these parameters to change in ways that are not obvious, the fact that you have a connectome and the fact that you have a hyper-realistic biomechanical body doesn't mean anything. Like this is not biologically meaningful. Right. you can get behavior fidelity without any biological fidelity. Well, and especially because you said that we're not even talking about the sort of identities of the individual neurons or, you know, their maps from inputs to output.
Starting point is 01:05:07 So how in the world can you expect to get something believable, realistic? I don't know what you want to call it. Yeah, so we actually even, we even try it a little bit. So the worm connectome also has motor neurons. It has the neurons that would be controlling. their muscles. And we use that population of motor neurons to wire it up to the fly body actuators just for fun. Yeah, okay. Basically. But that's sort of, that's where the deep learning comes in, right? Like if you have an artificial neural network that maps, that does that mapping between
Starting point is 01:05:42 the motor neurons and how it produces torque in the body, that's where the neural network was. And we trained that. But this is kind of just showing that I can run the same. software on, you know, a Mac or a PC? Yeah, if you have the right interfaces, yes. I think that's a great analogy. I can emulate an engine and a different computer. It's an emulator. Right.
Starting point is 01:06:07 It's totally an emulator. It's exactly what it is. It's like if you have the right, if you have, if you're, if you, if you, if you, if you, don't care about meaningful interfaces, you can get lots of things to plug together. Right. Okay, good. Right. So that's the, you know, like, HDMI matters, right?
Starting point is 01:06:22 And the real trick to get something meaningful out of it is to actually engineer those interfaces. Right. Yeah. Okay. So that's a good cautionary tale. We should all read the popular science literature with a little bit of caution. But since we're at the end of the podcast, let's, you know, think big a little bit about the implications of everything that you're telling us. you know, I'm getting the, one of the messages I'm getting is the embodied nature of all of these neurons, all the brain and so forth. These days, forgetting about wild claims from startup companies, but there's still a lot of interest in AI and consciousness. And, I mean, consciousness, both artificial and real. We've had a couple of podcasts recently that talked about whether biology, was intrinsically important to the idea of consciousness.
Starting point is 01:07:21 Okay. And not because of like antifysicalism or mystical woo stuff, but because all, maybe, maybe all of the little processes going on underneath the hood of a biological organism, the respiration, the metabolism, and the signals going forth, maybe all of those matter in some way over and above just the algorithm that is being run on the hardware. Are there, do you take any lessons from your work for these kinds of ideas?
Starting point is 01:07:51 Yeah, I think so. I maybe try, I'll maybe state what I'm about to say a little more strongly than I actually believe for the, for the sake of conversation. Sure. We have, we have no examples that we all agree on of agents that are intelligent and conscious except the ones that are embodied. We don't agree, right? Like the other ones may or may not. be intelligent and conscious, but we don't agree yet. So the only ones who actually agree on are embodied agents. Furthermore, the nervous system, all nervous systems, evolved starting about 500 million
Starting point is 01:08:29 years ago to control a body, to sense from the environment and respond to those senses in order to move around in the world and seek food and mates and et cetera, et cetera. That's what animals do, right? And everything that we think of as we reasoning as consciousness. I mean, there's all of these words. I'm not going to list them all, right? All of that machinery, all of the capabilities for doing so, evolved on top of the neural computations required for sensorimotor control,
Starting point is 01:09:02 for sensing from the environment and moving the body around. And so in my guess, like I'm going to guess that understanding the the platform, the substrate on which all of those other capabilities were built would be important for understanding the stuff above, as well as a strong constraint in how it could possibly have gotten there. I think that, you know, for claiming to say things stronger than you actually believe, that was incredibly reasonable claim. You've been all the copyouts in there.
Starting point is 01:09:39 All right. All right. I am a scientist. But the sort of the, to turn that around a little bit, if we are interested in artificial approaches to thinking, consciousness, whatever, there's a lot we still have to learn from the biological reality of it. That I actually don't feel that strong about. I don't think it's actually important to understand the details of high biology implement
Starting point is 01:10:09 something to build an artificial system. that takes advantage of some of those insights. I mean, I feel like the field of bio-inspired engineering is full of these examples, where there's the concept that biology might do something was sufficient to inspire a perfectly good solution. Without understanding the details, I mean, like, bird flight is the only, is the first one everyone always thinks of, right? Like, we knew that birds can fly, therefore we were inspired to fly. It turns out imitating the way that birds fly was an utter failure. We had to throw it out all the window and start over.
Starting point is 01:10:43 right, fixed swing aircraft, that's where it's at, right? And so the details of how a bird actually flies is fascinating and we continue to study it, but understanding it was not necessary for us to fly. Very enough. Right? So it's just that we can do it. I think that's a lot of times where the bio-inspiration comes from. The inspiration is sometimes just more like, isn't that cool?
Starting point is 01:11:04 Like the central pattern generator circuits that I talked about earlier, same example, right? The observation that there must be something inside your spinal cord, the genera's rhythms, that's all the roboticists took. They didn't need exactly how it worked, exactly what the cells are and how it works in an actual biological system. They're like, oh, I can implement this chromato oscillator on my onboard computing ship. Great, perfect. This looks great.
Starting point is 01:11:28 That's all they needed, you know? So I'm not sure we need to know the details of biological intelligence to get to artificial intelligence. I don't think that's necessary. However, concept that it may be necessary. for that agent, for that intelligent system to be actually embedded in something that's interactive that has a physics, so to speak.
Starting point is 01:11:53 It doesn't have to be our physics. But I think it should have maybe some rules and constraints, some notion of energy, some notion of conservation laws, like not just limitless everything. Maybe that's important. I don't know. This part I'm speculating, but I don't think it's necessary to understand how biology works to get artificial intelligence.
Starting point is 01:12:16 I guess I would completely agree with you there. The difference, the failure of the analogy a little bit is, we all know what flying is. We don't really know what consciousness is. And maybe there's a little bit more to be learned than just inspiration from the biological side of things. I think that's absolutely true. Yeah, I don't know.
Starting point is 01:12:38 I think the biology of consciousness is difficult. There's the psychology and the philosophy of consciousness. Getting at the biological basis of consciousness is pretty difficult as far as I understand. Of course, famously, it has been labeled the easy problem of consciousness. But to be fair, David Chalmers always said, the easy problem is hard. Yeah. Well, there's, I mean, it is, I don't know. In biology, there are no easy problems.
Starting point is 01:13:10 There are no easy problems. There are no easy problems. Every time you come up with that economy, oh, surely it must be A versus B. 30 years later, it's both. It's both or C, yeah. I guess, okay, then the last question will be, are there any potential therapeutic aspects of this? Are we learning enough about how connectomes work that we can help figure out ways to fix them when they're broken?
Starting point is 01:13:32 I sure hope so. I think one of the most interesting applications that I actually think about a lot in building our embodied models of the, like, except brains not in a jar, right, actually connect to a body, is exactly that interface between the nervous system and the musculoskeletal system, of which there are tons of pathologies and dysfunctions that are pretty terrible when they happen to you. We can think about, for example, spinal injury. So that affects both your nervous system as well as your neuromuscular control, right? You can have an injury, like if I have a bum ankle on one side, I start limping. That's a different neural strategy. And
Starting point is 01:14:12 And then over time, I might adopt a different gate and walk differently. And then a little bit longer, maybe the legs on one side of my body gets stronger. So it's adapting at a different time scale as well. So understanding those interactions between how your nervous system controls movement in compensation to injury and attempting to repair it. Or if you have an amputation, you can't repair the amputation, but you can repair the function, right? So all of those interactions are very important. important and poorly understood because they're holistic.
Starting point is 01:14:47 Like our ability to understand those points of holistic, longer term adaptations is very poor because we just haven't had the tools to be able to do so. And so that's one of the things we hope to be able to do in building these embodied models is to understand not just does it walk. That's kind of, you know, hopefully that works, right? But after it walks, what happens when it breaks? What happens when we break it in different ways? How does it compensate? What is the role of plasticity? What is the role of growing new muscles versus growing new tendons versus growing new neuropathways, right?
Starting point is 01:15:19 And if we understand that, perhaps we'll have some new clues about how to design therapeutics to help that process work better, right? Like your PT does a lot of crazy stuff, but not all PTs agree on how to rehabilitate after some kind of injury. Is there any guidance that we might be able to come up with by understanding the interactions between nervous system and the musculoskeoscelotry system a little bit better? This all sounds very complicated. biology is complicated that's why it's the science of the 21st century I guess it's it's it's squishy and it's fun and and it's I just feel so I feel so privileged
Starting point is 01:15:57 to be able to do it and to like you know spend my time hang up my friends talking about brains of biomechanics I like sometimes I wake up and I like I can't believe this is a real job I think that is the perfect place to end because that's an inspiration for everyone. So Bing Brunton, thanks so much for being on the Mindscape podcast. Thank you, Sean. This is super fun.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.