Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas - 308 | Alison Gopnik on Children, AI, and Modes of Thinking

Episode Date: March 17, 2025

We often study cognition in other species, in part to learn about modes of thinking that are different from our own. Today's guest, psychologist/philosopher Alison Gopnik, argues that we needn't look ...that far: human children aren't simply undeveloped adults, they have a way of thinking that is importantly distinct from that of grownups. Children are explorers with ever-expanding neural connections; adults are exploiters who (they think) know how the world works. These studies have important implications for the training and use of artificial intelligence. Blog post with transcript: https://www.preposterousuniverse.com/podcast/2025/03/17/308-alison-gopnik-on-children-ai-and-modes-of-thinking/ Support Mindscape on Patreon. Alison Gopnik received her D.Phil in experimental psychology from Oxford University. She is currently a professor of psychology and affiliate professor of philosophy at the University of California, Berkeley. Among her awards are the Association for Psychological Science Lifetime Achievement Award, the Rumelhart Prize for Theoretical Foundations of Cognitive Science, and a Guggenheim Fellowship. She is a past President of the Association for Psychological Science. She is the author of The Scientist in the Crib, The Philosophical Baby, and The Gardener and the Carpenter, among other works. Web site Lab web site Berkeley web page Google Scholar publications Amazon author page Wikipedia

Transcript
Discussion (0)
Starting point is 00:00:02 Oh, hear that? That's the spam brand, singing you a love song. Spam, sizzle, pork, and mm. From the neon lights of the club to the harsh, buzzing lights of the office. Don't let the wear show on your face. Just swipe Mabeline instant eraser concealer to erase the night before, wherever that happens to be. Instantly covered dark circles and under-eye bags for a brighter, more awake look.
Starting point is 00:00:32 This do-it-all formula also contours, correct, and highlights, all while staying lightweight, crease-resistant, and smooth. It may be the world's greatest eraser. Find your shade of instant eraser concealer at your local retailer. Hello, everyone, and welcome to the Mindscape podcast. I'm your host, Sean Carroll. So here's a question. Given a problem, how do you find the solution to that problem? This is one of those questions that sounds deep or profound or something like that, but in fact you might worry it is a little bit too abstract.
Starting point is 00:01:02 how can we hope to understand how, in perfect generality, to find the answer to a problem if you haven't given me a bit more information about what kind of problem it is you're talking about. But it's not so abstract that we can't make some progress. You know, in general, how do we, in fact, go about solving problems? Sometimes, hopefully, indeed, you'll find a problem that resembles another problem, a problem that you've seen before, so you can either use or maybe adapt the kind of solution that you already knew. about. Other times you know nothing about the context of a problem, so maybe you'll just try some things randomly, sort of flail about, just get some information. These kinds of questions, as abstract as they are, turn out to be frighteningly relevant to things like building artificial intelligence,
Starting point is 00:01:50 right? When you turn on the computer and there's no software on it yet, the computer doesn't have any pre-existing strategies for solving problems. You have to choose how to build them in. So how should we go about figuring out the best way in different contexts to solve problems? Well, one thing to do is to look at what actual human beings actually do. The lesson of today's conversation with Alison Gopnik is that human beings use different ways to solve problems in different life stages. There's a way that we do it when we're adults, when we're flourishing in the prime of life, and there's a different thing that we do when we're children or babies.
Starting point is 00:02:32 very roughly speaking, babies are a little bit more creative, a little bit more free-flowing. They just try a whole bunch of things. Their attention is hard to pin down. You might have noticed that if you've ever dealt with babies. And that's a feature, not a bug. The fact that babies have trouble focusing their attention on something is a reflection of the fact they're trying to learn about the world by interacting with it in many different ways. Whereas adults are optimized for something different. Hopefully, by the time you're an adult, by the time you're in your 30s, you've learned a lot about problem-solving strategies, and you're more about perfecting the methods that you already know rather than flailing around randomly and learning new ones. Not that you can't do it,
Starting point is 00:03:19 not that it's impossible, but you're better at some techniques than others. And maybe, who knows, we sort of brush upon the possibility in the conversation that later in life, Once you're past your prime reproductive cycle, for example, you can go back to being less hidebound. I mean, maybe that would be ideal. We all know people who don't quite live up to that, but you serve different purposes. I guess the overarching lesson here is that there's a division of labor, not only between different human beings working in groups, but even between different life stages of single human beings. And as we'll talk about, we do, in fact, learn.
Starting point is 00:04:02 some lessons that might be very, very relevant to AI and programming computers and thinking about how we should best approach understanding the world. That's what we're here to do, here at Mindscape, so let's go. Alison Gopnik, welcome to the Mindscape podcast. Happy to be here. So one of the things I guess we could start with from your work that I've derived is the idea that little children, kids, babies, whatever, may. shouldn't just be thought of as unformed adults, right?
Starting point is 00:04:50 That they actually think in a different way. Is that an okay way to put it? Yeah, that's exactly the right way to put it. So I think a lot of people have always thought about the 35-year-old psychologist or philosopher as sort of the height of all of intelligence. And then we just build up to that amazing person as we get older, and then we fall off as we get older. that doesn't make very much sense from an evolutionary perspective. And in fact, I think what's become
Starting point is 00:05:22 clearer and clearer is that children are really fundamentally a different kind of intelligence than typical adults are. And there's also some interesting questions about elders having a different kind of intelligence as well. So it's more like a kind of trade-off between different kinds of intelligences than it is having one magic thing, which is called intelligence that we have more of or less of and that we have less of to begin with and more of more of later on. And an idea that I've been working on a lot is an idea that actually comes from computer science, which is the idea of a trade-off between different kinds of intelligences. And in particular, a trade-off between what's called exploit intelligence and explore intelligence. And what I've argued is that childhood
Starting point is 00:06:11 is really about this kind of exploration intelligence, which is not just different from, but even in tension with exploit intelligence. Now, I have to say when I first started making these sets of arguments, I was, as you could tell from that last comment, I was a little snarky about those, you know, 35-year-old philosophers and psychologists sitting and thinking that they were the apex of intelligence. But since my own children have gotten older and I have more grandchildren, Now I sort of reverse that. My main feeling now is, oh, my God, those poor 35-year-olds, the children and the grandmoms are getting to do all the really fun human stuff.
Starting point is 00:06:52 One of my other slogans is that we're basically human up till puberty and after menopause. And in between, we're sort of glorified primates. We're doing the things that all the primates do. We're finding our way in the dominance hierarchy and we're mating and we're getting resources and all that stuff. And it's only when we're little and we're old that we get to do things like theory of mind and discovery about the world and causal inference and cultural transmission and large scale storytelling, all the things that really make us human. So now I feel like, okay, we grant moms and kids to just keep quiet the fact that we're having all the fun and then the 35-year-olds are having to do all the work. And so this is going to be a preview for what's to come in the, in the, in the, the conversation, but that's basically because we're in that exploratory phase early on,
Starting point is 00:07:44 and in what is nominally thought of as the prime of our adult lives, we're more focused, right? We have tasks, and we're very good at doing those tasks, but we're less good at being flexible and creative about things. So there's this idea that comes from computer science about trying to solve what happens when you're trying to solve what's called a high dimensional task. That means a problem that has lots of different possible solutions that vary along a lot of different dimensions. And one thing you can do is you can just kind of tweak what you're already doing a little bit and see if that makes things a bit better. And that's a very efficient, effective way of trying to solve the problem. So just change where you are a little bit,
Starting point is 00:08:23 see if that makes it better. If it does, then try something else. And that's the essential exploit strategy. That's the grown-up strategy. Here's the thing that I need to do. I'm going to focus on trying to do it. But of course the problem with that is that there might be another solution that's much further out in this space that's as it were, you know, in the far reaches of the box at least, if not actually out of the box. And if you just keep making these little tweaks, you're never going to get there. But what you could, so what you could do is you could bounce around, try lots of things, sort of independent of whether you think they're going to be useful or not. Just try things. Just see how the world works. And,
Starting point is 00:09:04 in computer science they talk about this is the difference between a low temperature search think about it your your audience will oh yeah get this analogy right um think about it as if it was like a molecule of air that's just either going very slowly or bouncing randomly around in the space and the interesting uh solution that comes out of computer science is that the best strategy so these two things trade off against each other right like you can't do both at the same time so which should you do and it turns out the best is start out with a big, bouncy, random, wild search, even though, of course, that's going to take a lot longer and you're going to spend a lot of time thinking about things that actually aren't going to help you, and then gradually cool off to the more focused search.
Starting point is 00:09:51 And people in computer science talk about this as simulated annealing. It's like what happens when you heat up, again, your audience should know this, so what happens when you heat up metal and cool it to make it more robust. And what I think is that childhood is essentially evolution's way of doing simulated annealing. So if you think about those two descriptions, there's one way that's focused and oriented towards outputs. And then there's this noisy, bouncy, random kind of way of behavior. You can sort of pretty immediately think which one fits your four-year-old better. Yeah.
Starting point is 00:10:25 And the thought is that that, even though that might look from some perspectives as if it's a deficit, because the kids are saying weird crazy things. They're often strange pretend land. They do things that don't seem to make sense at first. If you're in explore mode, then that's really the thing that you want to do more than anything else. So, of course, in some ways what this means, and we've actually shown this empirically, is that children are more creative than grown-ups, at least sometimes. So, for instance, we've done a bunch of studies where we give children and grown-ups a problem
Starting point is 00:10:58 that either has a pretty obvious, there's an obvious solution you could try, or a much less obvious hypothesis, one that to start out with is less likely. And what we've discovered is that when the solution is the more likely, the more obvious one, as you might expect, the grown-ups are better at getting to the solution. But when it's the unlikely hypothesis, four-year-olds are actually better than, say, college undergraduates at getting to the right solution. So in some ways, the four-year-olds are more creative than adults. But the trouble is if you look at what we think of when we think about creativity and adults, it's really got two pieces.
Starting point is 00:11:36 So it's not really easy to compare. So if you look at what a creative solution for an adult, the first part is generate lots of possibilities. And then the second part is pick out the one that's good, right? Pay attention to the ones that are good and not the ones that aren't. And that first part, generate lots of solutions, think of lots of possibilities. That's where the kids really excel. But for adults, you also have to have the part about, you also have to have the part about choosing
Starting point is 00:12:05 the right solution in the end. And that's the part where those executive exploit capacities seem to be more useful. So the great philosopher, John Locke, Sean, I know you have the chair of natural philosophy who was a great natural philosopher, said that there were two faculties for human intelligence. One was the faculty of wit and one was the faculty of judgment. So the faculty of wit was generate lots of new ideas and the faculty of judgment was pick out which ones were actually good ones. And kids seem to have a tremendous amount of the faculty of wit, not quite so much at the
Starting point is 00:12:41 faculty of judgment. Fair enough. But okay, if we're giving evolution credit for coming up with this, you know, nice division of temporal labor over our lifetimes. Let's face up to the fact that kids are pretty helpless. Like human babies, they take a long time to be able to fend for themselves. Could you talk a little bit about how that fits in with what we know about other species and whether or not it's like an accident or actually optimizing something?
Starting point is 00:13:09 Yeah, it's interesting because if you look across an incredibly wide range of species, even including insects and there's some arguments that this is true even for, for plants, but certainly true for all the primates and for, and for mammals in general, you see this really striking correlation between how smart, perhaps from a human perspective, but how good an animal is it learning, how large its brain is, how much it uses its brain, and how long a childhood it has. So you see it, the first context in which people notice this was with birds. So if you look at birds like corvids or crows, very, very smart birds, they spend as long as a year or two being fledglings needing to be taken care of. Whereas if you think about like the domestic chicken, chickens are mature within a couple of weeks.
Starting point is 00:14:01 And although this gets me in trouble with chicken lovers and everywhere, they're not very bright there. Or a better way of putting it is they're extremely good at doing the things that they do well, like pecking for grain. And they're very good at doing those from the time they're born. They're not so good at learning. And if you think about it from this sort of explore-exploit perspective, that kind of makes sense. So if you're going to be a creature that lives in a changing unpredictable environment that has to do lots of new things, you're going to need a period to be able to do that exploration before you can exploit. And that means that in that period, you're going to be really bad at doing things.
Starting point is 00:14:40 You're going to be helpless. And you're going to need other, you're going to need the other. other adult members of the species to look after you, make sure you stay alive, make sure you have enough calories to, you have enough calories to fuel all of this ferocious learning that's going on. And that seems to be sort of the evolutionary strategy. The calories are kind of a nice, a nice part of this because it turns out that if you look at how many, what percentage of your calories your brain uses up, even as an adult, you know, 20% of you. of your calories are going to your brain, which means that your brain is, you know, an expensive
Starting point is 00:15:19 computing gadget. But when you were four, 60 percent, in fact, almost 70 percent of your calories were going to your brain. So basically, you know, your average four-year-old is like, like, you know, something out of Doctor Who or science fiction. It's basically this giant, hungry brain that's going around the world, hypnotizing us into feeding it both a bunch of peanut butter sandwiches so its brain can work. and a bunch of data so its brain can work. Pasadena Playhouse presents Lerner and Loz Brigadune, featuring six-time Emmy Award winner Tyne Daily and a full 21-piece orchestra.
Starting point is 00:15:54 With its a lush score, including Broadway standards like Almost Like Being in Love, and The Heather on the Hill. This beloved classic is a heart-stirring journey into a world where time stands still, and love device all logic. Step through the mist of the Scottish Highlands into this timeless love story. Learner and Lowe's Brigh-Doon is on stage at Pasadena Playhouse, beginning May 13. Tickets are on sale now at Pasadenaplayhouse.org. Hey, everyone, it's Cal Penn. I'm the host of Earsay, the Audible and I Heart
Starting point is 00:16:24 Audio Book Club. This week on the podcast, I am sitting down with Ray Porter, the narrator of Andy Weir's audiobook Project Hail Mary, massive sci-fi adventure about survival and science, and what happens when you wake up alone very far from Earth? I really had to make a decision because I caught myself getting that frog in my throat and starting to get teary as I'm narrating some of these sections. And it's like, okay, yo, yeah, yo, is this indulgent? And I really thought about it. I was like, no, at this point, it would kind of be betraying the trust the author and the listener have in telling this story if I don't go through it. But there's places in this book that deeply emotionally affected me and I left it on the mic.
Starting point is 00:17:08 That's great. Because it served the story. People will say like, oh my God, I cried at the end. It's like, yeah, dude, me too. Listen to Eursay, the Audible and IHeart Audio Club on the IHeart Radio app or wherever you get your podcasts. So that's interesting because you're pointing to an explanation that is not purely physical or even mostly physical. It's not about brain size or anything like that, but that if we allow ourselves to poetically attribute forces of natural design, design, to intelligent design rather, to evolution, this sort of planned difficulty in taking care of oneself is actually serving the purpose of letting the kids explore be creative. And that's supposed to
Starting point is 00:17:56 pay off later in life. That's right. So the thought is, and, you know, of course, as always in biology and evolution, it's complicated and it's connected to other kinds of aspects of animals. and there are smart animals who don't have a long childhood, like cephalopods, octopuses, for example. Different kinds of animals seem to solve this explorer-exploit problem in different ways. Sometimes insects and, for instance, seem to do it by a kind of division of labor among some ants and bees are explorers or scouts, and some of them are workers who are actually doing things.
Starting point is 00:18:32 So there's different ways of solving it. But it does seem like this is a strikingly general. and common solution among a very, very wide range of species, and that suggests that it's got this adaptive, it's got this adaptive value. Is this division of labor thing a general feature? I think I remember it was Michael Muthu Krishna, who I had on the podcast and who mentioned this experiment, which I guess is famous among psychologists where human children and chimpanzees were has to poke sticks into a box and get a reward. And then when it's revealed that one of the sticks isn't doing anything, the children didn't learn. Sorry, the, yeah, the children didn't learn and the
Starting point is 00:19:16 chimpanzees did because the children were trusting the grownups. Right. Yeah. And of course, that's another dimension of having this long, having this long childhood and having this particular kind of intelligence, which is that we are also social and cultural learners. So we pass on information from one generation to another in a way that no other, other animals do it more simply, but we do more of it than any other animal does. And again, a lot of that social transmission is taking place in the context of, you know, caregivers, people who are moms and dads who are helping the kids. But it's interesting because that is a famous experiment. But it's worth pointing out that, again, there's this tradeoffs. So if you just imitate what the other people around you are doing,
Starting point is 00:20:06 then there's kind of no point because you're not going to make any progress. So somebody along the line has to actually innovate as well as imitating. And there's a bunch of work we've done some of it and other people have as well that shows that children are, when they're imitating, they're kind of balancing. Well, what do I think about how this actually works? And what do I think about the person who's actually demonstrating it to me? So, for example, there's a lovely experiment where if you have the experimenter says, I'm going to show you how this works, the children are much more likely to do the kind of
Starting point is 00:20:41 overimitation that you've described. So they'll just do what the experimenter did. But if the experimenter says, gee, look at this. I don't know how this works. Do you know how this works? Then the children are much more likely to explore, including exploring, in these kind of unlikely ways. And vice versa, we did some experiments that showed that if you actually show,
Starting point is 00:21:02 get let children discover something about a machine, for instance, a lot of our experiments depend on this wonderfully simple, inexpensive machine, the blicket detector. It's a little box that lights up and plays music when you put some things on it and not others. Then it costs like, I don't know, 2999 or something. It's nice, nice, nice from the grant perspective. And it's, it's been, it's been extremely productive. So if you do something like, present the child with a little box, let them play with it, and they see that, say, red blocks make it go. And then you have an adult who says, oh, blue blocks make the detector go.
Starting point is 00:21:38 The children, it's interesting, they'll just exactly split the difference between what they see themselves and what the adult says. So they won't just rely on what they do see themselves. They won't just rely on the adult, but they'll produce one solution or another kind of in proportion to the probability of those two solutions. So I do think the fact that we're social beings, but that in the course of cultural and social evolution, Michael might have talked about this,
Starting point is 00:22:08 we have to balance imitation and innovation. And it's quite complicated to do that. I think that also plays a role in the special intelligence of children. Well, it makes me think very much of being an advisor to students, right? Especially graduate students, where you want to say, look, please do be creative and come up with new ideas, but please also read some of the literature. And there's a balance there. You don't want to just slavishly follow what other people have already done. Yeah. I mean, I think that one of the interesting things that we're working on now is thinking about caregiving,
Starting point is 00:22:42 thinking about what happens as you take care of someone else. And that's been very that the, and particularly thinking about the intelligence of caregiving. thinking about how hard it is to figure out what you should do as a teacher or a therapist or a parent that will allow the person you're caring for to become autonomous, right? You don't want them to just imitate what you do. You don't want them to just do the same thing. But you also don't want them to get into trouble. You don't want them to do stupid or dangerous things. And how I think it's really interesting about how caregivers manage to walk that line no matter what.
Starting point is 00:23:20 kind of context therein, whether you're thinking about being a, you know, a grandmother of a two-year-old or you're thinking about being a supervisor or postdocs. It's the same, it's fundamentally the same problem. And it's having those caregivers that enables a lot of that cultural transmission to take place. One of the interesting things that has come out that I've been writing and thinking about recently is that actually grandmothers seem to be playing up grandmothers and grandfathers. I always talk about grandmothers egocentricly, seem to be playing a particularly important role in that kind of cultural transmission.
Starting point is 00:23:59 So there's quite a bit of anthropological evidence that when you look at, you know, who gives the songs, who gives the stories, who tells you the big aspects of the culture, it's more likely to be older people than parents. So the parents are kind of trying to deal with the everyday, keep the kids alive, keep being fed. And it's actually the grandparents who are, you know, in my case, telling, telling,
Starting point is 00:24:27 reading Narnia books and singing old Broadway show tunes and doing things that are things that are especially designed to serve this function of cultural transmission. And of course, just as we have this exceptionally long childhood, we also have this long post-menopausal grandmotherhood, elderhood, which is not characteristic of other animals, except, interestingly, for orcas. So orcas are one of the few examples of a mammal that also continues to live for some substantial period of time
Starting point is 00:25:01 after menopause and has grandmothers that live with the pod. And what the grandmothers do is pass on information about what to eat and how to function. So especially when things get short, the grandmothers are the ones who lead the pod out. out to, oh, okay, I remember, you know, 20 years ago there was curtail litmus in this site and help to help the grandchildren, the children and grandchildren to survive. And I think that's another really nice sense of a kind of intelligence that's different from
Starting point is 00:25:31 what we think of as the standard grown-up intelligence. That sounds almost too adorable to be true. How sure are we that the killer whales really put so much responsibility in the grandmother's hands? Well, what I like about this is what it shows is the really important thing to pass on is recipes, right? That's the thing that the grandmothers, that's the thing that the grandmothers are designed by evolution to do. And I just, again, with the advisor thing, just as it's on my mind, we can be egocentric a little bit, that's okay. I do think a very, very common mistake in dealing with students is that the older wise folks are,
Starting point is 00:26:13 sometimes too good at saying why a new idea won't work. Right. Right. And, I mean, are you hinting that maybe I'll get better at that as I get older? I'll be more open to the exploration. Well, I think that's definitely one of the, that's definitely one of the features of elders that seems to be important. And, you know, again, to use the analogy of the students, I think part of the reason for that is that the 35, year old caregiver also has their own agenda, right? So they want to make sure that they get the results that they need for the grant. And the more the older person can sort of say, okay, I'm, I've gotten what I need.
Starting point is 00:26:56 I can be more open to the possibility that this younger generation is actually going to do well. Now, of course, there's big individual differences among grownups about how much, how likely they are to do that or not. But it's interesting that even if you, there's a little bit of evidence that even if you look at adult scientists. And, you know, one of my, one of my other slogans is that it's not that children are little scientists, it's that scientists are big children. And I almost always get a round of applause, you know, if I, if I say this at Fermi Lab or, you know, Lawrence Berkeley Lab,
Starting point is 00:27:29 everybody sort of agrees with that. And one of the, the, there's a little bit of empirical evidence that shows, for instance, that the labs that get the Nobel Prizes are the ones where something unexpected happens. So what happens when you do your experiment and what comes out is like totally weird, not what you expect at all. And you could say, okay, something strange happened, let's go back to the ground.
Starting point is 00:27:54 Or you could say, huh, like, why did that happen? And it turns out that the labs where when something unexpected happens, they follow up and try and figure it out, do better in the long run than the labs where you're doing the thing that you were supposed to do. Okay, we'll try to let go of graduate students as an example here and think more about the actual human babies.
Starting point is 00:28:15 Tell us more about how they get their picture of the world. I know that one crucial step is when they figure out that other people have opinions or beliefs that are different than their own. Yeah. So the big idea about child development, which now I and other developmentalists have been arguing for for the last, I don't know, 20, 25 years, is that you should. think about development as being like theory formation in science. And at first, that idea seems
Starting point is 00:28:48 sort of unlikely. I mean, little kids, are they not like really smart scientists? But when you look carefully at the way they understand the world, it looks a lot like the kinds of theories and the changes in theories that adults, that scientists have. And what that suggests is that from a kind of computational perspective, that's just a really good way of getting information about the world. So what we've shown is that from the time they're very, very little, children are looking for causal relationships, for example, which is one of the things that it's really important in a theory. And we can show, again, with our little blicket detector, these little machines that have where they have unexpected causal properties, we can show that even, you know, toddlers
Starting point is 00:29:33 are doing the right kinds of inferences about how those kinds of systems work. So they seem to develop these causal models, these kind of what are sometimes called intuitive theories. And then they get new data and they change the theories depending on the data. And we can show that really systematically. So we can, for instance, show them information data about how that little machine works, the little bucket detector works, and then we can see what kinds of inferences do they make. And to a remarkable degree, they make the inferences that you should make if you're trying to, if you were being a good scientist.
Starting point is 00:30:11 But of course, you know, figuring out how machines work is fine, but the thing that's most important in all of our lives, arguably, is figuring out how the people around us are working. So way back in the 80s, I and others did develop what's come to be called theory of mind, which is figuring out what is it in baby's minds that enables them to understand your mind. And what we found out, which is sort of typical of what we found out, is that babies both know more to begin with than we would have thought. But they also learn more. So between, say, one and two, for instance, they seem to start learning that people could want different things.
Starting point is 00:30:51 I could want one thing you could want another. Between four and six, they seem to start understanding, between three and six, they start to understand that I could think something different than you do. And those are really, really deep, important things to understand. But more recently, one of the things that I think has been very interesting is the development of work on children's intuitive sociology. So they're also figuring things out like, oh, when people are allies, they'll behave this way. The next level, good. Yeah, right. When they're enemies, then they'll behave this other way.
Starting point is 00:31:24 And if one creature is dominant is larger than the other, then they can get their way. and what we're just trying to do now, again, to go back to this caregiving point, is figure out, what do they actually think about caregiving? And there's a little bit of evidence that even babies already are identifying, okay, this is what it looks like for someone to take care of someone else. This is a good potential, this is a good potential caregiver for me. So there's this lovely kind of back and forth between that helplessness that I talked about, and then the fact that if you are that kind of helpless creature, learning about, other people learning about love, learning about what other people are like, is going to be
Starting point is 00:32:05 really important for your survival. And of course, as adults, that's still the most important thing that we're learning about. I want to get in the audience's mind the idea of those blicket detector, because clearly is playing a big role in your psychology experiments. Is this something you buy off the shelf or do you make them? Yeah, it's funny. We started out when we started doing this 20 years ago. We actually made them. So we had in those days, in the psychology department, you had a shop, which we still tend to have anymore, but we had a shop. We went to the folks in the shop and said, okay, well, look, here's what we want. We want this little, it's just, it's very simple. It's a little box. You put different things on top. And sometimes it lights up and plays
Starting point is 00:32:47 music, and sometimes it doesn't. And then we had various other kinds of variants of this. So we had one with gears where you flick a switch and then the gears go. And then that makes, something else happened. So they're kind of like little Rube Goldberg machines that we'd put together. Now, at the time that we, this is a kind of interesting anecdotal observation. At the time that we first did this, we thought, gee, this would be so much easier
Starting point is 00:33:13 to do if we just had screens in a computer and do it that way. The kids didn't want to have anything to do with it when it was a screen. They really needed to have the real thing. But now what we're finding is that even like three and four-year-olds. And I think the big difference is now screens are interactive. So three- and four-year-olds have the idea.
Starting point is 00:33:35 And in fact, again, if you have a baby, you know, really love the idea that they can act on, they can touch something, they can talk to it, they can swipe it, and then figure out what the outcome is supposed to be. Although it still looks like we need the real things for the younger kids. But for the older kids, the older kids now sort of have the idea, oh, okay. A screen is something that has causal powers as well as a little machine done. My best skin ever at 45? Give me a theme song and a best skincare award because it feels like this.
Starting point is 00:34:12 Right there. That's farmhouse fresh skin, all right? I'm blowing. And everyone asks how. The best skin care is farmhouse fresh. And the award is you, your best you. Visit farmhousefreshskincare.com and use code radio for a free starter routine with any purchase. But still, you have these little, these still doing the little boxes?
Starting point is 00:34:37 I just like the idea that it's a right of passage in the Gopnik lab for graduate students to build a little box that lights up under different circumstances. Well, that's exactly right. And we have a lab culture about where we get the doorbells that go in it. And one of the funny, a funny story about this when we first started doing it, it. When we first started doing it, we actually had the folks in the shop who were putting these things together. And at one point, one of the machines that we had broke, and my brilliant graduate student and I went in and asked, said, look, it's not working. The gear is not making the other gear go. And they said, oh, no, that's not how it works. We just programmed it. So it does this specific
Starting point is 00:35:22 thing when you... No, there's actually no physics behind it at all. It's just a, it's like a, you know, it's like a Tesla car. It's just a computer masquerading as a real physical artifact. And we were, I have to say, we were a bit crushed about this. The way that it actually works most of the time in the lab is that there's a graduate student who's sitting and pressing a button underneath the table that's determining what it does. So from the kids perspective, too, it's not, they have the illusion of actually doing physics, but what they're actually chewing is doing experiments.
Starting point is 00:35:59 It feels like the Wizard of Oz here. I feel like I've been fooled about all this stuff going on. Okay, so if you say things like, you know, a child under one-year-old doesn't have this theory of mind and a two-year-old does. So do we know of certain benchmarks or phase transitions and the growth of a child where their, you know, cognitive view of the world expands a bit? Yeah. So as I say, from the very beginning, I mean, literally from the time they're born, babies are doing things like paying special attention to faces and interpreting them. From very early on, they're imitating other people in a way that other primates don't seem to,
Starting point is 00:36:38 which suggests that there's something about understanding other people that's really important. By the time they're nine months old, they're doing things like pointing to communicate, and a nine-month-old will point, and if you don't follow the point, they'll get antsy and go, ah, you know, dare, dare, dare. So that suggests that they know something about what the fact that other people are looking at the same thing that they are. So sometimes what happens is that people say, oh, you don't get theory of mind until you're four or five, but that's not right. You just get different theories the same way you would if you thought about, you know, physics. There's different kinds of theories about different parts of the mind.
Starting point is 00:37:19 but very characteristically you see these changes coming at you know roundabout a particular age so about nine months you see this big revolution and you know some of it may just be maturation but i think the something that is increasingly important and that we haven't thought about enough is just how active learners even these very young children are just how much what they're doing is not just observing statistics, although, of course, they do that, but also actively experimenting on the world. And, you know, if you think about even a newborn, they're looking at you, they're smiling, they're seeing what the effects of their actions are. And by the time, by the time you're talking about a toddler, that's like their whole lives, right? They're just constantly, constantly
Starting point is 00:38:11 doing experiments, except when they do it, we call it getting into everything. When physicists do it, we call it being a good experimental physicist. And I think it's really under, so one of the things that we've been doing a lot recently is trying to think about how the children's learning compares to the learning of machines, for example, something like the large models that have had so much play. So what's the relationship between what AI is doing
Starting point is 00:38:42 and what these very little kids are doing? And I think one of the really big dimensions that makes the kids different from the AI systems is that they are going out and actively trying to get information about the world and then changing what they think based on the information they get, as opposed to the large models, for example, that are basically just,
Starting point is 00:39:03 it's interesting to think about this in terms of cultural transmission. The large models, I've argued, really what they do is just pick out patterns in all the things that other people have already figured out. So they're just doing the image part of cultural transmission. But the kids are actually going out there and finding out things that are new and
Starting point is 00:39:23 experimenting and seeing new outcomes. And we think that may be really the crucial thing that lets them learn as much as they do as quickly as they do and with as few calories as they do compared to the AI systems. So it is a little bit like the distinction in causal reasoning between simply finding correlations versus being interventionist about things, right? Going outside the data set and saying, if I did this, what would I be next? Yeah, that's exactly right. And we've, for 20 years, we've been collaborating with actually philosophers of science
Starting point is 00:40:00 and computer scientists who've been trying to figure out how do we do causal inference in science. And one of the really, you know, basic ideas is that you can't, or it's very difficult to do it just by looking at patterns of statistics or correlation that you want to make causal inferences. Well, what makes a causal inference different from just a correlation? This is an old philosophical problem, back to Hume. And I think the idea that's become most prominent in philosophy of science and seems intuitively and in science itself is, well, okay, if you want to really make the causal inference, you have to do an experiment.
Starting point is 00:40:37 You have to actually intervene, do something in the world, see what the outcome is. what makes something causal. And I think we've been doing some work on this, but I think if you look at even quite young babies, you know, if you think about something like a busy box, a busy box is a toy that you use for little babies. They're called busy boxes. A busy box is a thing that has lots of causal possibilities where you can do lots of experiments. It's it's cheaper than your, you know, standard cyclotron, but it has the same kind of character for babies. It's a way of it's a way of actually being able to do the kinds of experiments that you need to figure out how the world works. And of course, as I point out, since theory of mind and intuitive psychology is so important,
Starting point is 00:41:29 they have a great experimental subject there all the time, which is the caregiver. So if you think about them as being little scientist, little psychologist, we're the lab rats. So a lot of what babies do, in the terrible twos, for example, is doing something and then looking to see how we react to it. You know, we had Judea Pearl on the podcast. And at one point, yeah, and at one point he said, literally, like, haven't you ever seen a baby? All a baby is doing is like touching things and making a causal map of the world. And I understood what he was saying and agreed with it, but I guess I didn't realize it was quite as literal as apparently it is. No, absolutely.
Starting point is 00:42:10 So what we've done is taken some of the formalisms that Pearl developed like causal basnets and then show how the children are, how the ways that children are solving these causal problems are just like what you'd expect from causal graphical models. So essentially what the children are, I mean, I think we can say that we've demonstrated this. What the children are doing is constructing causal graphical models from data and then using them to determine
Starting point is 00:42:35 in their interventions. Now, the thing is that both for Judea and for the whole world of causal inference and for us, it's still a kind of unsolved problem about, and for scientists, right? How do you decide which experiment is really the right experiment to do? Sure. So what something like Judea's framework lets you do is say, okay, if you get this result, here's the causal graph you should have. But how do you decide what you should test in the first place. And I think one interesting thing that's coming out is that a lot of the, the sort of old shibbolus about how you do experiments, you have to keep everything constant, you can only vary one thing at a time.
Starting point is 00:43:21 That's not true for babies that it may not be the best way of doing science either. And I think this is like a wonderful open, a wonderful open question about how do you decide? what kind of experiments to do? How do you decide how to explore? And we've started doing this with kids and AI agents. What we've done is put them in the same kind of general environment. Minecraft is one of the ones that we use, if you know mine. I imagine your audience will know Minecraft,
Starting point is 00:43:57 although there's a bit of a funny story about this, which is that I originally started doing this work about how you explore the Minecraft environment because my grandson was mad about Minecraft. I figured, well, at least this will make me cool, right? If I can tell him, the grandmoms doing stuff about Minecraft. Then I gave a big talk about this. I got something called the Rummelhardt Prize. It's a big deal.
Starting point is 00:44:20 And my grandchildren were in the audience. And I said, well, I did this because I wanted to impress Augie. And he came up to me very sweetly after the talk and said, Grandma, this is a little, that was a little embarrassing because like, Nobody cool plays Minecraft anymore. We all play, we all play Fortnite. So like it isn't really cool to be involved in Minecraft if you're a 13 year old.
Starting point is 00:44:44 So I wasn't keeping up the changes. But in any case, Minecraft is a great game. It continues to be a great game for grownups and for 11 year olds. And it's what we've done is put kids in that environment and then put AI agents in that environment. and just said, figure out what's going on, explore. And even relatively young kids will explore that environment in a rational way.
Starting point is 00:45:12 They're not just randomly trying things. They're doing things in a way that lets them figure out how the environment works. And they're much, much, much better at it than AI agents. Interesting. Well, the thing you said about traditional scientific methodology asking us to keep all but one thing constant and changing that one thing and seeing what the effective. I mean, that sounds sensible to me, but is it just because it's simpler to keep track of what's going on,
Starting point is 00:45:42 but maybe it's ultimately less effective than kind of poking things in concert? Yeah, so that's a really interesting technical, formal question about when, you know, that it is true that if you did that, that's a simple, formative rule about what to do, but sometimes actually doing, trying to vary different things at once can be more informative than than, because as you can imagine,
Starting point is 00:46:05 it's really hard to keep everything else constant and just change one. And that, I think thinking about what the kids are doing can be very, because the kids, the kids are often trying lots of different things in different ways if you think about, you know, the two-year-old with the busy box. And yet they seem to be such good learners.
Starting point is 00:46:25 So it's a really interesting question, I think for AI, for science, for developmental psychology, about how that's possible. And how literally true is it to describe these very young children as good Bayesian's? Yeah, I think it is literally true. What we've done is take various kinds of ideas from Bayesian inference, and what we can do is give kids information, for instance, about the baseline probability of a hypothesis, and then we can give them information
Starting point is 00:46:58 that will let them update that hypothesis and they'll do the right kind of updating in the right kind of way. Another kind of discovery that was in my lab, but also even more in labs like Richard Aslens and Jenny Safrin's back in the 90s, was that children are quite good at doing statistics, which you might be really surprised at because after all, grown-ups are notoriously bad at doing probabilities. But if you do something like show the children that one blicket were works eight out of 10 times and the other one works four out of 10 times, they'll pick the one that has a higher probability of activate. And then this is with 18 month old. And then you say, okay, which one will you use here, make the machine go? They'll pick the one that has the higher
Starting point is 00:47:46 statistical probability. In fact, they'll do it even if it's like two-thirds versus eight-tenths. So they seem to be able to kind of do the math implicitly obviously and unconsciously to figure out what how probabilities work. So you know, there there's and but again this has led to this puzzle which is they really seem to be doing something like Bayesian inference. And yet we know that Bayesian inference ideally is sort of impossible computationally. So if you have a big set of hypotheses, then it's going to take you, you know, if you're the Bayesian ideas, you take a hypothesis, you generate a pattern of evidence, you check it against the data. that you got, you figure out which hypothesis would have been most likely to generate that pattern of data.
Starting point is 00:48:33 And the problem is if you have a big space of hypotheses, that's just going to take forever because you're going to have to try each one of the hypotheses separately. It's called the search problem. And nobody's really quite solved that problem, either in statistics or in AI or in childhood. And the children do seem to be able to solve that problem because they end up, you know, finding out about the world. And it's a really interesting question about how they solve it. And my guess at the moment is that something about this active inference might be part of the solution.
Starting point is 00:49:07 That it isn't just that you're sort of sitting back, having data float over you and then trying to update your hypotheses. You're actually out there being an experimenter and figuring things out, which should make at least the, I know that in physics there's always a bit of attention between the theoreticians and the experimentalists. So I think from the developmental perspective, we're team experimentalists.
Starting point is 00:49:33 That's the- Fair enough. That looks like that's really the secret. And how much do we know about the neuroscience of this kind of thing? I mean, are these ideas that babies sort of get better at different kinds of reasoning as they grow older mirrored in ways that the brain is wiring itself?
Starting point is 00:49:54 Yeah, it's quite, neat because one of the oldest developmental neuroscience findings, which is consistent with what we've seen to this day, is that early in development, what you see is lots of new synapses, lots of new connections being formed. And then there's a point, a kind of tipping point where the ones connections that have been formed are strengthened, they're myelinated, they become more effective. The ones that haven't been formed are pruned. So the weaker one, ones just kind of disappear. So you have this early brain that is very, very flexible,
Starting point is 00:50:31 very good at changing in the light of new experience, very plastic as neuroscience I just say. And then, but not very effective, right? Not very good at actually doing anything. And then you have this later brain that's very good at doing things, but much less good at changing much less with much less plasticity. And again, this is like another version of this explore, exploit trade-all. And empirically, if you look at brain,
Starting point is 00:50:55 development, you can see that depending on the domain that you're in, you see this pattern of very early, early proliferation and then later pruning. So if you look at the visual system, for instance, you see this tipping point at around 18 months. So the visual system is getting set in that early period. And then it kind of settles in, which is why if you have vision problems, it's really important to correct them in a baby. it's really important to correct them early. If you look at the language areas, it's like five or six where you start seeing this, you start seeing this transition. So it's when you've developed a language that then it becomes harder for you to learn another, learn a new language.
Starting point is 00:51:38 And if you look at what's sometimes called the executive function, the prefrontal part of the brain, that's the latest one. And that's not completely getting set until adolescence, for example. Okay. So you see this, but you do see this general pattern. Start out with lots and lots of connections, and then at some point start strengthening and pruning. Hey, everyone.
Starting point is 00:52:01 It's Cal Penn. I'm the host of Earsay, the Audible and I Heart audiobook club. This week on the podcast, I am sitting down with Ray Porter, the narrator of Andy Weir's audiobook Project Hail Mary, Massive sci-fi adventure about survival and science, and what happens when you wake up alone very far from Earth?
Starting point is 00:52:23 I really had to make a decision because I caught myself getting that frog in my throat and starting to get teary as I'm narrating some of these sections, and it's like, okay, yo, yeah, yo, is this indulgent? And I really thought about it. I was like, no, at this point, it would kind of be betraying the trust the author and the listener have in telling this story if I don't go through it. But there's places in this book that deeply emotionally affected me. And I left it on the mic.
Starting point is 00:52:50 That's great. Because it served the story. People will say like, oh my God, I cried at the end. It's like, yeah, dude, me too. Listen to Earsay, the Audible and IHeart Audio Book Club. On the IHeart Radio app or wherever you get your podcasts. My best skin ever at 45? Give me a theme song and a best skin care award.
Starting point is 00:53:12 Because it feels like this. Right there. That's Farmhouse Fresh Skin, all right? I'm blowing, and everyone asks how. The best skincare is Farmhouse Fresh, and the award is you, your best you. Visit FarmhouseFreshskincare.com and use code radio for a free starter routine with any purchase. And I just hate to bring it back to academia once again, but this comports with the idea that, you know, like the energetic young idea creators are the young faculty and postdocs, right?
Starting point is 00:53:46 not the older senior faculty you've been successful for many decades. Yeah. I mean, I think it's an obvious question that lots of people have asked is, well, are there things that grown-ups could do that would make them as creative as the children? And the first thing to say is, even if you're thinking about a lab, if you want to get grant money, it's really good to have people who are really, really practiced and know how that system works and are really good at, and even, if you forget about grant money, just actually doing the experiments, if you're a physicist, for example, is a giant enterprise.
Starting point is 00:54:25 It really takes a lot of focus and executive energy to be able to get the experiments to run. So I don't think you'd want, you know, like you don't want your department chair to be this wildly creative person who's thinking up strange ideas all the time, right? You want them to be focused. Nevertheless, I think it's interesting and relevant to this Explore Exploid trade-off that when adults want to, adults often will kind of have social institutions that allow them to switch back and forth between this explorer and exploit. So sabbaticals, I think, are a great example in the academic context, right?
Starting point is 00:55:08 So we don't sort of expect scientists to be able to just do this on their own. what we think is going off to a retreat, going off to a sabbatical, going off to a workshop, those are all ways that you can kind of pull yourself out of the context that you're already in and allow yourself to do greater exploration. So, you know, it's a pain that we all spend so much time traveling as scientists. But I do think there's a bit of an argument that being in a different place, being in a different context, often doing interdisciplinary work where you're forced to think about things in really different ways, because now you're looking at biologists instead of physicists.
Starting point is 00:55:49 All those seem to be ways that grown-ups set themselves up to be more creative. And does it, you've mentioned already several times, the connection between these ideas and AI, large language models, etc. How operationalizable are these insights? Can we imagine building better AI models using the lessons we've learned from development? Well, that's kind of what we've been doing. So I'm part of the Berkeley AI research group, and what we're trying to do is take some of these ideas, ideas about active learning, ideas about social learning, ideas about causal model building, and actually implement them in AI systems. And to a certain extent, what's happened is that because the large models have been so effective in lots of ways, they've,
Starting point is 00:56:43 there's a tendency to sort of say, okay, well, they worked before. We'll just keep making, we'll just, you know, pour more compute into them and they'll get bigger and they'll use up more energy and then we'll get better and better and we'll have this mythical thing called AGI. And one of the things when I talk to AI groups, which I do a lot now, I have a, I have a slide where I say there's no such thing as general intelligence, artificial or natural. which always lead sharp intake of breath from the audience, because it just isn't the theory, the ideology, the model, and oh, okay, there's this one, this gets back to our very first conversation. The model that there's this one thing called intelligence, some people have more of it, some people have less of it, if you have more and more of it,
Starting point is 00:57:34 then you're going to be more and more effective. That's not the model that comes out of cognitive science at all. What comes out of cognitive science is that we have these tradeoffs between different kinds of cognitive capacities. So if we could design, sorry, so LLMs don't rather strikingly have any of these capacities. They're not going out in the world and doing experiments. They're not creating abstract causal models that then they can use to generalize. And you can see the difference between the amount of data that the children have
Starting point is 00:58:06 and how good they are at generalizing it to new situations and the large models. The large models need enormous amounts of data, and they're not very good at generalizing, especially to what's called out-of-distribution cases, cases that weren't there in their training. The kids with much less data are very good at doing that. So the question is, what are the kids doing, and could that make more effective AI? And I think the thing to say at the moment is we're very, very, very, if you start thinking about the comparison to kids, we're very, very far away. So the kids are, you know, orders and orders of magnitude better than any of the current AI systems that we have. But I think that's the direction that we might want to go in.
Starting point is 00:58:49 Well, it's a difficult conversation to have sometimes because the AI, the people who worry that we're close to superintelligence any moment now will say, look, we can beat the best human beings at playing chess or playing go or whatever. And you try to make the point, as you just did, that there are other aspects of intelligence that they're not good at, but they seem a little bit fuzzier, right? It's a little bit harder to put a benchmark on it. Is that something that we're trying to make progress on? Well, I mean, one thing is that, for example, if you look at robotics, you know, notoriously, the AIs are better at playing chess, but they're terrible at actually picking up the pieces if you made, part of the game B that you had to pick up, find the pieces in a, you know, that have spilled on the floor and put them back in exactly the right places. They're really quite bad at doing that, especially if you had, say, a new chess set that
Starting point is 00:59:47 was, you know, like an Alice in Wonderland chess set or something where it wasn't, you couldn't, you couldn't just identify them from your previous training. And this is the famous Moravich's paradox. This goes back to beginnings of AI, but things that look really hard for humans. chess and go turn out to be relatively easy for AI and things that look really easy, like perception and action and movement and the kinds of things that kids do when they figure out how the little blicket detector works turn out to be really hard for AI. I think the whole conversation about intelligence in AI is fundamentally misguided because
Starting point is 01:00:28 really the reason why these systems are as effective as they are is, because they're taking advantage of hundreds of thousands of humans who've done things like put text on the web and in some ways like with reinforcement learning from human feedback have trained up the systems. My latest metaphor about this is, do you know the story of Stone Soup, the old children's story of Stone Soup? This is a wonderful children's story. This is another advantage of being a developmental psychologist is you have wisdom of the stories that grandmothers have told in the past so this turns out to be a very very widespread bit of folklore and here's the story there's these visitors who come to a village and they say we want some food
Starting point is 01:01:22 and the villagers say oh sorry we don't have any we can't share any with you and the visitors say that's okay we're going to make stone suit we have magic stones so they get a big cauldron they They put a couple of stones in the cauldron. It starts boiling. They say, see, we're just going to make stone soup. It's so good. You know, it would be even better if we had an onion and a carrot that we could put in it. But I guess if we don't have it, we don't have it.
Starting point is 01:01:46 So one of the villagers says, I think I have an onion and a carrot somewhere. They go and put it in. They say, oh, that's great. Like, oh, see how well the soup is working. When we made it for the king, we put a chicken in. And that was really great. So could you go? And of course, you can guess what happens.
Starting point is 01:02:02 The villagers all contribute their bit of food. And then at the end, the villagers say, this is amazing, this is magic. We got all this soup just from a stone. And I think if you think about a version of that where you said there were the computer people, the tech guys who went to the universe of computer users and said, oh, we have AI.
Starting point is 01:02:24 We can do it just with three algorithms, gradient descent and transformers. And we'll have AI any minute now. But you know, we really need a lot of data to make this AGI work. And the user said, oh, okay, we have all of our text and pictures that we put on the internet, all of our books, all of our newspapers. We could give you that to make the intelligence. And then the villagers, the tech guys say, oh, that's really great.
Starting point is 01:02:54 But like, if we could do reinforcement, our AGI is still saying stupid things. So if we could get reinforcement learning from human feedback and get people to give us feedback about whether our AGI is doing well or not, that would make it even better. And the people said, oh, okay, like there's whole villages in Kenya who could do this. And finally, the tech guy said, oh, that's really, we're getting really good intelligence. But if we could do prompt engineering, so we could figure out what exactly what prompt to use, that would make it even more intelligent. Could you do that? And the user say, oh, yeah, we could think a lot about that. And then, of course, in the end, what happens is that the tech guys say, see, we told you, we made HEI just from a couple of algorithms.
Starting point is 01:03:38 And it's ignoring the fact that the reason why it works is not because of the algorithms, but because of the data. And that data comes from a bunch of humans who are doing the kind of exploratory creative intelligence that four-year-olds do. I do presume that there are other angles on building AI systems that are more oriented towards making causal models of the world, even intervening, putting them in robots. I really don't know. Yeah, that's one of the things that people have thought about. But as I say, it's hard. So, you know, trying to do the Bayesian inference is hard because the search problem is hard.
Starting point is 01:04:16 There's what's called reinforcement learning. And reinforcement learning, an old idea in psychology, is the, and actually take actions and then see if the actions make you better off or not. So the mouse who runs through the maze and gets cheese sometimes but gets a shock other times, and learns to go towards the cheese and away from the shock. So that's a technique that, for example, in the Go solution, reinforcement learning played a really important role in trying to solve that problem. chess, the chess agent is playing against itself over many, many trials to try and figure out what the, what the best reinforcement learning is.
Starting point is 01:05:01 But the problem with reinforcement learning is that it's too narrow. Like if you just end up on, you could, since all you're thinking about is, am I better off or not, you're not going to be able to do the kind of exploration that you need to really figure out how the world works. And so the idea that I think is most promising and we've been working on is an idea that should be very familiar from science, which is an idea that you could do learning. But instead of trying to calculate whether you've got, you know, higher usefulness or utility or not or whether you've got more cheese, what you're calculating is, did I get more information? Did I find out more about the world or did I find out more about the system when I did this action versus this other action? And the result is that you are going to do, again, to go back to the point we made before, you're going to do the things that will tell you something about how the world works, even if they don't make you any better off in the short run. And there are ideas in an idea I really like and that we've been working on is the idea of a kind of intrinsic reward,
Starting point is 01:06:12 like the kind of reward you get as a scientist when you just are doing it because it's so cool when things work out the way that you want. So I think the solution to the problem means having a kind of reinforcement learning agent, but one where the reward isn't cheese or utility or winning the game, it's finding out something new, figuring out more about how the world works. And there's been a lot of interesting attempts both in development and in AI to figure out how you could make that happen, what kind of signal would tell you
Starting point is 01:06:45 that as a result of this action you'd learned more. And one that we're working on now that I think is really interesting is something called empowerment. And the idea behind empowerment is that you get rewarded when you do something and it has a predictable effect on the world. So what you do is try to do as many things as you can
Starting point is 01:07:03 where varying the action that you take will vary what happens out there in the world. And when you do that, that's really exciting. That's really cool. that is something you're going to be likely to try again. But you also want as many different kinds of actions, as many different relationships like that as you can. So if you find one, after a while you'll get bored and you'll try and find another one. And I think that's very closely related to the causal learning that I talked about before.
Starting point is 01:07:30 So if you think about what you mentioned this, Sean, that causation is all about intervention, right? So really what you're learning with this empowerment reward is, I'm going to learn how to intervene. I'm going to learn how doing things out there in the world ends up having effects. And we have a little bit of evidence that even tiny babies, you know, if you take literally a two or three month old and you put a ribbon between their foot and a mobile so that they can actually control what happens to the mobile, they'll sit there and try all sorts of different patterns of kicking to try and see what the consequences are going to be for the mobile. So they really are like little, and they'll smile and they'll giggle and they'll go back to doing it. It just seems to be an incredibly satisfying, an incredibly satisfying enterprise for them. And of course, they're doing the same thing with mom when they're, you know, doing all sorts of funny faces and seeing if mom gives funny faces back again. So I think that might be a really, really important part of the solution.
Starting point is 01:08:35 And again, it speaks to science because going back to what we were saying before about how, systematic to your experiments have to be. One of the things that I've noticed is that the powers that be always say, well, you don't want to just have a fishing expedition, right? This grant is just a fishing expedition. But a lot of times what you actually end up doing is doing a fishing expedition. You try something and then kind of unexpectedly it has this particular systematic result. And that's where the gold is rather than the causation that you already know about.
Starting point is 01:09:10 And empowerment is kind of a way of saying, yeah, keep that fishing expedition going. Well, and there are better and worse ways to go fishing. Right, exactly. You know, we did have Carl Fristin also on the podcast, and he has these ideas of the free energy principle and the Bayesian brain. And part of it, part of the sort of aspect that gives people pause is he seems to be saying that our brains try to minimize being surprised. And you might think that, therefore, you should.
Starting point is 01:09:40 just sit in a dark room and never do anything. But if I understand correctly, he was saying, no, actually, we want to minimize the net surprise over our lives. And therefore, we better explore around and do weird things now so we can anticipate what's coming. Yeah, that's exactly like the exploration and exploitation tradeoff that I was talking about. So it's interesting if you think about something like empowerment or all of these kind of intrinsic rewards, the failure cases are you just sit there and do the same thing over and over
Starting point is 01:10:12 again. And maybe those are human failure cases do. So what you need to do is to be able to want to have a coherent story about what's going on around you. You don't want to just be, you don't want to just be paying attention to random stuff that's happening, even though that might give you something that's new and surprising. But you also don't want to just do the same thing over and over again. And and we've been looking at, you know, comparing, for instance, what do children think when you give them a machine that just randomly does different things like our, our blicket detector, but a kind of random blicket detector, versus one where there's a systematic relationship between what you do and what comes out, even if what comes out is surprising, versus one that just does something obvious that you know about beforehand. And they really seem to like to play with the machine that is surprising, but surprising in a systematic way. and I think that's true about scientists too. The world has some structure, and we do take advantage of that,
Starting point is 01:11:09 and I think this is something that we haven't quite, as philosophers, physicists, AI researchers, whatever, learned how to systematize perfectly. Yeah, I mean, one of the things that always strikes me, I mean, the reason why I started doing this work in the first place back when I was a philosophy student, completely a philosophy student, is if you think about going back to Plato and Aristotle, one of the deep philosophical questions is this question of knowledge.
Starting point is 01:11:37 It's how we know that there's a world out there. It has structure. Not only does it has, it has, you know, forks and minds and all sorts of things that we can't immediately observe in it. And yet all that reaches us from that world is a bunch of disturbances of air at our eardrums and photons at our eyes. How do we ever, at any point, manage to reconstruct that world from that data? And I think going back to Plato and Aristotle, the two ways of trying to answer that question have been to say, well, okay, it just looks as if we're understanding that world from data. It's really there all along. So it's really some kind of innate, there's some kind of innate evolve structure that's responsible for this. And that's been one, that's Plato's approach. That's one of the approaches. The other approach going back to Aristotle, which is the approach of the most recent version of AI like the LLMs, is it just looks as if we're, we're really understanding the structure, all we're doing is pulling out correlations between those photons and those disturbances of air.
Starting point is 01:12:38 So all we're doing is just taking the data and pulling out correlations. And we think that that's telling us something about structure, but we have no particular reason to think that. And the great thing about development is that if you look at actual babies and children actually learning, they don't seem to fit either of those pictures. They seem to be able to learn really. and I think also if you look at science, we seem to be able to learn really radically new things about the world,
Starting point is 01:13:05 whether it's learning that I might like broccoli and you don't, or whether it's learning about, you know, corks and leptons. And yet it doesn't look as if all we're doing is just pulling together the finding statistical correlations in the data. It looks as if we're genuinely developing theories that go beyond just the correlations in the data. And I don't think we have a good, you know, even though we've been doing this for a thousand years, we still don't have a good formal model, computational model, good understanding of how that's possible.
Starting point is 01:13:39 And I think looking at the kids who are clearly doing it is a really good route to answering that philosophical question. And that's what I've spent my whole career doing. You know, sometimes looking at what actually happens in the world does help us understand it better. Alison Gopnik, thanks so much for being on the Mindscape podcast. Well, thanks so much for having me Sean, a great conference. conversation.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.