Freakonomics Radio - Does “Early Education” Come Way Too Late? (Rebroadcast)

Episode Date: March 1, 2018

In our collective zeal to reform schools and close the achievement gap, we may have lost sight of where most learning really happens — at home. ...

Transcript
Discussion (0)
Starting point is 00:00:00 Hey there, it's Stephen Dubner. We're bringing to you today an important episode from our archive that we thought was worth hearing again, or, if you weren't listening back in November of 2015, worth hearing for the first time. We've updated it a bit. It's called, Does Early Education Come Way Too Late? Thanks for listening. Hey, Lovett. Dubner, how are you doing? Great. Welcome to New York. Yeah, it's good to be here. We don't often get to do this, sit down face-to-face. Yeah, because the traffic in New York is so terrible that I stay away.
Starting point is 00:00:29 Why are you here? Are you meeting with the Pope today? No, the Pope passed on me. Oh, are you meeting with the UN today? UN passed on me as well. Just me? Yeah, just you. All right, so, Levitt, I understand you've gotten into the early education business.
Starting point is 00:00:51 Yeah, I think we regret it a little bit. Roland Fryer, John List, and I went out, and really John more than us, started a preschool with the idea that if we were really smart and really thoughtful, we could do things for three-, four-, and five-year-olds that would change their lives and maybe could be used by other people to change a whole lot of lives all across the world. Steve Levitt is my Freakonomics friend and co-author. He's an economist at the University of Chicago. John List is a colleague there. Stephen Dubner, how are you doing, my friend? I'm doing great, John. So why don't you tell us a bit about your work? My primary research goes to the field and runs field experiments on
Starting point is 00:01:33 issues like why do people give to charitable causes? Why do people discriminate against one another? Why do women earn less money than men? Liss grew up in Wisconsin, went to college there and in Wyoming, then taught in Florida and a few other places. When I moved to Chicago, I became very interested in public education, largely because I saw the problems of public education all around me. I live just south of Chicago in a city called Flossmoor, and right next to that is a city called Chicago Heights. And in Chicago Heights, you have ninth graders who are reading at a fourth grade level and doing math at a third
Starting point is 00:02:16 grade level. You have poor kids who just aren't experiencing the value added that children of the affluent experience. So combining that with the fact that that's sort of how I was raised myself. I was raised in public education and not in a wealthy family at all. My father's a truck driver and my mother's a secretary. So this was a sort of setting that I had been raised in and I could see the problems in that setting, but they really came to fruition for me when I moved to the University of Chicago. So, List, Levitt, and the Harvard economist Roland Fryer set up an experimental preschool in Chicago Heights. The demographics are about one-third white, one-third Hispanic, one-third African American.
Starting point is 00:03:03 It's a relatively poor community. And the idea there was to look at state-of-the-art techniques for teaching kids reading, writing, and arithmetic, cognitive skills, and compare the outcomes of kids with another curriculum that emphasized non-cognitive skills like sitting still and expanding working memory and executive function and things like that. Even though the school was a school, it was also very much an experiment. So our overarching theme is let's go into schools and use them not only to teach our kids, but to teach ourselves what works and why. But the school wasn't the only part of their experiment. The more interesting piece of what we did was to get away from the idea of the school and say, well, really, schools only have kids for a handful of hours per day, but who really
Starting point is 00:03:57 will mold the kids through their life are the parents. And so if we could take the parents of preschool kids and have an academy where we actually teach the parents how to teach their kids, then maybe we could have a bigger and a longer-term impact on the kids. So you set up also then a parent academy, yeah? Yeah, so we set up a parent academy. And this is a large basement room in a K-12 school in Chicago Heights. We have two teachers in there. The parents arrive for a session, which is once every two weeks for 90 minutes,
Starting point is 00:04:34 and it's over a nine month long period. And we then incented the parents for things like their attendance at our early childhood sessions. They were incented based on the homework assignments that their kids handed in. They were incented based on the interim assessments that we actually conducted with their kids. So over the course of the school, your parents could earn up to $7,000. Wow. So you're trying to help kids do better at school by essentially paying their parents
Starting point is 00:05:07 to teach them to do better at school, yes? Exactly. To take parents who care enough about their kids that they're willing to show up to these classes and equip them with a better set of skills so that they could be better teachers to their kids, not just, say, the kid that was in our program, but all the siblings, and to do that over a lifetime as opposed to just one year. And why go to the parents? Why not just pay the kids directly? Well, for one thing, the kids were three, four, and five years old, so they wouldn't understand the value of money. Maybe trinkets could have done it. But I think we really
Starting point is 00:05:36 believed that the power of success lies in the parents. Levitt and List were pretty enthusiastic about their experiment and undaunted. How hard could it be to set up a preschool and a parent academy? OK, so now is where the real problem starts. It was one of the most difficult things I think we could have tried to do. So we have to make sure that the superintendent, of course, is on board. And as economists, I think maybe we weren't fully equipped to make it. It seemed like it would be easy. We needed to secure state licenses to run a pre-K program. The logistics
Starting point is 00:06:18 are hard. We need to develop a partnership with the community so the community trusts us and they will actually send their kids to our parent academy. It's just plain complicated. We need funding. Funding for the teachers, funding for development of the curriculum, and we needed funding for the incentives. Wow. Okay, a couple quick questions before we get on to longer questions. What's all this going to cost and where's the money coming from? So this particular experiment cost nearly $1 million and the money came from Ann and Ken Griffin. Who have a foundation in Chicago, yes? This was a foundation in Chicago. It is no longer a foundation in Chicago.
Starting point is 00:07:02 You put them out of business with your parent academy? We put them out of business. We spent all of their money on these interventions and they've gone broke. So now Ken's trying to make more money and so is Ann. And maybe they'll send us some more in the future. The truth is the foundation shut down when the Griffins divorced, but the economists did get their money to run the preschool and parent academy. So what did the Griffins Foundation get for all that money? How did the experiment work out?
Starting point is 00:07:30 It worked out okay. Just okay? Hmm. Today on Freakonomics Radio, we'll hear about their results. We'll also hear about other early education ideas, some of which are really cheap. This costs $5 a year per kid to produce. And some early education ideas suggest that even preschool may be too late. are really cheap. This costs $5 a year per kid to produce. And some early education ideas suggest that even preschool may be too late.
Starting point is 00:07:55 By the end of the age of three, children born into poverty will have Radio, the podcast that explores the hidden side of everything. Here's your host, Stephen Dubner. So three economists, led by John List, decide to set up a preschool in Chicago with an experimental curriculum. So, these are three, four, and five-year-olds. And our goal, of course, was to set up a program so we could measure how the children's cognitive and non-cognitive or executive function skills changed because of our program. None of the economists knew much about this field. So essentially what we did is we started out doing a series of interviews with experts in early childhood in development psychology. And we ended up hosting a two-day conference at the University of Chicago where we had the leading experts come in and we
Starting point is 00:09:09 talked about exactly what should the tools be that we use to measure cog and executive function skills and in the end we settled on these assessment tools called Woodcock Johnson on the cognitive side and on the non-cognitive side, things that measured operation span, spatial conflict, and self-control. The economists also set up a school for the parents of the preschoolers. And here, we gave them a curriculum that was composed of both a cognitive component, which is called Literacy Express, and a non-cognitive component, which is called Tools of the Mind. So we combined these two curriculum to try to push these two
Starting point is 00:09:54 types of skills into the parents, let's say, minds, and then show them how they could teach their children how to have these skills of self-control and to finish your homework. And the parents, you will recall, were incentivized to do their work. A parent could earn up to $7,000 based on their own attendance and how well their kids did on homework and assessment tests. So what were the results of all this educational experimentation? What do the data say? Well, the research team is still working up the results on the preschool curriculum. But as for the Parent Academy, John List, Steve Leavitt, and Roland Fryer published a working paper on that
Starting point is 00:10:36 project. The verdict? Let's jump right into the results. I mean, these are huge, huge gains. That is to say, incentivizing and teaching parents how to teach their kids really worked. So a first thing to note is we have huge differences across kids. Now, what I mean by that is that our program really, really helps Hispanic and white students, and it doesn't help blacks at all. How disappointing was it to see that Hispanic and whites moved a lot and blacks didn't? Yeah, I think it's a mixed bag. I think that when we started down this research agenda, part of our mission was, first of all, to learn about the racial achievement gap and learn about how we can lower that gap. Most of the time, we lump Hispanic and African American kids together,
Starting point is 00:11:31 and we say, what is the solution for minorities in public education? And I think this particular result teaches us that the education production function across these two groups is very different, and the solution will not be the same across African American and Hispanic families. Do you have any ideas for African American families? We have a few things boiling, but nothing that has popped up that moves African American families. And to be honest, we have no real theory for why that is. The two sets of parents were equally engaged in the program, and we can control for all sorts of background characteristics,
Starting point is 00:12:14 and nothing really explains it. So to me, that's really a puzzle, and a puzzle that I don't have an answer for. But again, the Parent Academy did work really well for some students. In just a nine-month program, we can move an Hispanic student from around the 30th percentile in test scores to above the 50th percentile in test scores. These are bigger effects than almost any educational policy that is put into place. So we're getting results that swamp a result that you would get from a year-long program in a charter school. Now that's on both the cognitive assessments and the non-cognitive assessments. But in looking carefully at cognitive skills versus non-cognitive skills,
Starting point is 00:13:03 the researchers discovered something, something that was both a key to their success, but also a warning sign. Upon entry into the program, we tested kids to see where they stood in terms of their cognitive skills, how well they could, you know, do the alphabet, math, and whatnot, and also their non-cognitive skills
Starting point is 00:13:20 about how they could sit still and keep things in memory. And what was incredibly interesting to me in our findings is that for the kids who were below average on these non-cognitive skills, so the ability to concentrate, to remember things, to kind of think their way through problems, the below average kids made no progress in our program. So if you started behind in terms of how ready you were to learn in some sense, then you got nothing out of our program.
Starting point is 00:13:49 And that was true whether you scored high on the cognitive scores or not. So kids could be really high achievers in terms of math and reading, but gain nothing from our program if they didn't have these sort of sit skill skills. But on the other hand, if you were above average on these non-cognitive skills, you got huge benefits from our program. So what does this mean? Well, for one thing, I think it intuitively makes sense that there's a threshold for being able to learn. If the kids can't concentrate, it's hard for them to learn. And no matter how hard the parents try, it's going to be hard to make games.
Starting point is 00:14:25 On the other hand, what it's really valuable for from the perspective of public policy is that it really tells you where to target your resources. So what does the Parent Academy research suggest? Well, at least a couple of things. One, the fact that it worked, that at least some kids did better after their parents got tutoring, seems to confirm what Steve Levitt said earlier, that schools themselves may not have as much influence as we think. Well, really, schools only have kids for a handful of hours per day, but who really will mold the kids through their life are the parents. Two, if a child's ability to learn is so heavily influenced by what happens at home, and if the kids who came in with low non-cognitive scores at age three or four didn't make cognitive gains, well, maybe the key here isn't just what happens
Starting point is 00:15:18 at home for a kid, but what happens at home well before a kid is even old enough to go to preschool? In other words, what happens starting at age zero? The brain, unlike any other organ that we have, it comes out relatively underdeveloped. That's Dana Susskind. Unlike, you know, your kidneys, they function from day one as they will for their entire lives. The brain is underdeveloped and it's absolutely dependent on what it encounters, you know, on its ride to full development. And it's really in those first three years of life when a huge amount of the physical brain is built, literally 80 to 85 percent of it. And, you know, what is building those connections, those 700 to 1,000 new neural connections, is language. Susskind is one of those multi-hyphenates.
Starting point is 00:16:07 I am the director of the 30 Million Words Initiative and author of 30 Million Words, Building a Child's Brain. And I'm at the University of Chicago, and a scientist, a surgeon, social activist. Exhausted already. And mother, and mother of three wonderful children. Suskind is head of the Pediatric Cochlear Implantation Program at the University of Chicago, which means she sees a lot of families whose babies don't hear well, if at all.
Starting point is 00:16:38 So when they come to me, they're often shocked because most children born with profound hearing loss actually have no family history of it, even though it's genetic. So, you know, first you sort of wrap your arms around this overwhelmed family because the baby has no clue and start sort of explaining what we can do. What they can do has changed a lot in recent decades. You know, it's really a golden age for children with hearing loss. What they can expect out of life is what any child with typical hearing can. And that's because of what people like Suskind now routinely do.
Starting point is 00:17:16 What I do each and every week is I implant this technology into the baby's cochlea, which is sort of a snail-like shaped structure where the nerve part of hearing begins. Then about two weeks later is really when their hearing birthday happens, because you think it's when I do the surgery, I have to tell parents, look, they're not going to hear you right after surgery. But two to three weeks later, the audiologist, with usually a whole gaggle of family members, are there to turn it on. And that's when... So they really flip a switch at some point, yes? They literally flip a switch. So now, again, keep your eyes on her, and within a few seconds it'll go on. You'll see her reaction.
Starting point is 00:17:57 Hello! Natalie! Natalie, honey! Hi! Hi, honey! Hi! Hi, baby! Hi! You hear mommy? You hear mommy? But Suskin learned that giving kids the physiological ability to hear didn't mean they'd automatically be successful in learning language. You know, how do we learn language?
Starting point is 00:18:29 It's not like all of a sudden when a baby's born, they come out speaking in sentences and understand what you're saying. Hearing is not the ear, it's the brain. And it takes time for the brain to understand what those sounds mean. That's what Suskin came to understand during follow-up visits with her patients. If I do a cochlear implant on a child at 18 months versus five years of age, it's a huge world of difference. That is, the older ones had a much harder time learning language. And that's because the brain's neuroplasticity,
Starting point is 00:19:00 its ability to develop with new stimuli, is most acute when children are under the age of three. Susskind found that age wasn't the only factor working against some kids. Poverty was also a big issue. When you take the Hippocratic Oath, your responsibility doesn't end when the surgery ends, right? It ends when your patients do well.
Starting point is 00:19:22 And for me, that meant understanding that there were so many, you know, what we call social determinants of health outside the operating room, which were impeding how my patients did. So, Susskind started a program called Project Aspire. Project Aspire is for children with hearing loss from low-income backgrounds. And as I was working on Project Aspire and learning, I realized, oh my gosh, what's going on in my deaf population really just mirrors what's going on
Starting point is 00:19:50 in the typically developing population at large. And that led to Susskind founding another organization called the 30 Million Words Initiative, which gets its name from a remarkable study from the 1960s. Researchers Betty Hart and Todd Risley started off during the war on poverty in Kansas City working with preschool students, trying to sort of improve their vocabulary, trying to impact the achievement gap. Hart and Risley, who were psychologists, studied the language environments of young children
Starting point is 00:20:23 in 42 families. And they followed them for about two and a half years till the age of three, going into the homes every month, recording, trying to understand what the language environment looked like. And what they found in a nutshell was that by the end of the age of three, children born into poverty will have heard 30 million fewer words than their more affluent peers. Wow. By the age of three? By the end of the age of three, so right before they were turning four.
Starting point is 00:20:53 The deficit in words is indeed huge. But frankly, quality is even more important. And Hart and Risley demonstrated differences in the quality of input, as well as many others. You know, with children from poor language homes hearing more prohibitions and less affirmations, the don't do that, get down, less verbal back and forth, less complex vocabulary.
Starting point is 00:21:17 That combination, less vocabulary and less complex vocabulary, creates a major detriment. By 18 months, the children from language-poor homes are processing language at six months behind those from language-rich homes. So what I always like to say, and it's quite tragic, is that it's not just about language being, you know, vocabulary being poured into a baby's brain.
Starting point is 00:21:42 It's really building a fundamentally different machine. So if a language-rich environment is really helpful in building kids' brains, what's to be done about it? That is what Susskind and TMW, the 30 Million Words Initiative, are trying to figure out. We're developing programs, evidence-based programs, that reach parents where they are to get this message out. So we have something in the maternity wards, pediatricians' offices. Our best developed program is this home visiting program, where over a six-month period of time, we, one-on-one with a home visitor, we go in and explain the science. Coming up on Freakonomics Radio, we tag along as the 30 Million Words Project visits kids and parents in the science. Coming up on Freakonomics Radio, we tag along as the 30 Million Words Project
Starting point is 00:22:25 visits kids and parents in the home. So even if Sincere can count and say his ABCs, he won't be ready to learn if he can't sit still or follow directions. It's the bottom I have right now. I'm getting him to assist me. He's pretty busy at this age, right? And if you need to boost your word intake, well, there are more than 300 Freakonomics Radio episodes
Starting point is 00:22:48 that can be downloaded at Freakonomics.com, on Apple Podcasts, or wherever you get your podcasts. Seek a family. Do this. Keep down. Mommy. We'll be right back. Basketball. Stippy, stippy, stippy, stippy. Happy, funny, world. Car. Yes, so nice. A puppy. Thirsty, basketball. On show.
Starting point is 00:23:33 Go there. The main goal of the 30 Million Words home visiting program is to teach parents to effectively communicate with their kids during the critical years of brain development. We're going to be visiting Taquilla today, and her son is sincere. So he's about like 17 months or so. That's Michelle Saenz, the TMW home visitor. She's outside a seven-story brick apartment building on Chicago's west side. Hi, Taquilla. It's Michelle with the TMW study. We're down here.
Starting point is 00:24:09 The mom she's visiting is 22 years old. My name is Tequila Williams, and my baby's name is Sincere Person. And we're sitting in the living room of my apartment. The TMW Home Visit Program is being run as an RCT, a randomized controlled trial, to test its efficacy. It'll take a few years. Each family will get 12 visits during a six-month period, and then the researchers will do follow-up assessments for another three and a half years. They've enrolled 200 families, and they're hoping to have all the data by 2019. One tool the researchers use is a little device called a LENA, or Language Environment Analysis System.
Starting point is 00:24:51 It's basically a pedometer for language. It counts words. Okay. And so now we're going to look at your LENA report. A parent is supposed to put the LENA in the kid's t-shirt pocket so it can record how many words are spoken by both child and parent. And so, on the day of your recording, Sincere heard an average of 963 words per hour.
Starting point is 00:25:18 And I know for this one you had set a goal for 1,100. It was really close to it, right? Just like right out there. And that's not the only kind of data the TMW initiative is gathering. For instance, they also measure the brain processing speed of the kids they're visiting. So it's a measure we do on two different home visits and three of our follow-up visits. And it gives us insight into the children's cognitive processing speed. That's Kristen Leffel.
Starting point is 00:25:44 She's the director of operations for TMW. She was also visiting Tequila and Sincere. So we set up a camera over the back of the laptop and asked the child to sit in the parent's lap and watch a little stimulus on the computer screen so that the stimulus basically puts up two images simultaneously and so it might be a fish and a puppy, and then it'll say, look at the puppy, do you see the puppy?
Starting point is 00:26:09 Where's the book? Can you find it? See the kitty? Can you find it? And so then we'll code it frame by frame to watch the child's eye movements, and it gives us insight into the processing speed in their brain. If you're slower that means that you're taking a longer period of time to process a word that you already know and you have less time to learn new words.
Starting point is 00:26:37 That's Dana Susskind again. So you imagine at 24 months children who have been exposed to less language are slower processors. So they're taking longer to understand what they already know. As a result, they can't pick up the newer words. So it's sort of like you're not just behind in the race of life. You're a slower runner. So that's why you don't catch up. Yeah, it's like compound interest.
Starting point is 00:27:02 I mean, it's funny. As much as we hear the talk about how for every dollar you put away at age 20, it's the equivalent of, you know, whatever, $50 at age 50. What you're talking about is actually much, much more frightening to think about the deficits at those early ages because they start compounding at such a young age, yeah? Yeah, and it's the reason that we need to start thinking in a preventative rather than a remedial fashion. And it's not to say that we have all the answers or that it's going to be easy, but it's about the only way that we can prevent this from occurring because these children have potentials that we will never know. So that even when people are doing these different studies when they're older, which are great, you never want to stop.
Starting point is 00:27:48 I mean, it's never too late. But you've built a different machine at that point. The TMW program teaches parents a simple mantra to remember how to best communicate with their kids. How you explain to families and to this country what a rich language environment is, is complex. And what we've done in our research program is we've culled it down to what we call the three T's. Tune in, talk more, and take turns.
Starting point is 00:28:17 And so just as review, Tequila, how did you guys use the three T's this week? So Saturday when we did the Lena recording, we went on the bus downtown to see my dad. Tune in is sort of the most nuanced of the Ts. It's really seeing what your child's interested in, following your child's lead, using that child-directed speech, that sing-songy voice. Talk more as it sounds, talking more, using rich vocabulary, narrating while you're changing your baby's diaper. And take turns, which I think is the most powerful, is really viewing your child as a conversational partner.
Starting point is 00:29:05 Even before they have a word or a babble, knowing that just by responding to any glances or gestures, you're getting them ready to have a conversation and to do it from day one. And those three T's are the foundation and the behavioral measuring stick that we should all use in interacting with our children. A behavioral measuring stick, a reminder that even though a program like 30 Million Words is all about the words, about the cognitive skills, there's also a lot to be gained in the non-cognitive realm, as John List and Steve Levitt saw in their Parent Academy experiment. The TMW randomized trial is now in its second round, and it's incorporating one of the key findings from the first.
Starting point is 00:29:36 One of the biggest things we found is that parents after the first trial said, you know, this is great. Now I know how to build my baby's brain and make him smart, but how do I use my language to help him behave better? And so we actually have a week where we explain children's, you know, executive function and prefrontal cortex development and how their language and how their modeling can help their children's behavior. Today we're going to talk about another way to build sincere's brain and help them do well in school and so it takes more than being smart to be successful so a child's behavior is just as important as his intelligence so even if sincere can count and say his ABCs he won't be ready
Starting point is 00:30:16 to learn if he can't sit still or follow directions That's the problem I have right now. I'm getting him to assist me. He's pretty busy at this stage, right? He's been on all the time. Green light's on all the time, you said. And so the stronger Sincere's red light becomes, the better he will get at self-regulating. And so a big part of helping Sincere learn to self-regulate is watching you do it. And so use your three T's to show him how you use your red light to self-regulate in challenging situations and so when you notice yourself feeling frustrated or upset talk more and explain how
Starting point is 00:30:54 you're feeling to sincere and so tune into your tone of voice if your tone is angry and loud sincere will think that it's an appropriate way to respond. And so if you stay calm, he will learn how to stay in control in tough situations. Is there any evidence that two parents are better than one when it comes to learning language? I would think that one vigilant parent is certainly better than two crappy ones. I mean, obviously, when you're a single parent, there's a lot more stress and a lot more on your shoulders. And that's why I always say, you know, when you advocate for the power of parent talk,
Starting point is 00:31:34 you also have to advocate for the parent. It sounds like parent-child conversation is maybe the highest form of, you know, language acquisition. But where does TV fall into that? And is educational TV, you know, any acquisition. But where does TV fall into that? And is educational TV, you know, any better than the average TV? I mean, the studies are pretty compelling in the zero to three space that screen time is not necessarily a good thing. But in the book, I talked to several studies really showing how the screen of a human being saying exactly the same thing as somebody
Starting point is 00:32:07 face-to-face will have absolutely no effect on sort of the language learning. Now with that, it's not so much that there's something wrong with the screen, it's that it's not responsively contingent. It's not responding to the child. And so I mentioned this cool study where it was a Skype with a responsibly contingent adult who was responding to the child and they were able to learn vocabulary, meaning that there's nothing wrong with the screen. It's more that we're social beings. And especially in those early, early years, you want something responding to the cues of that actual child for language to stick. But presumably that could be a great use of artificial intelligence, right? I mean, if I can program, whether it's an iPad or a robot, to have a conversation that is contingent upon what the kid said. Yeah. You know, technology right now is more on the distracting side of things, but certainly as it evolves, you could imagine, you know, it becoming smart enough that, you know, maybe us parents aren't going to be necessary in the end, but it's got to evolve
Starting point is 00:33:10 some more. Until that evolution is a bit further along, we wanted to find out more about TB's impact on early learning. There's this television program that's been entering the homes of millions of children for decades now. Tell me how to get, how to get to Sesame Street. That's Melissa Carney. I'm a professor of economics at the University of Maryland. She used to be a big fan of Sesame Street. My father says that my sisters and I learned everything we knew from Sesame Street. Her favorite character?
Starting point is 00:33:53 Greetings, it is I, the Count, and it's time to answer that fascinating question, what is the Sesame Street number of the day? I loved The Count, and I would get very excited when The Count came on. And recently it's been pointed out to me that as an economist, perhaps that's not a surprise that I would like the guy who came on and talked about numbers. Carney and her colleague Phil Levine were curious about whether a show like Sesame Street really helps young kids get ready for school. Many, many researchers had already concluded that it does. There have been more than a thousand studies on the Sesame Street effect. But to an economist
Starting point is 00:34:30 like Carney, studies like these are potentially problematic. They often rely on self-reported data, which, as we often preach around here, can be the lowest form of data. They may have identification and selection problems. That is, if you find that kids who watch Sesame Street do better in school than kids who don't, how do you know that it's not just that Sesame Street appeals to smarter kids or to the parents of smarter kids? So economists are really keen on finding what we call causal impacts. So we don't just want to say, oh, kids who watch Sesame Street when they were little did better when they got to school. So what we need to do is figure out a way to identify kids who watch Sesame Street that had nothing to do with them or their family's situation. Okay, how do you do that without running a giant randomized trial where you force some
Starting point is 00:35:28 kids to watch Sesame Street and forbid others to watch? Sesame Street just came on the air in 1969. So the first thing we can do is say, hey, relative to the kids who were just born before them, did they do better when they got to school? They found that yes, the generation of kids born after Sesame Street did do better in school. But that alone couldn't prove the Sesame Street effect. Maybe schools were improving. Maybe the next generation was just smarter.
Starting point is 00:35:57 And so just comparing those two generations could be misleading. It wouldn't be due to Sesame Street. But Carney and Levine did find a way to make sense of the data. Good for us as researchers, but bad for the kids. It turns out that a third of the kids in the country couldn't watch Sesame Street even when it came on just because of limitations in television technology at the time. In many areas, the show was broadcast on channels with a weak signal, which meant access was limited. So kids who, for example, in 1969 or 70 were living in Los Angeles or Southern California more generally or Ohio, where they lived, Sesame Street was broadcast on a weaker station and they couldn't get that signal. So there's this great variation for us as researchers.
Starting point is 00:36:41 Two-thirds of the kids in the country could watch Sesame Street. A third couldn't. Not because of anything their parents were doing, just because of where they happened to live and the station that was broadcasting Sesame Street in their county. So using that sort of two layers of differences, the kids who were younger versus older and the kids who lived in places where Sesame Street was on a stronger broadcast signal or weaker signal, we can identify the effect that Sesame Street had on their school readiness. All right, then, what was the effect? We find that kids who were preschool age in places where they could watch Sesame Street
Starting point is 00:37:18 were 14 percent less likely to fall behind when they got to elementary school. If we try and make a comparison of that number to what we see in the literature studying, for example, the Head Start program, our nation's publicly funded preschool program, the estimated effects on school performance are very similar. Head Start is estimated to cost roughly $8,000 per year per kid. How about Sesame Street? This costs $5 a year per kid to produce. That's one, that's two, three, four, five. Now, there's a big difference between a kid spending the day in preschool
Starting point is 00:37:57 and just watching a TV show. Still, the Sesame Street effect is impressive. And in fact, that effect is entirely driven by kids who grew up in counties with higher levels of economic disadvantage. So I mean places that had higher levels of high school dropout, had a higher rate of single parent households, had lower household income on average. These were the kids that really saw a relative improvement in their school performance. The effect is largest for boys and African Americans. And this, you will remember, is opposite what John List and Steve Levitt found with their parent academy interventions. Our program really, really helps Hispanic and white students, and it doesn't help Blacks at all.
Starting point is 00:38:49 We were surprised by the results because if you look at just a lot of studies of interventions designed to help kids, you tend to see the largest results for girls and for whites. And here we are finding the largest results are for boys and for African-Americans. So we were pretty excited about that. You know, we could speculate this gets a little bit outside of our expertise as economists, but Sesame Street was explicitly designed to help urban kids and minority kids. So if you remember the set from when you were a kid and watched this, it's set on an urban stoop. And there are, you know, African-American characters featured prominently. So it's possible that Sesame Street did this well and urban kids and minority kids related to the characters and related to the content and maybe took more away from it than they would have if the program were designed differently. So that's some good news, right? Sesame Street seems to have been successful in getting
Starting point is 00:39:55 kids, especially low-income African-American boys, ready for school. But here's the bad news. Carney found that long- term, the benefit wore off. We don't find a persistent effect on ultimate educational completion or looking further down the road. We don't see that large of an effect on wages or employment. of a strong academic elementary school outcome, but not much in the long run, as being consistent with this idea that Sesame Street wasn't impactful on those non-cognitive skills that will show up later in employment outcomes, for example. The monster. What is that? A monster mummy.
Starting point is 00:40:47 You know this big word? It's called your imagination. So the evidence we've looked at today from Sesame Street, from the 30 Million Words Initiative, from the Parent Academy, as inchoate as it is, seems to suggest, at the very least, that when we talk about learning, we don't really know what we're talking about. Most of us, at least. Most of us probably think too much about cognitive skills and not enough about non-cognitive. Most of us probably put way too much faith in the formal education system when, in fact, the path to learning begins way before then, at home.
Starting point is 00:41:33 As sort of I've evolved in my thinking along this journey, it's really about early childhood. Dana Susskind again. We need to reimagine what education looks like because we need it to follow the science. Education doesn't start on the first day of school. Dana Susskind again. address education as it should be in a scientific and biological way, right, because learning begins at day one, that we're never going to move the needle. We're remedial rather than preventative. And that's the larger issue. A larger issue, of course, requires a larger effort. It requires that rather than simply worrying about the success of your kids or my kids, we might do better to think about a new collective effort
Starting point is 00:42:27 to change our expectations of what it means to be a society that truly values learning. This would require a lot of work, perhaps even a lot of sacrifice. Dana Suskind has three kids of her own, 18, 16, and 13 years old. Her book, 30 Million Words, ends with a terrible story, something that happened several years ago at Lake Michigan. Our three children, she writes, were playing in the sand, watched over by my husband, their father, Don Liu. As he stood at the shoreline, he suddenly noticed, in the turbulent, chaotic distance,
Starting point is 00:43:07 two young boys struggling in the raging waters. He started running into the lake as our younger daughter cried out, Dad, don't go! They were the last words she ever said to her father. The two boys got back alive. My husband, always fearless when it came to helping others, died, overwhelmed by the torrential pounding of the waves and the gripping undertow.
Starting point is 00:43:36 Now, your husband was a pediatrician as well, correct? He was a pediatric surgeon. So he did actually mostly minimally invasive surgery. So with little portholes, he was a spectacular surgeon. And he said it's because he was really great at video games. You're making an argument against yourself now, you understand. We'd be next to each other at night and he'd be playing video games and I'd be writing a paper. But then he always made everything look easy. So, you know, he'd be the one who got the grants and, you know. So, yeah, no, he was just awesome. I don't know if you actually got to the end of the book, but he is the epilogue. And for me, I included him both, you know, so he could continue on this journey as well as to really, you know, he's sort of a metaphor for what we need to be thinking about in this country,
Starting point is 00:44:29 that every child in this country is our own and we should want for them what we want for our own children. Coming up next time on Freakonomics Radio, have you ever noticed that any project that anybody has ever tried to finish, from a kitchen renovation to a huge infrastructure project, takes way longer than planned and costs way more? There is a phrase for that. So the planning fallacy is a tendency to underestimate the time it will take to complete a project. The planning fallacy involves the optimism bias. I think it's a wonderful thing.
Starting point is 00:45:15 It involves overconfidence. We are overconfident for many, many reasons. And it'll break your heart. Me? No. I have no expectation or desire to live that long. And oh yeah, we'll tell you how to beat it. That's next time on Freakonomics Radio. Freakonomics Radio is produced by WNYC Studios and Dubnir Productions. This episode was produced by Greg Rosalski. Our staff also includes Allison Hockenberry,
Starting point is 00:45:49 Stephanie Tam, Max Miller, Merritt Jacob, Vera Carruthers, Harry Huggins, and Brian Gutierrez. You can subscribe to Freakonomics Radio on Apple Podcasts or any number of podcast portals. You should also check out our archive at freakonomics.com, where you can stream or download every episode we've ever made. You can also read the transcripts there and find links to the underlying research. Our show can also be heard
Starting point is 00:46:09 on NPR stations across the country. Check your local station for the schedule. We can also be heard on Sirius XM, Spotify, even your better airlines. And we can be found on Twitter, Facebook, LinkedIn, or via email at radio at Freakonomics.com. Thanks for listening.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.