Freakonomics Radio - 54. How Is a Bad Radio Station Like Our Public-School System? (Encore)

Episode Date: December 21, 2011

The thrill of customization, via Pandora and a radical new teaching method

Hey, everybody. Happy Christmas, Kwanzaa, and thanks for downloading the Freakonomics Radio podcast. Our last episode was about weird recycling, that is, reusing stuff that most people didn't think was reusable. Well, today, we're taking our own advice. This episode is an encore of a show we did a while back, which we thought was worth updating. Hope you agree. Good God.

Anything but this song. Alright, here we go. Hey, give me, give me, give me all your dog food. Oy vey. You've been there. It's impossible to find a decent song on the radio. Then when you do and it ends, the next song stinks. Wouldn't it be nice if the radio only played the songs you want to hear?

I mean, the rest of the world has figured it out. Amazon does it. Netflix does it. Your airline does it. Even your credit card company. Just go buy some baby diapers and see how long it takes before someone mails you a prospectus for a college savings plan. If your personal data is like a fingerprint, then you have left big, greasy smudges all over the universe. The key is an algorithm, a formula to harness that data and

customize the world for you, to give you the things you need to make you smarter, richer, happier, to give you only the songs you want to sing. Now, there's actually a solution to this radio problem. And it's so easy that even Steve Levitt can use it. About three years ago on our blog, on the Freakonomics blog, I admitted to people that I'm a Luddite and that I don't know anything about technology. And I asked our blog readers, tell me what cutting-edge technologies I should adopt in my life. Okay, I got a lot of suggestions. And I think the only

one that stuck with me was Pandora. Levitt's my co-author, an economist at the University of Chicago. And it was absolutely stunning to me that there was a technology where you could tell it the music you liked, and then it would play other music you had never heard of but would like, and it would do it all for free. And if you didn't like a song, you say, don't play that song ever again, and it would just go away. I mean, what an incredible invention that was. Now, if you had never gotten on Pandora and you were just starting today, what's a song that you would say, God, this is the song I love and I want a hundred more like it,

but I don't know where to find them? What's the song you'd put in today? So if I had to put in a song today, I would put in a very obscure song by a group called Igloo and Hartley called In This City. Okay, so to start things off, we'll play a song that exemplifies the musical style of Igloo and Hartley, which features basic rock song structures,

call-and-answer vocal harmony, also known as antiphony, major key tonality, and a vocal-centric aesthetic and acoustic rhythm guitar. So that's what you like. Actually, I love all of those things. So the next time someone asks you, Steve Levitt, what kind of music do you like? I love, actually, I love all of those things. So the next time someone asks you, Steve Levitt, what kind of music

do you like? I'm going to say I like Antiphony. And I found that brown hair in this city that I won't disappear

in this city. From WNYC and APM American Public Media, this is Freakonomics Radio. Today, the thrill of customization. And a question, what does a bad radio station have in common with the public school system? Here's your host, Stephen Dubner. Round up, round here in this city.

Then I won't disappear in this city, then I won't disappear in this city. Imagine you fell asleep 150 years ago and you woke up today. There aren't many things that you'd recognize, but one of them is a classroom. One teacher in a box with 25 students. Now, why hasn't that changed? A while back, I put that question to Joel Klein, who at the time was chancellor of the New York City public school system. In a prior life, I used to represent the American Psychiatric Association, and it was during an era which there were a lot of light bulb jokes, and most of you are probably too young to remember this era. But my favorite light bulb joke ever was, how many psychiatrists does it take to change a light bulb? And the answer is only one, but the light bulb really has to want to change. And the answer to your question is, the school system does not want to change. It wants more resources. Grades are up. Graduation rates are up. But when you look across

the board in New York City, when you look at the absolute numbers, not relative to where they were, but absolute, you can't be too happy yet. You're graduating about 59% of students now, so that's still about 10% below national average. I hope I'm right on that. So what's the problem? Are New York City kids dumb? Are the teachers who come here not good enough? There's a lot of questions there. So let me start with, for example, on the graduation rates. If you count August graduates, which I think we should count, we're at 63 percent, still below where we need to be. But quite frankly, in the last four years alone, that's gone up about three points a year. And that's huge. No other city, I think, has seen that kind of gain. But in the end, two things that one has to be candid. Look at it in America generally.

In America generally, as you said, about 70% graduate high school, so 30% don't graduate high school. Out of the 70% who graduate, probably 30, 35% of them are not prepared for college. So what's the point? The problem isn't only New York City, of course. The national dropout rate has been declining, but still nearly three out of ten kids never finish high school. Test scores have essentially been flat for a couple of decades. Other countries are passing us by. I asked Arne Duncan, the U.S. Secretary of Education, how big a concern these numbers are. This is a huge deal, Steve.

We're very concerned that if we're going to remain economically competitive as a country, if we're going to give our children a chance to compete in a global economy, we have to dramatically improve the model of education in which everyone was treated the same. And the teachers that you remember, the flip side of that, the best teachers are the ones that absolutely understand who you are, who find skills in you and abilities that you didn't even realize you had in yourself. And those teachers where it doesn't work, those teachers that are just relating to a mass of faces in front of them. They don't know you as an individual. You get the sense, accurate or not, that they don't really care about you, quite frankly. So that's how a classroom is like the radio. It's a factory model, a big fat effort to pitch right down the middle. Isn't it time to change the classroom model? I mean, people have been talking about education reform forever. And lately, things are changing. There's a proliferation of charter schools,

some of them excellent, the Teach for America program, parenting workshops and preschool programs. And in New York City, a small band of reformers has been pushing a gutsy program with a catchy name. It's called School of One. They want to dump the factory model altogether. Secretary Duncan is wild about School of One, and Joel Klein is the man who gave it the go-ahead. Here is the program's founder, Joel Rose. So in New York City, even before the recession, we had six applicants for every teacher that we hired. We have worked incredibly hard to ensure that our highest performing teachers are rewarded for the work that they do. And we can tell you on a relative basis who our stronger teachers are and who our weaker teachers are. But one of the things that

I was interested in is looking at that information on an objective basis. In other words, if we picked a particular standard, like what percent of eighth grade math teachers in New York City get 80% of their students to proficiency by the end of the year? That number came in at 13%. 13%. Right. And when we ask the question a little differently, what percent of eighth grade math teachers can get one year's worth of growth out of 80% of the students in the class that came in at 12%? Yikes. How about reading? In reading, the numbers are about half that.

Half that? Right. Now, we have some incredibly talented and hardworking teachers in New York City, and there are thousands of students who graduate college that would love to move to the city and work here. This is not an issue of recruitment or even of talent. It's an issue of design. I mean if you think about any other industry, if we created an objective standard of success and only 13% of a particular classification of employee was successful, we would change the job. We have never had that conversation in education. or presidents performed at the level, the objective level that New York City teachers did, we'd either get rid of all of them or radically change the job. If we set the bar at how successful do we need plumbers to be, and that standard is

a reasonable objective standard, and only 13% of plumbers can actually hit that standard, then we have to think differently about how we're organizing the work of plumbing. How should the work of teaching be organized? Rose started out as a classroom teacher, three years in a fifth grade in Houston through Teach for America. He went to law school, then got back into education with Edison Learning, the for-profit schools company, and eventually he landed in New York City's Department of Education. That's when he had a revelation. Even the most talented teachers in New York were operating in the old 25 kids in a box factory mode. How well can one person possibly teach math to 25 different brains at the same time?

So I am originally from South Florida and I was visiting my family in Miami and went to go see a friend who runs something called a New Horizons Learning Center. This is a franchise that provides technical training to people on a particular area of technology. So if you want to get certified in something from Microsoft or Cisco or something like that, you go to one of these centers. You take a class. You take a test. You get a certificate, and you can use that to get a job. And so I went to meet him for lunch, and I walk into the the office and there's a big sign right when you walk in and it says, choose your modality. Choose your modality.

Choose your modality. And what's that mean? That a student can choose to come and their own pace at home online or they can do what New Horizons calls mentored learning, which is a student can come in whenever they'd like and there is a teaching assistant type person that can help them as they work through the software. So I can eat in, take out, or have delivery food. Exactly. And did you – did a gigantic light bulb flash off in your head? A gigantic light bulb flashed off in my head. What I immediately saw when I saw that sign was that is what we've been looking for in K-12 education. The introduction of other modalities. That live teacher-led

instruction. The kind of instruction we're all familiar with, that we all grew up with, is one way. It may be the best way, but it's not the only way the kids can learn. Ah, don't touch that dial. Listen to... Coming up, one teacher in a box versus one algorithm for as many kids as you want. I can see how many lessons they've had on each skill. I can see how fast they're moving through those skills. And we meet the man behind Pandora.

It's a hard world. It's a holy dog. Give me, give me, give me a holy dog. It's a holy dog. From WNYC and APM American Public Media, this is Freakonomics Radio. Here's your host, Stephen Dubner. So Joel Rose thought, what if instead of all 25 kids in a classroom trying to learn math from one teacher in one modality at a time. What if you could take the classroom and divide it into smaller groups and have each kid get her own playlist of different modalities every day, kind of like the playlists that Pandora makes for Steve Levitt?

With Klein's blessing, School of One quickly moved into pilot phase. In early 2010, it began as an after-school program in three New York City schools, teaching sixth grade math to 270 students. I visited one of those schools, IS339 in the Bronx, and I met Kirsten Shai from School of One. Kirsten Shai, So what we see here on the screen, the first thing when a student walks in, they see their schedule for the day. So right now it shows period one. Kids are divided up by their homeroom teams, and they can see which area of the room they're supposed to be. So at this table, they're doing more virtual tutoring.

At the far table over there, there's kids who are working on a variety of different online math programs. And at this closer table, there's kids who are working on independent practice. It's another modality that we have. Can you quickly name all the modalities for me? Ooh, quiz me. Large live instruction, small live instruction, virtual live instruction, which we call virtual tutoring colloquially, independent practice, small group collaboration,

and independent virtual instruction. So these guys are doing math homework with headphones at a computer, and there's somebody on the other line. And who is that person, and what are they teaching them? The other person on the line is a virtual tutor. I'm not sure exactly where they are presently in the United States right now. And they're working on the individual skills that they need to be working on, so it could be any number of 5th or 6th grade math skills that a kid needs at that time.

I'm talking to the teacher and doing his work. He told us to add any number with 2 in it. Now your question is, add 3 to any number. Add 3 to any number? 3 plus 40. I mean, suppose you wrote any number as 40. I can write it as 35. Small group instruction?

Independent practice? A virtual tutor? It's not what these kids are used to. Here's Petrona Hudson, 12 years old. I was failing math because I didn't understand it. Nobody sat down with me and helped me work. My teacher, she'll explain it once, and if you don't understand it, she'll quit. She'll be like, oh, I give up, too bad.

My name's Lionel, and I'm 11. Lionel, okay. And what are you doing here in the School of One? Math. Now, what about the kids who are in your class in math who don't come to School of One? Do you feel like you're brushing past them? Yes, because I'm learning a lot more than what they're learning. They're probably home playing video games.

Lionel, Patrona, middle school math, every lesson, every quiz, every keystroke, it's all fed into the school of one algorithm. At the end of every day, each kid takes a test. Now the algorithm can learn what the kid learned today, which lessons stuck, which topics need more attention, how each kid learns the best. Every day, as the kid gets a little bit smarter, the algorithm does too.

Far from IS-339 in the Bronx, all the way down in lower Manhattan in the old Tweed Courthouse, the school of one team sits in a big open room. There are laptops, whiteboards on wheels, the standard intensity of a startup. Chris Rush is a co-founder of the project. If Joel Rose is the education theory guy for School of One, Rush is the tech savant. In some ways, he's the algorithm. He's sitting in front of two computer screens. So what I'm doing is I'm looking at the results from the entire week. And I have a grid here that has every student and has every skill that they could be learning, a skill such as adding fractions

or circumference of a circle. And I can see how many lessons they've had on each skill. I can see how fast they're moving through those skills. So what I'm monitoring is I'm looking for skills where kids are getting stuck so that we can target those to improve the program around adding fractions or circumference of a circle. And I can also make sure that any kids that are getting stuck get the proper attention they need. So I tally how fast kids are moving through the skills, and we give them a rating, sort of like par in golf. So if they're beating par, the average, or if they're ahead of it, and we take the kids that are falling behind, and we say, what's happening here? How can we do something better for them and upgrade our algorithm and pull them out to make sure they're

getting the proper attention? Okay, so we talked to a pretty enthusiastic boy named Lionel who was happy to be in the program, was so happy that he was telling his friends they should stop going home after school and playing video games and instead come here and play math computer games. He said he successfully recruited one or two kids. So let's look at Lionel. Tell us what he's been doing, how he's doing, what direction he's moving in. Okay, so I'm going to pull up Lionel here. And what I really see, Lionel is one of those great case studies, actually. The nice story about Lionel is that Lionel was really struggling in the month of March. He was taking him 10 exposures, 12 exposures to learn certain skills.

And now Lionel's moving through things with two exposures, three exposures. That's really exciting. That's what we want to see, not just learning the skills, but he's learning how to learn skills faster. We have one skill here that's on hold because Lionel needs to come back to it. And that's dealing with, this particular skill happens to be dealing with algebraic expressions. And that seems to be where he's having more trouble, where geometry seems to be something that he's doing much better in. So what do you do with that information? Where does that steer you to steer him, to help steer him? So we'd look

a little more closely. Is it geometry that he's doing well with, or is it the way that we were teaching him geometry? And in this particular case, it actually looks like we were teaching him geometry a bit differently than we were teaching him how to deal with algebraic expressions. So the first thing we would do is try to take the methods that we taught him geometry and apply them to him learning algebraic expressions. So the idea, I'm guessing, is that you will find out what approach works best for each kid, and that you will end up with a manageable mix. Because if everybody needs the live teacher instruction, then you're back to 28 kids in a box, yeah? Correct. It's very much like the Pandora Music Service online,

where you enter in a song name or an artist, and it tries to guess the next best song for you. And maybe it guesses right the first time, but by the two or three songs in, basically it works the same way here. If a student tries small group collaboration and they don't do well that day, we give that a thumbs down. If they do small group collaboration and they do well, we give it a thumbs up. So we can rate our schedules every day for each student, so we get smarter and smarter at choosing the next day's schedule for each student. Okay, Tim, so you've let me hijack your Pandora account.

So we're listening to the Pandora account of the Pandora guy. And we're on Ben Folds Radio. That's your station here. That's the heart of my genome. Is that right? Yeah, yeah. I dig all that stuff. 6 a.m.

Day after Christmas I throw some clothes on in the dark The smell of coal Car seat is freezing The world is sleeping, I am gone. Tim Westergren is the founder of Pandora. It is built on what he calls the Music Genome Project, whereby a bunch of musician analysts painstakingly break down each song

into hundreds of qualities, from rhythmic patterns to guitar style to antiphony. In the summer of 2011, the company went public and was capitalized at nearly $3 billion. Pandora's database now contains nearly a million songs by 100,000 artists. It has more than 100 million registered users. That's right. It's grown like a weed. Wow. So more people are Pandora listeners than are, let's say, users of Reynolds Wrap, probably.

That's not the first correlation I would have thought of, but that may be true. So what Pandora does is you customize a radio station for anyone who asks you, or as many radio stations as they want. So do you feel a bit like we've entered a new world where essentially everything is customizable? Yeah, I think that's basically true. I think what the web did at first was made everything available. That was kind of the first phase, I think, of the web. And the second phase is to kind of repair that and make all that stuff that's sort of so voluminous

actually navigable. And I think that's where Pandora sits. You know, we look at music and say, you've got this sort of tyranny of choice on the web. It's like walking into a record store and you've got 80,000 CDs to choose from and you need to figure out where to start. We're trying to do that with music. And the Music Genome Project's sort of purpose is to make that easy for someone. Our public schools are longing for a tyranny of choice, the misery that comes from having too many options.

Is School of One the answer? That's impossible to say. So far, the early returns look good. Here's Joel Rose again. Before the program began, every student took a pre-test that was aligned to the skills on their playlist. The average score was 42%. Before the program began, every student took a pretest that was aligned to the skills on their playlist. The average score was 42%.

The end of the program, roughly 50 to 60 hours of instruction later, they took a posttest on the same skills. Posttest scores averaged 70%. We asked the DOE research and policy team, is that good? Is that not good? How do we contextualize that? They did an analysis and found that these gains were, depending on what we consider a control, four to eight times the gains we would see in traditional schools in roughly a third of the time. There will be fortunes made and maybe lost. There will be competition among technology vendors and content providers and a million others. There will be turf wars with teachers unions.

Would School of One require fewer teachers or maybe more? Less money or more? Joel Rose says it's simply too early to answer these questions. What we do know is that a future with something like School of One will be different, very different. Technology, instead of being discouraged in schools, would move to the head of the class. Teachers would have to be trained differently. Here's Blair Heiser, the math department chair at IS339 and a teacher at School of One. The fear of School of One is just that students might get lost

given that there isn't that traditional 25 kids, one teacher, that teacher works with those students every day. And so I think that's the one hesitation or fear is it's different, it's new, it's something that hasn't really happened before. And that's, you know, as a teacher, if you've taught 15 years or 20 years in one way, it's very challenging and, you know, kind of think outside the box in terms of your instruction. Arne Duncan, the Secretary of Education, thinks that most of what's happened in the past isn't really worth hanging on to. I think our Department of Education has been part of the problem historically. I've been very honest about that.

And as hard as we're pushing everybody else to move outside their comfort zone and do more, I promise you we're trying to be very self-critical, look ourselves in the mirror every single day. And historically, we've been this compliance-driven big bureaucracy. And we are fundamentally trying to change what we do from being this big bureaucracy to being this engine of innovation and scaling up what works. Instruction already is changing. Across the country, there's been a big spike in students enrolled in full-time virtual schools. The Khan Academy, with its simple do-it-yourself video lectures, has started distributing its material to school systems. And since we first talked to Joel Rose, there have been big changes at School of One. He left the project to start a new nonprofit organization that hopes to take the mixed modality model national.

But let's not get too excited. A lot of experiments look good in the lab. New York City alone has 1.1 million schoolchildren. Can they really be taught one at a time? Can an algorithm, a playlist, help teachers do their jobs better? Can that algorithm really help a kid like Lionel find his own music? The odds seem long, but just think how long the odds might have seemed 10 years ago, flailing around the radio dial, hoping to find just the right song.

Have you heard from anyone for whom Pandora really changed the shape of their life in some way? Maybe it resulted in a courtship and a marriage, a divorce, a murder? We had someone whose father was ill or was aging and was in a home, kind of reaching the end of his life. And in the last few months, they discovered Pandora and they shared it with him and he really took to it. And so when they visited him every day, he would listen to Pandora all day long and it became kind of a real companion. And he eventually passed away, but he passed away listening to Pandora. And because, you know, when you die,

you're given a time of death, the family wrote us to thank us and told us the time of death and we actually wrote them and told them which song was playing when he died. And we sent them a CD, and they played that song at his funeral. Thank you. This episode was produced by Colin Campbell and Amy Machado. Our staff includes Susie Lechtenberg, Diana Nguyen, Catherine Wells, Beret Lam, and Chris Bannon. This episode was mixed by Michael Raphael and John DeLore.

Special thanks to Jacob Berman. If you want more Freakonomics Radio, subscribe to our podcast on iTunes and go to Freakonomics.com, where you'll find lots of radio, a blog, the books, and more.