Stuff You Should Know - What's the Pygmalion Effect?

Episode Date: February 8, 2024

Do teachers and managers give special treatment to those who they're told have great academic or professional promise? Does this create a self-fulfilling prophecy, regardless of the truth? That's just... part of the fascinating Pygmalion Effect.See omnystudio.com/listener for privacy information.

Transcript
Discussion (0)
Starting point is 00:00:00 Maybe you've stayed in an Airbnb before and thought to yourself, hmm, this seems pretty doable. Maybe my place could be an Airbnb. That's right. It could be as simple as starting with a spare room or your whole place when you're away, but the point is you could be sitting on an Airbnb and not even know it. Yeah, maybe a music festival or some big tournament is coming to town and you want to get out of town.
Starting point is 00:00:23 Well, you could Airbnb your home and make some extra money. That's right. Or listen to this, what have you got a vacation plan for this summer? When you're away, your home could be an Airbnb. Yep, whether you could use a little extra money to cover some bills or for something a little more fun, your home might be worth more than you think. Find out how much at airbnb.ca slash host. Get ready for our 2024 I hard podcast awards presented by the Hartford live at South by Southwest March 11th will honor the very best in podcasting from the past year and celebrate the most innovative talent and creators in the industry and you'll help decide who wins podcast of the year. Nominees include Crime Junkies, The Daily, My Favorite Murder, New Heights, Normal Gossip, On Purpose with Jay Shetty, The Retrievals, Scamanda, Smartless,
Starting point is 00:01:13 and Wiser Than Me, vote now at iHeartPodcastAwards.com. The Hartford Small Business Insurance is the presenting partner of the 2024 iHeart Podcast Awards live at South by Southwest. To learn more or start a quote, visit thehardford.com slash small business. With insurance designed for your small business, the bucks got your back. Welcome to Stuff You Should Know,
Starting point is 00:01:36 a production of I Heart Radio. Hey, and welcome to the podcast. I'm Josh, and there's Chuck and Jerry's lingering too. She's a lurker, and this is stuff you should know. The Education Edition. Yeah, I'm pretty excited about this after learning more about it. Yeah, this is your pick. Where'd you come up with this?
Starting point is 00:02:00 I don't know. Well, that's good. I was hoping that it wasn't like, well, I had a really bad experience with a teacher when I was a kid. No, I had always good experiences generally, but now I'm worried that it was a listener, because I've gotten a few of those lately, like, hey, when you said you didn't know, it was me. Oh, no.
Starting point is 00:02:20 I usually make a note, but... Sure, sure. I don't know. Well, if you suggest to the Pygmalion effect, you're probably the only one and you can feel free to email and be like, hey, you said you didn't know it was me. Yeah. Well, we're talking about the Pygmalion effect
Starting point is 00:02:36 and it does have to do with education, but it has to do with, you know, more than that too. And for those of you who don't know, the Pygmalion effect is a kind of self-fulfilling prophecy. It's called an expectancy bias, I believe. And it basically says in effect that if you have high expectations for say a student or an employee or something, they're likely to perform better
Starting point is 00:03:01 than other people. And it has something to do in all sorts of different ways, it turns out, from that relationship, that high expectation. And it's pretty neat if you think about it. And Pygmalion, it's named after, I guess, an Ovid metamorphosis story, right? Yeah, I think it was, I believe it was a statue? Isn't that right?
Starting point is 00:03:26 I think Pygmalion was the sculptor and the statue is Galatea. Okay, I knew it from, you know, because I'm not the art major. Well, I'm not either. I was the English major. So, I read George Bernard Shaw's play Py Pigmalion, in college in a class. And then of course, the My Fair Lady was based on Pigmalion, in which I think her name was Liza Doolittle, sort of, hey, let's take this rough around the edges, young woman, and make her into a fair lady.
Starting point is 00:03:59 I knew it as trading places. Exactly. But that, you know, sort of a classic story. The original play is great. And it all has to do, like you said, with this sort of self, this idea of the self-fulfilling prophecy which had been around for a long, long time. But in the 1960s, of course, when psychology and doing studies on all kinds of things was really blossoming and just sort of exploding in all directions.
Starting point is 00:04:26 Super hip. Those, well, I don't know about that, but maybe in those communities. But there was a psychologist named Robert Rosenthal who got pretty interested in this idea of how bias can affect something like performance or assumptions or thinking like, it moved out of the classroom, but initially like, hey, this kid has promised
Starting point is 00:04:50 or this kid does it and then they end up being like that. Yeah, yeah, for sure. And there's a lot of implications obviously of, okay, well then does that mean that there's kids who are not performing as well as they could because they're not being treated well by their teachers. Like there's a lot. And I think one of the things that I like about this
Starting point is 00:05:09 is that just how much debate and research and argument has gone into just this one segment of approaching education really just goes to show how seriously we take education or have at least in the past. Yeah, I think so. I mean, that certainly doesn't mean we figured it out, but I think people have long studied and tried
Starting point is 00:05:32 and argued and debated on the best way to help kids reach their potential, and that's a good thing. So there was a sociologist named Robert Merton, and he turns out to have been the person who coined the term self-fulfilling prophecy. I hope he copyrighted it because I owe him some money, just me. Anyway, that was back in 1948 and even by then, that was a good almost 50 years after experimental data started coming in that showed self-fulfilling prophecies existed. So I guess our kind of hero, or at least protagonist,
Starting point is 00:06:07 antagonist, I guess it depends on how you look at him, Robert Rosenthal. In the 60s, he hit upon a pretty great study idea along with a colleague of his named Kermit Fode, which is a great name. In writing out loud, blinked out in Morse code. It's a great name all across the board. But working together back in 1963, they took on running rats through mazes, which was already like just so cliche back then, that it was like a perfect thing to experiment on because
Starting point is 00:06:39 it was like the people that they were actually experimenting on, the students who were running the research were the ones who were being experimented on, the students who were running the research were the ones who were being experimented on, but the rats and mazes was just so ubiquitous, they didn't question that at all. It didn't even occur to them that they would be being experimented on. Yeah, and they ended up coming up
Starting point is 00:06:57 what I think should be just these words on a T-shirt and just don't even explain it, because what they told experimenters that were working with these rats, they said, all right, you got some really great rats in this group and they were bred to be maize bright, but those other ones, they're maize dull. And I just think that would be fun on a t-shirt,
Starting point is 00:07:19 but actually these rats were assigned randomly, but what they found out was that the dull rats, the maize-dull ones hit their peak performance three days in and then started to go downhill where these really bred to be maize-bright rats just kept on improving. And so the conclusion was, I think these students are getting these rats
Starting point is 00:07:42 that are maize-bright and are just, you know, hey, little buddy, you know, hey, little buddy, you can do it. I know you got it in you. You're a smart rat. Like they're handling the better. They're talking them up. They're encouraging them and it's working.
Starting point is 00:07:52 Yeah. Because, I mean, again, you said that they were assigned randomly and there was no such thing as maze bright or maze dull rats. They were all just the same. So they had to have something to do with the researchers because there was no difference between any of the rats that were assigned. I think in the worst, the worst interpretation is you could also suggest that the Maze bright rat
Starting point is 00:08:16 student experimenters could even have been fudging the numbers a little bit to meet their expectations consciously or not. But it's a possibility. could even have been fudging the numbers a little bit to meet their expectations. I didn't want to say it. Consciously or not. But it's a possibility. Sure. And actually that kind of led to one kind of branch of study that came out of that Maze Bright Maze Dole rat experiment. How much expectancy bias affects researchers in scientific studies. That was the first leap that it
Starting point is 00:08:45 went to. But shortly after that it ended up in the classroom because a principle of spruce school in elementary in San Francisco read about this rat experiment. I think it was an American scientist in 1963-ish and the principal Lenore Jacobson wrote to Robert Rosenthal and said, hey, if you ever want to replace like rats in experimenters with students and teachers, I'm your person. And very quickly, Rosenthal took Lenore Jacobson up on that. Yeah, by very quickly, I guess in science terms, a couple of years later. Right.
Starting point is 00:09:21 And they said, all right, you right, we don't know it now, but this is gonna end up being a very, very famous experiment called the Pygmalion experiment. And again, named for the art and the play, and what else was it? Trading places. Trading places, that's right. I keep wanting to say 48 hours, but that's not it at all.
Starting point is 00:09:43 Yeah, but actually,, that came afterwards. So, you know what I mean? Sure. Great movie though. Which one? Trading Places, I love it. Okay, I've never seen 48 hours. Oh, really?
Starting point is 00:09:55 Yeah. It's a good one. Okay, so which one's better, Trading Places or 48 hours? Well, I mean, they're both kind of great. One is just more of a straight up comedy, which is Trading Places. Sure. 48 hours was sort of I mean, they're both kind of great. One is just more of a straight up comedy, which is Trading Places. Sure. 48 hours was sort of in that cop buddy movie action thing,
Starting point is 00:10:11 but also has laughs. Yeah, for sure. But you know, it's a prime Eddie Murphy. Okay. That sounds like more of a trading spaces person to me. Trading Places. Trading Places. That's a HDTV show.
Starting point is 00:10:24 Yeah, totally is. So boy, that was a good sidetrack. Eddie Murphy's got a new Beverly Hills cop coming out, by the way. Oh yeah, that's right. I wonder how that's going to be. I wonder too. I don't feel like he's aging poorly. He doesn't seem to be getting less funny over time, although I haven't seen any of his stuff
Starting point is 00:10:41 very recently. We'll see. I haven't either. Okay. I'm reserving my opinion to live. All recently. We'll see. I haven't either. I'm reserving my opinion to live. All right. That's fair. All right. So Spruce School, San Francisco, it was performed on these kids, a white majority, a Mexican-American
Starting point is 00:10:55 minority, but mostly working class kids. This wasn't some like, when I first heard Spruce School, I thought it was some like super whitey-twitty private school. I did too. Sounds like it. It sure does, doesn't it? Especially in San Francisco. But one more thing very crucially about this school,
Starting point is 00:11:08 the kids were grouped by reading ability. So if you weren't a very good reader, you were in a group or a class with other kids who weren't a very good reader and so on and so forth. Yeah, and we're gonna talk a lot about grouping because it's not a great thing to do, as it turns out, and it's got a lot to do with a lot of this. For sure.
Starting point is 00:11:25 So, students at the school, they were given a test, and the researchers told these teachers, and as we'll crucially find out too, this test was not given by the researchers, they were given by the teachers, correct? Yes. So that's gonna come into play as well. But they told the teachers, said,
Starting point is 00:11:42 all right, we've got these results. You've got some bloomers or quote, unquote, growth spurters in your class. And they're probably just like these maze bright rats. They're like, they're going to really improve over the school year. Just you watch. We gave him this test. It was the Harvard's test of inflected acquisition. And it's supposed to assess their potential, which was not true at all. What they actually took was an IQ test called Toga, Flanagan's test of general ability. And there were some problems with that right off the bat, right with this Toga test. So one thing Chuck about that test of inflected acquisition, it
Starting point is 00:12:23 didn't exist. They just, they made it up so that teachers, if they were possibly familiar with the test of general ability, they wouldn't be like, wait, this isn't what you would use to find growth spurs or bloomers. They just made up a test because this was a made up, the results were supposed to be made up too. Again, the teachers thought that they were administering a test
Starting point is 00:12:46 and that the results were real world, but they were being lied to. They were being manipulated in the exact same way those students were told that some of their rats were Maze Bright or Maze Dull. Exact same experiment just with humans now. Yeah, because the idea is to see if teachers think that a kid is supposed to have a growth spurt intellectually, then that will end up being the self-fulfilling prophecy. So these students were chosen at random, the teachers were given that information and after months and months they took this test again, the Toga test, at the eight month mark, the one-year mark and the two-year mark.
Starting point is 00:13:22 again, the Toga test at the eight month mark, the one year mark and the two year mark. Yeah, and so just as Rosenthal predicted in his hypothesis, I should say Rosenthal and Jacobson, the principal, the people who had been, or the kids who had been identified as growth spurters or bloomers actually did bloom academically. They gained all sorts of IQ points over the course of the eight months and then year and then two years when they took and retook the test.
Starting point is 00:13:49 And that even though the effects were mostly pronounced among first and second graders, that was enough. That was enough to just kind of show like this is a real deal. These kids were no different than the other kids. The only difference was that these bloomers were the ones whose teachers were told, keep an eye on them because they're going to be amazing kids. Yeah. And what's interesting is for the, I think the third, fifth, and sixth graders, they showed that they actually improved at the same rate.
Starting point is 00:14:19 The bloomers did, the ones who were assigned that tag at least, at the same rate or slightly, even slower rate or lower rate than control group. And the researchers, Rosenthal basically said, well, that's because when you're younger, your mind is more malleable. And so that's probably it. And also, because the school and these teachers probably, you know, think that their reputation with school, then these teachers probably, you know, think that their reputation wasn't, like, they may have felt bad for these kids who weren't, who didn't get the Bloomer tag.
Starting point is 00:14:51 So they may have, like, paid more attention to them or something. Right, or the younger kids hadn't been at school long enough to establish like, hey, I'm actually not that smart or hey, I'm actually really bright. So their reputation wasn't established. No big man on campus label had been applied yet. Yeah, so if you're starting to sense like,
Starting point is 00:15:12 oh, wait a minute, then he just immediately sort of explained away something that didn't agree with his finding. You will see that that kind of becomes part of the story. Right, so they published a study in 1968 called Pygmalalion in the classroom. And again, they named it after Pigmalion because in that story from Ovid, the sculptor Pigmalion sculpts a beautiful woman, falls in love with her,
Starting point is 00:15:36 and loves the statue so much that the goddess Venus says, I'm going to make you a real live person. So the attention that Pigmion paid to Gallatea, his statue, created a magical transformation in his statue from statue to human. There was some sort of magical intervention. So it actually is a really great, great name. And I can't think that that didn't have something to do
Starting point is 00:16:01 with how much it exploded onto the scene because it's really difficult to understate what just a bomb this dropped. Not just in academia, but in popular culture. It got picked up and talked about for years afterward. That sounds like a great place to break, eh? I thought you might say that. No, right. Well, let's take a break and we'll be right back and talk about this explosion
Starting point is 00:16:24 of understanding right after this. Get ready for our 2024 I Hard Podcast Awards presented the Hartford, live at South by Southwest. March 11th will honor the very best in podcasting from the past year and celebrate the most innovative talent and creators in the industry. And you'll help decide who wins podcast of the year. Nominees include Crime Junkies, The Daily, My Favorite Murder, New Heights, Normal Gossip,
Starting point is 00:17:01 On Purpose with Jay Shetty, The Retrievals, Scamanda, Smartless, and Wiser Than Me, vote now at iHeartPodcastAwards.com. The Hartford Small Business Insurance is the presenting partner of the 2024 iHeart Podcast Awards live at South by Southwest. To learn more or start a quote, visit the Hartford.com slash Small Business.
Starting point is 00:17:20 With insurance designed for your small business, the bucks got your back. Hey, this is Dana Sports. you may know my voice from noble blood Haley would or stealing Superman, I'm hosting a new podcast and recalling it very special episodes. One week will be on the case with special agents from NASA as they crack down on black market moon rocks. H Ross pros on the other side and he goes,
Starting point is 00:17:45 Hello, Joe. How can I help you? I said, Mr. Perot, what we need is $5 million to get back a moon rock. Another week, we'll unravel a 90s Hollywood mystery. It sounds like it should be the next season of True Detective or something. These Canadian cops trying to solve this 25-year-old mystery of who spiked the Chowder on the Titanic set.
Starting point is 00:18:04 A very special episode is stranger than fiction. It's normal people plop down in extraordinary circumstances. It's a story where you say this should be a movie. Listen to very special episodes on the I heart radio out Apple podcasts or wherever you get your. Hi, I'm Susie Esmond and I am Jeff Garland yes, you are and we are the hosts of the history of curb your enthusiasm
Starting point is 00:18:31 podcast we're going to watch every single episode it's a hundred and twenty two including the pilot and we're going to break them down by the way most of these episodes I have not seen for 20 years. Yeah, me too we're going to have guest stars and people that are very important to the show, like Larry David. I did once try and stop a woman who was about to get hit by a car. I screamed out, watch out!
Starting point is 00:18:51 And she said, don't you tell me what to do! And Cheryl Hines. Why can't you just lighten up and have a good time? And Richard Lewis. How am I gonna tell him I'm gonna leave now? Can you do it on the phone? Do you have to do it in person? What's the deal?
Starting point is 00:19:04 Not just on cable. You have to go in Asia. Human beings helped you. And then we're going to have behind the scenes information. Tidbits. Yes, tidbits is a great word. Anyway, we're both a wealth of knowledge about this show because we've been doing it for 23 years. So subscribe now and you could listen
Starting point is 00:19:17 to the history of Kerber enthusiasm on iHeart Radio app, Apple Podcast, or wherever you happen to get your podcasts. heart radio app, Apple Podcasts, or wherever you happen to get your podcasts. All right, so where we left off, the study was called Pigmellian in the Classroom, published in 68 as the paper, and then also, notably, as a full book. If it was just the paper, it may have just sort of been passed around through academia, but because it was a book, it became very popular,
Starting point is 00:19:58 and all of a sudden, Barbara Walters is interviewing Rosenthal, and the New York Times is got it on the front page, and the New York Times has got it on the front page. And, you know, like the mainstream media is all over this, is, you know, basically saying, and, you know, kind of like the media does with something like this, they're not digging into the data like academia will, as we'll see.
Starting point is 00:20:17 Right. But they'll run big headlines, and they'll say this is really significant, because we all knew that the way we teach our kids is wrong and this kind of proves it. Yeah. So I think that was another reason why it had such a huge effect on like the larger culture because people had been suspecting for a while that putting kids into groups by, you know, reading ability was a bad idea. It was doing a disservice to them. Now there's this paper that showed demonstrably that that was absolutely true. That was a bad idea. It was doing a disservice to him. Now there was this paper that showed demonstrably
Starting point is 00:20:46 that that was absolutely true. That was a terrible idea. And yeah, like you said, there were headlines all over the place. People were discussing it. And Rosenthal, he was basically the ringleader, the ringmaster to all this stuff. He was very much on board with not pointing out,
Starting point is 00:21:04 oh, actually you guys are missing a lot of nuance. It's not quite that cut and dry. He was like, yep, absolutely. Like exactly what you're saying, this black and white thing, where like, yes, this is absolute proof. I'm totally going to go along with that. And he got criticized just for that alone, just not, not, not intervening in how his science and findings was being communicated to the larger public. And in fact, kind of playing a role in making that happen, just kind of capitalizing on the general populations in comprehension of statistical analysis. We don't know what that is or how to do it. So we rely on scientists to explain it to us in terms we can understand or the press.
Starting point is 00:21:48 And if the scientists, as we've covered many times, Chuck, isn't forthright or honest, that stuff can get turned into all sorts of misunderstandings or overblown findings. Yeah, and one of the big things too that we should point out was that fact that we told you earlier misunderstandings or overblown findings. Yeah, and one of the big things too that we should point out was that fact that we told you earlier that
Starting point is 00:22:10 before the break that these tests really kind of showed this effect for these younger kids in first and second grade, but not for the kids in the older grades. And in fact, it showed a negative correlation sometimes in some of the older grades. They didn't even put that in the book at all. So they're already sort of cherry picking stuff the older grades and in fact it showed a negative correlation sometimes in some of the older grades. They didn't even put that in the book at all.
Starting point is 00:22:27 So they're already sort of cherry picking stuff and the book was the thing that really blew up more so than the paper. And so of course the press isn't covering that aspect of it probably because they didn't even know about it. Yeah. So there's two tracks. The popular press like the New York Times or Today Show or whatever, they're covering it in glowing terms like it's absolute proof of what everybody always suspected.
Starting point is 00:22:48 The other track was a pretty wide river of criticism coming out of the halls of academia from other psychologists of different stripes who just were teeing off on this paper. And even though it didn't necessarily capture the attention of the larger public, in academia there was a thorough debate that started right after the paper came out. It went on for a good decade and actually turned out to be really healthy, not just for Rosenthal's paper, Rosenthal and Jacobson's paper, but for, I guess, statistical analysis as a whole. But I think because Rosenthal ended up inadvertently creating the meta-analysis study. But before we get to that, Chuck, let's talk about some of the stuff that was wrong with the paper, statistically speaking.
Starting point is 00:23:39 So yeah, I mean, the Toga test we should talk about right out of the gate because this test was not supposed to be used on first graders or with kids with an IQ below 60. And that alone probably accounts for, or at least accounts for some of the fact that these low results were coming in on these kids in the younger grades. And then they would obviously gain much more ground because they've then aged into the test by their time they're taking this when they're really supposed to be.
Starting point is 00:24:11 Exactly, and there was something that, that was, Rosenthal like responded to that. It even said, hey, even if that test doesn't apply to these younger kids, the fact that the same kid has taken the same test over time, it really, it renders that moot. It's still going to show accurate results. I see what he's saying there,
Starting point is 00:24:32 but it's just moot to me because it wasn't even supposed to be given to a kid that young. Right, but also he's totally full of beans right there. He's, so the first initial findings, that first test produced such totally skewed results that as those kids aged into the test and started getting normal results
Starting point is 00:24:54 and you compared those later results to the first results, you would see all sorts of crazy gains that were completely incorrect. Like they just weren't true. That was a big part of it. That Toga test was not set up for kids with IQs under 60, which is a big problem because first graders in the United States on average had IQs of 58.
Starting point is 00:25:15 And so you can see it reflected in some of those results. Like some kid had an IQ of 18, that's almost impossible. And certainly they wouldn't be like reading at that point. Same with the kid, I think with 30. And then one of those kids later went from like 30 to like a hundred, which is coming close to maybe even gifted level. Like the results were just terrible.
Starting point is 00:25:39 And even worse than that, in the book, as an academic should, they didn't include any of the raw data either. Yeah, so that means you can't go out as another researcher and sort of try and replicate that. It just kind of occurred to me, what he was sort of saying with that initial defense was like you have a broken scale that doesn't say what your true weight is, but you can still,
Starting point is 00:26:04 it's still accurate because you can see how much weight you gain or lose by using that same scale. Right. You're like, yeah, but you still don't know how much somebody weighs. Yes, that's true. But then also the thing that makes him dishonest in that response is that imagine it's broken the first time you weigh yourself and then you fix it and you weigh yourself after that. And so those are the right results, but you're comparing them to that first broken result. It's completely useless. Why does anyone even have scales anyway?
Starting point is 00:26:34 I don't know. It doesn't make any sense. And why for God's sakes do they keep them at hotels like at the beach? I don't know, man. There was one in one of my rooms when we were on tour and this one was in San Francisco. I'm like, why are you here? Why are you here? I just glared at it a couple of times and it eased itself back under the vanity.
Starting point is 00:26:53 Oh, I mean, hey, I weigh myself to keep track of things but for God's sakes, don't weigh yourself on vacation. No, I was gonna say I do at home, but not on vacation, not even on tour. So anyway, scaled diversion aside diversion aside like you said he didn't include raw data That means you can't come along afterward and try and replicate it. So that's a big problem. Yeah other people chimed in and said things like I think Richard East knows a psychologist who said also You know apparently teachers couldn't remember.
Starting point is 00:27:25 And a lot of them reported that they even didn't really even glance at this list on who was a bloomer or not a bloomer. So it's, which is very strange. It sounds like some of these teachers didn't even fully realize or care much that they had an experiment going on. Yeah, I thought that was kind of weird too. Cause I didn't get the impression that these were anything but normal dedicated teachers, but I don't know, maybe they suspected that this was made up or that this was, maybe they
Starting point is 00:27:52 were like, there's no test that can really pick that up. So I'm not even going to pay attention to that kind of thing. Or they were busy teaching. That that could be a hit too for sure. Another one was that the teachers themselves administered the tests, the initial tests. So they weren't administered by professional child psychologists. They were administered by teachers who already had an impression of the kids they were administering the tests to, because it was the previous year's teachers. So if you were, say, in second grade, your first
Starting point is 00:28:22 grade teacher was the one who administered your tests. I didn't get that, but that was another criticism from academia. Yeah, absolutely. So people are debating this. They're starting to sort of argue positions, you know, foreign against overtime. There was a 2018 overview of a lot of these debates from someone named Thomas Elgood and Natasha Stursinger and Allison Levine and hats off to Livia for like getting all these names. There's a lot of people that did a lot of follow-up stuff. So nice job. Yeah.
Starting point is 00:28:54 But they noted that the individual, the individual students results varied a lot on the different post-tests saying, basically we just don't have a lot of evidence that these IQs really improved at all. Yes, but here's the thing. This is what's astounding of it. I think it was Robert Snow in his book review of it,
Starting point is 00:29:19 wrote that it's possible that the Pygmalion in the classroom like study actually did turn up evidence of this idea that we've all considered for a long time as possible, that teachers' expectations affect student performance. But if it did, it did it by accident because he was just saying like the study was so poorly executed. And it seems like Robert Snow was correct in that guess that somehow, some way this study did show this is a real thing.
Starting point is 00:29:55 And over time, from this 10 year long debate over the results and the methodology and all that stuff, and hats off to Rosenthal. He didn't just like, he didn't just like throw the study out and run off with a big bag of money with a dollar sign on it. He stood there and he answered his critics. He had to, he engaged in the debate for a good decade.
Starting point is 00:30:14 And over the course of that decade, more studies with better methodology and better execution were created and studied the same effect, this Pygmalion effect, and they found, nope, he was right. Whether it was a bad study or not, this produced some sort of correct results that we do realize now the Pygmalion effect does have, it is real to some degree.
Starting point is 00:30:40 Yeah, and depending on who you were, you could come at it from a different angle and each of you have a point, because as on who you were, you could come at it from a different angle and each of you have a point. Because as Livia points out, like just sort of politically, as far as being hard on teachers or not, it would play out in different ways. A writer for the San Francisco Chronicle said like, oh, see, here you go. These low expectations on these these children of lesser income, that's what's causing them to fall behind and maybe even drop out of school later on. Whereas the Albert Schenker who was with the
Starting point is 00:31:12 United Federation of Teachers said, no, it's not the teacher's fault, it's poverty itself and we have too many kids in these classes and we don't have the right materials. Yeah, and regardless of where you fall on it, there was still a big push to do away with like advanced placement classes or gifted tracks or even remedial stuff.
Starting point is 00:31:35 They were like, just because you think a kid's remedial, do not put them in a remedial class, put them in like a mixed aptitude class and they'll do way better than if you put them in a remedial class. That was a big deal. I don't, I guess it wasn't successful because there was still plenty of AP classes and snotty little AP students in the 90s when I was in high school.
Starting point is 00:31:57 I was just love to shove it in your face. Oh, I'm in AP history. Did you not take any AP classes? No. I took a couple. I took AP history. Did you not take any AP classes? No. I took a couple. I took AP history in English, but looking back, like, I don't know, I can definitely see, like they were great classes and I felt like the teachers
Starting point is 00:32:16 were better, but it also may have been my own bias because it was AP and also like a student that, you know, they don't think should have tested into there. If they had been thrown in there, maybe they would have risen to that level. So it's, you know, with adult eyes, I know, look back at kind of how messed up all that stuff was. Well, if it was better teaching from better teachers with better material, then the argument for people who are like against that would say,
Starting point is 00:32:47 then all classes should be like that. Every history class should be taught like that. Don't just make it for the ones who you think are gifted or whatever. So that was a, I think that still probably is a big deal. I'm not particularly up on the state of education today or early childhood education. So I don't know if they're still putting kids in classes, different separate classes or not. But if not, I'm sure there's still people arguing against it. Yeah, I mean, I'm not sure yet as far as upper grades, all my experience right now is with Ruby in the third grade
Starting point is 00:33:20 at her little hippie-dippy private school, where of course everybody is treated equally and given the same opportunities. Everyone wins. Horde loses. So one kind of cool thing that came out of this was because it was so famous and because there were so many people sort of criticizing it,
Starting point is 00:33:40 so many people defending it, and so many people doing other studies. Because as we'll see see this soon leapt into The private sector with like business into the military Like people started sort of applying this kind of thing to all kinds of you know stuff outside the classroom Yeah, it led to Rosenthal saying well, hey Now I can look at like all these studies together and like Was that the the literal birth of meta-analysis?
Starting point is 00:34:06 Was he one of the first? That's how I took it, yeah. The same. 1978, he got together with a colleague, Donald Rubin, who was the head of Harvard's statistics, or statistical analysis department. So this guy's like as good as it gets with statistics. And they got together 345 studies
Starting point is 00:34:26 that looked at expectancy effects and found that there was like there was a pronounced effect that was detected in the, if you just looked at the high quality studies on it. Right. Okay. So they're looking at this stuff. Like you pointed out earlier, the people couldn't replicate because there wasn't raw data.
Starting point is 00:34:49 And there were psychologists and neuroscience researchers that were pointing this stuff out, like, hey, we can't even replicate this thing. There were also people pointing out that, the people that are criticizing it and the people that are defending it, like sometimes they're not even looking at the same data. Right.
Starting point is 00:35:05 Yeah, so Rosenthal was like, hey, if we're looking at actual student progress based on teacher expectations and you're just looking at gains in IQ testing, that's not looking at the whole picture. Like if you also take into account scores from year end achievement tests or teacher assessments on improvement into account scores from year end achievement tests
Starting point is 00:35:25 or teacher assessments on improvement or how many books a kid can walk around with on their head without spilling them over because they have really good posture. If you take all this stuff into account, you get a much clearer picture of whether the student actually did improve or not thanks to teacher expectation.
Starting point is 00:35:44 Yeah, exactly. So, and you know, I mentioned they did it outside the classroom. I think they found the biggest gains in military settings. Yeah, which makes sense. Yeah, the idea that you know, you probably just have more sway as a drill sergeant than you do as a teacher maybe. Yeah, for sure.
Starting point is 00:36:00 You have that much more influence and the more influencing control you have over somebody, the more effect your expectations can have on them. Yeah, but they definitely like, they saw this play out. So it's not like we're, this is an episode on how this isn't a thing because it is a thing whether they found it by accident or not. Like there was one example that Livia found where there were employees putting together medical kits and they brought in this group of new hires and told the managers like, hey, these people, they're Maze happy.
Starting point is 00:36:33 What was it? Maze bright? Maze bright. Yeah, they're Maze bright. Like you ought to see them put together these kits like you're gonna do great. They've got a lot of potential here. And that group ended up breaking records
Starting point is 00:36:45 for production levels. Right. And so if you're in management science, you're teaching everybody this, like just go out and lie to your managers. And your employees will start like actually producing way better than you would think. For no reason other than their manager
Starting point is 00:37:04 has higher expectations, thinks they're better at it, at for no reason other than their manager has higher expectations, thinks they're better at their job than other people. And that is a huge, huge part of all of this. There doesn't seem to be the same effect if you are forthright and honest with the teacher because the whole thing seems to be rooted in the idea that the teacher or the manager has to genuinely believe that this kid or the student or this employee is is above average and Expect above average results from them. Yeah, I say we take another break and we talk We dive a little bit more into that after this a eh? Sounds good, ma'am. Superman. I'm hosting a new podcast and we're calling it very special episodes.
Starting point is 00:38:06 One week we'll be on the case with special agents from NASA as they crack down on black market moon rocks. H. Ross prose on the other side and he goes, Hello Joe, how can I help you? I said, Mr. Perot, what we need is $5 million to get back a moon rock. Another week we'll unravel a 90s Hollywood mystery. It sounds like it should be the next season of True Detective or something. These Canadian cops trying to solve this 25-year-old mystery of who spiked the Chowder on the Titanic set. A very special episode is Stranger Than Fiction.
Starting point is 00:38:37 It's normal people plop down in extraordinary circumstances. It's a story where you say this should be a movie. Listen to very special episodes on the I heart radio out apple podcasts or wherever you get your. Hi, I'm Susie Esmond and I am Jeff girl, yes, you are and we are the hosts of the history of curb your enthusiasm, the hot cast we're going to watch every single episode, it's a hundred and2, including the pilot,
Starting point is 00:39:07 and we're gonna break them down. And by the way, most of these episodes I have not seen for 20 years. Yeah, me too. We're gonna have guest stars and people that are very important to the show, like Larry David. I did once try and stop a woman
Starting point is 00:39:18 who's about to get hit by a car. I screamed out, watch out! And she said, don't you tell me what to do! And Cheryl Hines. Why can't you just lighten up and have a good time? And Richard Lewis. How am I going to tell him I'm going to leave now? Can you do it on the phone?
Starting point is 00:39:31 Do you have to do it in person? What's the deal? It's the insulin cable. You have to go in and human beings help you. And then we're going to have behind the scenes information, tidbits. Yes, tidbits is a great word. Anyway, we're both a wealth of knowledge about this show
Starting point is 00:39:43 because we've been doing it for 23 years. So subscribe now and you could listen to the history of Kerber Enthusiasm on iHeart Radio App, Apple Podcast or wherever you happen to get your podcasts. One of the best shows of the year, according to Apple, Amazon and Time, is back for another round. We have more insightful conversations between myself, Paul Muldoon, and Paul McCartney about his life and career. We had a big bear of a land, it was called Maladins, with our logo, and I was coming back on the plane and he said, will you pass the salt and pepper and I miss her. I said what? So I drew pepper. This season we're diving deep into some of McCartney's most beloved
Starting point is 00:40:33 songs. Yesterday Band on the Run, Hey Jude and McCartney's favorite song in his entire catalogue here, there and everywhere. Listen to season two of McCartney, A Life in Lyrics on the iHeart Radio app, Apple Podcasts or wherever you get your podcasts. and Chuck, stop pushing now. So Chuck, one thing that I think probably everybody listening to this episode so far has come across as a question is, okay, if teachers' expectations actually influence student performance,
Starting point is 00:41:21 how, what are teachers doing that can have that effect? And that's been a big thread of this study as well. Yeah, because to implement this is kind of the important thing. It's not just to sit back and say, well, we know all this stuff now because hopefully the goal is to help kids learn better. So they did put together some broad categories over the years of how if you're a teacher you might be transmitting positive expectations. You might not be and not even know it by saying certain things. And they put together a four point thing which after I read it I was like, oh my god, why weren't they already doing all this? I know it's kind of sad. But here
Starting point is 00:42:02 it is. Climate that is giving a warm, emotional environment, input giving them more and tougher assignments, these students, output allowing the students more opportunity to engage with that material and then the fourth one is give more detailed feedback. Right, so teaching essentially. Yeah, like teaching well.
Starting point is 00:42:22 Yeah, exactly. So what they found was that given that idea that some of their students were growth spurters or were going to really make some crazy good moves this school year, teachers did different stuff with that information. They didn't all just follow what Rosenthal would have expected, which is they create these high expectations of warm learning environment for those growth spurters or bloomers. Instead, some of them were like, oh, okay, well then that kid's good. Let me go focus my attention on the lower achieving students.
Starting point is 00:43:00 Yeah, the Mays-Dole students. Yeah. And so what was interesting about that too, because that actually is kind of sensible. It's a sensible strategy if you have a finite amount of time and attention to give to all your students. They found that in some cases, there was a psychologist, Rana Weinstein,
Starting point is 00:43:20 who found that when that was done, in some cases, the low performing students who got more attention actually still did worse than the higher performing students. And she hypothesized that that was because those kids were basically being patronized. And even though they're six, they still understand that on some innate level. And so they were still getting signals
Starting point is 00:43:43 that the expectations for them were low. Yeah, or maybe they were already separated out, which kind of goes to that whole idea that like putting kids in a group just labeled, and you know, and a lot of times, you know, they would, I remember my school, even where my father was principal, the troubled kids program, and this wasn't necessarily academically, but the behaviorally troubled kids were all put in a special group that had a label, I can't remember, it was an acronym that basically indicated kind of how great they were,
Starting point is 00:44:17 which is, you know, it's a good thing. It's like you definitely shouldn't say like, call them like, these are the bad kids or whatever. So I think they would put labels on them that would hopefully give them an aspirational expectation or something or they did in the 70s. My dad's whole thing was outdoor programs. He was the first person in the,
Starting point is 00:44:39 I think in the state, definitely in the county that started all these camping programs and he really believed that getting kids out in nature, if they had behavioral problems, could really, you could see gains there and stuff like that. Oh, yeah, that makes sense. Yeah, that was pretty cool.
Starting point is 00:44:53 Great principle, yeah, and full stop. So what your point is is that if you separate kids, or you even talk about certain kids in certain ways, if you even have them separated mentally, it's going to be transmitted or telegraphed to both groups of students as a whole. Sure, and they found that even if they weren't separated, just sort of the language that teachers would use
Starting point is 00:45:22 in the class would divide them the way they talk to certain kids and other kids. Right, yeah. That's what I was saying. Okay. Which is, you know, it's pretty interesting, but again, all of it comes down to this. I shouldn't say again, because I haven't made this point yet. beings with biases, with prejudices, with just thoughts that they can't avoid unconscious ways that you treat or act towards certain kids where you favor some over others. And then there was something that stuck out to me because there was a researcher from New Zealand named Christine Ruby Davies.
Starting point is 00:46:03 I'll bet when she talks it sounds awesome. Yeah. But she has set up a project called the teacher expectation project where she's like, hey, remember how you guys said a minute ago that for this to be effective, you have to lie to the teachers, you have to mislead them so that they genuinely believe that the students are gifted? I say nuts to that. I'm gonna figure out a way to teach teachers to be high expectancy teachers. For everybody. Right. So that they have those effects on everybody without them being duped. But one of the things she came up with that to me was like,
Starting point is 00:46:41 yes, I think that's 70% of it right there. Teachers don't know all of their students equally well in the classroom. And if you've ever been one of the students who your teacher didn't really know you very well and clearly knew other students better, that is a isolating feeling. And it's not as easy to learn as it is
Starting point is 00:47:04 when you're one of the students that the teacher knows that kid. And so that's one of the things that Christine Ruby Davies teaches, like know all of your kids equally well. It's very important. Yeah, for sure. I mean, I was well known by all my teachers because I didn't consciously make a point to, but I was the class clown and I was always involved in trying to crack jokes and being funny and I may have been disruptive, but the teachers also loved me because it wasn't usually like a like super negative disruption. I would just see a good opportunity for a joke and run with it. But as you know.
Starting point is 00:47:42 Well, plus your dad would have fired them if they gave you any back talk, right? Yeah, right. Well into high school too, you know, but as a long story short, I was well liked by teachers. Right. And so they paid me more attention. Livy also points out something really important about grouping kids is if you just throw kids
Starting point is 00:48:03 in a group of like, you know, May's dull group, some of these kids may have dyslexia, some may have ADHD, some may be have insecure housing and family issues and be stressed, some may have limited English fluency. So you're throwing all these different issues in as one group. And of course that's gonna be an issue. Yeah Yeah, so
Starting point is 00:48:29 Yeah, that's why they say use mixed group mixed ability groups. That's one of the teaching the teacher expectation project Another thing that was touched on is creating a caring non-threatening environment Yeah, you just it's a warm environment for all students and you use respectful language, you can't be like, gosh, you're so dumb, you dumb dumb, you shouldn't say that to students, right? And this is another one too, working with students to set their own goals, which a lot of teachers would be like, you can't actually do that, but apparently Ruby Davies research has shown or some research out there that Ruby Davies sites has shown. If you allow students to set their own learning goals,
Starting point is 00:49:10 they will actually shoot for something that's challenging but doable. They probably aren't gonna be like, well, I'm just gonna learn to draw Huckleberry Hound this year, that's my learning goal. You know, like they're going to do something a little more challenging than that and they'll learn along the way
Starting point is 00:49:28 and they will have a sense of like agency and a stake in their learning. Like they'll take it that much more seriously and they'll know if you plot and chart their learning through learning goals and allow them to track it themselves, they will know when they've learned rather than having to look to the teacher to be like,
Starting point is 00:49:49 yes, you just learned something, way to go. Yeah, what in years the horse? If I remember correctly, you could draw a heck of a horse. I used to, I lost it as I proved on Instagram. No, everyone should go check that out. I thought it was a great drawing of a horse. Thanks. Another thing that they said as far as the high expectations
Starting point is 00:50:10 teaching from Christine Ruby Davies goes is praising effort rather than accuracy. Very big deal and working equally with all students. And I'm not gonna name my daughter's school for obvious reasons, but like they're doing it right and It's just great to see that happening so just big props to Her teachers and everyone at her school and and and this is it's not just her school
Starting point is 00:50:34 It's happening more than when we were kids that more and more schools, but it's still Not as much as it should in the same breath, you know, yeah, I'm sad not as much as it should in the same breath, you know. Yeah, that's sad. Two more just related effects that have to do with the Pygmalion effect, the Gallum effect, which is the opposite. If you have low expectations, it leads to lower performance, which makes sense too.
Starting point is 00:50:56 And that Gallatea effect named after Pygmalion statue, that what we expect for ourselves impacts our performance mostly because it mediates how the people in authority, a teacher or a manager or something sees us. So the way that they see us impacts how we see ourselves, which impacts how we perform, which impacts how the manager or a teacher sees us. And it's just like a or a boros.
Starting point is 00:51:23 That's right. Pretty interesting stuff, man. Good pick, Chuck. I think it's so great you just came up with this all by yourself. Oh, man. I hope I did. I hope you did too. Well, since we both hope that Chuck came up with this by himself, it's time, of course,
Starting point is 00:51:36 for a listener mail. Hey, guys. I live in Rhode Island where I run Charter Books, an independent bookstore opened in the spring of 2021. We report to the New York Times bestseller list. And I can confirm that you guys really nailed just about everything about it. And I thought you might like a few more tidbits.
Starting point is 00:51:54 Yes, please. Every week, we export a CSV document from our bookstore point of sale software, upload it to the bestseller list portal. And as mighty as they are, it's still amusing to see that it's basically just comes down to us emailing them a spreadsheet, along with all the other booksellers, of course. If we haven't done it by 11 a.m. on Monday, they send a gentle reminder.
Starting point is 00:52:17 If we inadvertently miss a week because they require that you report all 52 weeks, they send a message about how much they value our input and how disappointed they are that we forgot. Oh, wow. A little passive aggressive. Yeah. And then every week they also send an email asking about any bulk orders, which you explained very well
Starting point is 00:52:36 in the episode. You are correct in implying how powerful it can be. The list that is authors, publishers, publicists, and other entities in the industry frequently ask if we report to the times and years ago when I was with another bookstore We received a weird order for 20 copies of a random YA fantasy book Mm-hmm turned out to be a bungled effort by an obscure publisher to do some book laundering as Chuck would say Well, so hours after we took the order we received a sternly worded Message from the New York Times that they wanted documentation of all orders,
Starting point is 00:53:09 basically asking for our receipts. None of this is earth-shattering to you guys, probably, but it was fun to hear you talk about my day-to-day work. That is Steve from Charter Books. So hey, if you're near Charter Books in Rhode Island, support your indie bookstore. Yeah, no matter where you live, support your indie bookstore friends. For sure.
Starting point is 00:53:28 That was Steve, right? Yeah, and he had a similar picture they had our book on display. Awesome, thanks Steve. We love it when people round out information that we've talked about. And if you want to be like Steve and do something like that, you can do it via email. Send it off to StuffPodcast at iHeartRadio.com. Stuff You Should Know is a production of iHeartRadio. For more podcasts on my heart radio, visit the iHeartRadio app. Apple podcasts are wherever you listen to your favorite shows.
Starting point is 00:54:07 Hello, this is Susie Esman and Jeff Garland. I'm here. And we are the hosts of the history of Curb Your Enthusiasm Podcast. Now, we're going to be rewatching and talking about every single episode, and we're going to break it down and give behind the scenes knowledge that a lot of people don't know, and we're going to be joined by special guests, including Larry David and Cheryl Hines, Richard Lewis, Bob Oatenkirk and so many more, and we're going to have clips by special guests, including Larry David and Cheryl finds Richard Lewis Bob Oton Kirk and so many more and we're going to have clips and it's just going to be a lot of fun. So listen to the history of curfew
Starting point is 00:54:31 enthusiasm on I heart radio app Apple podcast or wherever you happen to get your podcasts. You may know my voice from Noble Blood, Haley Wood, or Stealing Superman. I'm hosting a new podcast, and we're calling it Very Special Episodes. A Very Special Episode is stranger than fiction. I sound like it should be the next season of True Detective, these Canadian cops trying to solve this mystery of who spiked the chowder on the Titanic set. Listen to Very Special Episodes on the iHeartRadio app heart radio app apple podcasts or wherever you get your podcasts. One of the best shows of the year according to Apple Amazon
Starting point is 00:55:12 and time is back for another round. We're the big bearer of the man. All of this. And that's going back on the plane. He said we passed the salt and pepper? And I miss herding. I said, what? Sergeant Pepper.
Starting point is 00:55:31 Listen to season 2 of McCartney A Life in Lyrics on the iHeart Radio app, Apple Podcasts, or wherever you get your podcasts.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.