The Jordan Harbinger Show - 342: David Epstein | Why Generalists Triumph in a Specialized World

Episode Date: April 23, 2020

David Epstein (@DavidEpstein) has worked as an investigative reporter for ProPublica and a senior writer for Sports Illustrated. He is the author of the number-one New York Times bestseller R...ange: Why Generalists Triumph in a Specialized World. What We Discuss with David Epstein: What are the pros and cons of specialization and generalization? Why sacrificing depth for breadth in the learning process might be an advantage. How struggling to generate an answer -- even a wrong one -- enhances subsequent learning. The end of history illusion and the hazards of choosing to specialize between ages 18-29. Why self-taught people tend to experiment more and come to unique solutions for problems that specialists overlook. And much more... Full show notes and resources can be found here: https://jordanharbinger.com/342 Sign up for Six-Minute Networking -- our free networking and relationship development mini course -- at jordanharbinger.com/course! The Art of Manliness Podcast is a podcast that aims to help men become better men; host Brett McKay explores how to live a life of both contemplation and action while having some fun along the way. Do yourself a favor and check out The Art of Manliness Podcast here! Like this show? Please leave us a review here -- even one sentence helps! Consider including your Twitter handle so we can thank you personally!See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Transcript
Discussion (0)
Starting point is 00:00:00 This episode is sponsored in part by Conspiruality Podcast. You know how I'm always talking about critical thinking and spotting manipulation? Well, there's a podcast that's all about dismantling new age cults, wellness grifters, and conspiracy mad yogis, basically the wild overlap of spirituality and misinformation. It's called the Conspiruality Podcast. The hosts, a journalist, cult researcher, and a philosophical skeptic, dive deep into how this stuff spreads, from Project 2025 and the Heritage Foundation's dystopian vision of the future to how former leftists get pulled into far-right conspiracies.
Starting point is 00:00:31 An interesting episode to check out is called Speaking Truth to Goop, where Jen Gunter breaks down the pseudoscience behind the wellness industry in a way that is super entertaining and eye-opening. It's sharp, funny, and makes you a lot harder to fool, which, if you listen to this show, you know I'm all about that. From exploring cults to analyzing our cultural and political landscape, the Conspiratuality Podcast will help you stay informed against misinformation and resist fear tactics.
Starting point is 00:00:54 Find Conspirality on Apple Podcasts, Spotify, and wherever you get your podcasts. Welcome to the show. I'm Jordan Harbinger. As always, I'm here with producer Jason DeFilippo. On the Jordan Harbinger show, we decode the stories, secrets, and skills of the world's most brilliant people and turn their wisdom into practical advice that you can use to impact your own life and those around you. We want to help you see the Matrix when it comes to how these amazing people think
Starting point is 00:01:21 and behave. We want you to become a better thinker. If you're new to the show, we've got episodes with spies and CEOs, athletes and authors, thinkers and performers, as well as toolboxes for skills like negotiation, body language, persuasion, and more. So if you're smart and you like to learn and improve, you'll be right at home here with us. Today on the show, David Epstein, author of Range, why generalist triumph in a specialized world, for years we've been led to believe that picking a specific field of study as early as possible and sticking with it was the key to becoming a high performer in our field.
Starting point is 00:01:53 But what if the key to becoming great in a specific field was not to start narrowing. narrowing our practices down as early as possible, but instead to study a wide breadth of seemingly unrelated fields entirely. He joins us to uncover some new research that shows that not only do head starts in life often fade away, but many times they can actually be detrimental to deep learning. These days more than ever, we're seeing that it's often the outsider that has an advantage, not only in disrupting established fields, but also in pushing the limits of human performance entirely.
Starting point is 00:02:26 If you want to know how we manage to book all these great people, it's all about the network, it's all about developing and maintaining relationships using systems and tiny habits so it doesn't feel like work. Check out our six-minute networking course, which is free over at jordanharbinger.com slash course. And by the way, most of the guests on the show, they actually subscribe to the course and the newsletter. So come join us and you'll be in great company.
Starting point is 00:02:49 Now, here's David Epstein. In the book, the thesis seems to be that often by specializing, we're sacrificing true understanding or true performance. Can you take us through that a little bit? Because the whole idea is counterintuitive. I mean, I want a brain surgeon to be adept at brain surgery, but, you know, why are you telling me that I also need them to play the violin? What's going on here? Well, I'm not saying that the brain surgeon has to play the violin, although it does so happen that Nobel laureates are 22 times more likely to have an aesthetic hobby than our typical scientists, so that this wide range of interest sometimes is a proxy for a number of other things.
Starting point is 00:03:26 But let's take surgery specifically, since you brought it up. There is no, question that specialized surgeons have fewer complications than non-specialized surgeons. That's true, even if you control for the number of times someone has done the procedure. So something about just being specialized on top of your experience with the procedure means you have fewer complications. At the same time, specialized surgeons are a lot more likely to do a procedure that has been shown to be ineffective or dangerous. So the specialization becomes sort of a double-edged sword where you're a lot less likely to have complications for a surgery you may not have needed in the first place. So, for example, a few years ago, the most common surgery in the world for knee pain was
Starting point is 00:04:09 testing a placebo-controlled trial where some patients got what's called sham surgery, where the surgeons make an incision, they bang around like they're doing something, they sew the patient back up, and that did just as well as the real surgery, and yet specialists continue to do the procedure by the millions. So there's this sort of double-edged sword of specialization. I think it has to do with what I call in the book, I mean, these are not my terms, but kind versus wicked learning environments. So in kind learning environments, specialization works really well. Those are terms created by the psychologist Robin Hogarth. And a kind learning environment is one where the next steps and goals are well understood. The rules are clear and don't change quickly. When you do something, you get
Starting point is 00:04:47 feedback that's quick and accurate. And work next year will largely look like work last year. On the other end of the spectrum are what Hogarth called wicked learning environments, where next steps and goals may not be clear. Rules may change when you may or may not get feedback all the time. It may be delayed. It may be inaccurate. And work next year may not look like work last year. So the actual physical part of doing a surgery is maybe more on the kinder end of the spectrum in a lot of ways, where it's known procedures that you want to do with as little error as possible. But in terms of evaluating the full organism and when somebody actually needs that and the delayed response of how someone does long after surgery, that's much more on the wicked end. And that's where you need to have
Starting point is 00:05:28 this broader view and these multiple methods for learning. And so I think surgery is actually sort of a good place to discuss it. And I've been talking to a lot of surgeons because of that, because it requires this kind of incredible, almost unique mix in some ways of specialization on the one hand of certain skills, but a broader view if you really want good outcomes as opposed to just like doing lots of procedures. And we'll get into why that is in a little bit here. But it seems like the most effective learning is often inefficient or slower somehow. And that's, I think unfortunately a lot of people are trying to do the opposite, right? We want like effective but quick learning and therefore we cut out all of what might look like
Starting point is 00:06:05 might look like fluff to the uneducated observer here. Like, hey, don't worry about anything other than ear, nose and throat. Let's just focus on that. You have 10 years anyway. Why are we going to educate you about all these other systems in the body? Let's specialize as early as possible. Does that ring true from your research? I think that definitely rings true.
Starting point is 00:06:24 I think it's understandable. It seems efficient, right? It's the well-meaning drive for a head start. But I think you mentioned medicine again. Specifically, I think people are starting to recognize that that is actually sometimes problematic. That while there's no question that specialization in medicine has been both inevitable and beneficial, I think people are increasingly realizing some of the drawbacks when you kind of take out people who have a view on the bigger picture. So again, in medicine, as people get increasingly specialized, they all work based off of what's called surrogate markers, which means nobody's looking at the whole body. They're all looking at some little proxy that they're assuming is a proxy for the whole body. Sorry, it's some little factor. So, like, someone who specializes in some aspect, you know, of the heart might do something that lowers blood pressure numbers, say, oh, great, we did something. And then you'll find that people die of heart attack and stroke at the exact same rate just with better blood pressure numbers. There's a ton of stuff going on like that. And so you also want someone who sort of has this zoomed out view. In fact, in the last chapter of the book, one of the guys who's very prominent right now because he is. is maybe the most prominent immunologist in the world. And so he's being a Twitter celebrity right now during the coronavirus, Arturo Kassad of all. He took over the microbiology and immunology department at the Johns Hopkins School Public Health, probably the most prominent one in the world, and is despecializing training, starting future doctors and scientists and public health professionals with training in what constitutes evidence and things like that instead of the normal anatomy and physiology
Starting point is 00:07:52 where you jump right into kind of the reductionist picture of the body, looking more at like social systems and public health and how do you even evaluate claims and what are the different levels of evidence that prove whether something works or not? So he's doing this despecialization. And his feeling is we never teach people that. And all that didactic information, the sort of technical stuff they need to know,
Starting point is 00:08:11 that's the easier stuff to teach them later on once they have this general scaffolding of sort of how to think. I think in that well-meaning drive for a head start, we often sort of short-circuit learning, even like whatever the material is. So take a study that came out in 2019 that randomized seventh-grade math classrooms to different types of learning. Some of these classrooms, it was about 60 classrooms, so quite a lot from education studies. Some of these classrooms got randomized to what's called blocked practice. That's like you give the kids problem type AAAAAA followed by B, B, B, B, B, and so on.
Starting point is 00:08:41 They make progress fast. They're happy. They rate their learning highly. They rate their teacher highly. Everything's great. Other classrooms got randomized to what's called interleaved practice. That's like if you took all those problem types and threw them in a hat and drew them out of random, so it could be like A, D, C, B, B, whatever. Progress is slower, kids more frustrated, rate their teacher worse. But instead of learning how to execute procedures, they're learning how to match a strategy to a type of problem. And when the test came around, the interleave group blew the block practice group away. The effect size was as if you took the 50th percentile and moved it to the 80th percentile, studying the same stuff just in a way that made it slower and more frustrating. And this is
Starting point is 00:09:19 what psychologists call desirable difficulties. These are things that slow down learning and just feel like frustration, but actually allow you to make more flexible and more memorable knowledge in the long term. So I think that's sort of a fundamental concept and a lot of stuff in range. So interleaving, is that just a fancy way of saying figure out the type of problem and then figure out a strategy to solve that problem? Interleaving is, refers to the mixing up of the types of problems so that you don't know what type of problem is coming next. So you're constantly, instead of practicing a procedure over and over, you're constantly being forced to try to diagnose the structure of the problem. So some people call this mixed or variable practice. So it's basically shuffling the challenges a lot instead of studying
Starting point is 00:09:59 the same thing over and over. Okay. So like when I took the LSAT, which is the, I guess, entrance exam for law school in the United States, there's a section called Games, which is this logic game section, they're not nearly as fun as it sounds, and there are all these really hard logic problems that are frustrating. It's kind of the proverbial of a train leave Chicago at this time and heading east, but it's much, much more complicated than that. You have to keep like 10 variables in your head and they all change and there's ways to diagram them. And basically, if you know how to diagram and think about these problems, you're going to kill it. But if you just try to wing it, you're totally screwed. And so, like, I was doing fine on all the other sections
Starting point is 00:10:36 of LSAT and I just drilled game. like crazy, and my performance actually went down over time, which was incredibly frustrating. And then when I just started taking entire LSAT practice exams, I was doing fine. Or when I just started taking random questions of any section on the LSAT and just running through it as a study, my performance actually went back up, which is, again, kind of a mystery back then, but now totally makes sense, because I wasn't looking at a problem and going, all right, this is a logic game, let me start the same way as I always do. I would look at it and go, oh, this is not a verbal problem or this is a verbal problem. Let me solve it in this different way entirely. I'm starting
Starting point is 00:11:12 from a step back instead of taking assumptions with me, I guess. Yeah, no, I think that makes a lot of sense. I mean, I remember actually you just reminded me of those games. Like I took the GRE and there was something like that, probably less complicated. Sure. That's one of the huge tricks. It's like, it's fine for someone to do just the quick, repetitive practice if they're going to continue facing the same problem. So I think specialization, our whole education system is kind of built out of Taylorism, which is like the science of management efficiency, which made a ton of sense when we were largely in industrial economy, and most people did face the same types of problems one year to the next. So they could have a discrete period of training for specific skills and then a discrete period
Starting point is 00:11:51 of working for the rest of their life. That's for most people gone by the wayside. We can't just have like one period of learning in our life followed by training. And so we're more in this world where we have to take knowledge and do what psychologists call transfer, which is you take things, concepts you've learned, and you're going to have to apply them to stuff you've never quite seen before. There are similarities, but you haven't seen this exact thing before. And so I think that's part of what I was seeing in the research, this increasing benefits accruing to people with breadth and conceptual knowledge is we've moved more into a knowledge economy where people can't count on work next year looking like work last year, basically. So how do we create practices like this
Starting point is 00:12:27 in our own lives? Is there anything where you've come across just in your daily life or at your job day-to-day, which is, I mean, you're a writer and a thinker, so maybe it's a little different for most people, but how do you implement this? You know, if I'm not studying for an exam and I'm working on the craft of interviewing, how do I start applying this? Or if I'm a doctor or a teacher, how do I start applying this to my own life? Yeah, I think of one way, so if you're a teacher, I mean, you should start by like using a desirable difficulties, like just interleaving all the stuff you were going to do anyway, like mix the order up and things like that. So let me ground this in the research that sort of influenced the way that I go about this.
Starting point is 00:13:02 which is I spend some time with a woman named Deidre Gintner at Northwestern University, who is one of the world's experts in what's called analogical problem solving. That's like when you're facing a problem that you've never seen before, a really useful way to generate possible solutions is to draw on analogies because you don't have the exact knowledge you need. So you have to look for structurally similar problems from elsewhere. And she came up with this test that gauges how well people do that. And she gave it to students at Northwestern. And students tended to do well at solving problems in their major and then poorly at solving problems outside of their major, even if it was a, it was a lot of, was basically the same problem just with different window dressing, essentially. But the students who did well inside and outside their major were these ones in this program
Starting point is 00:13:40 called the Integrated Science Program, where they don't even have a major. They just dabble in a whole bunch of different disciplines, and they end up being really good at drawing different analogies from all these different kind of mental models that they've been exposed to when they have to face novel problems. And the interesting thing was, though, when I went around to her colleagues, they would say, oh, we don't like that program. Those kids are getting behind. I'm like, here you have the world's expert saying, these are the kids who are the best
Starting point is 00:14:02 problem solvers and you're saying like they're falling behind because they're not specializing early enough, which I thought was pretty ironic. But yeah. So for me, so I want to, when I think about interviewing, I want to sort of expand my database of analogies I can draw on. So I'll go and look in other fields. You know, I've had a lot of exposure to journalists doing interviews, but what about how doctors interview patients or interview people about debriefings in special forces groups? And basically, I'll start by looking for domains that I wouldn't run into normally. And, trying to find, you know, what do they do similarly and what do they do differently, and you start to find things that you can apply and build these sort of general models
Starting point is 00:14:39 of things that work in different situations as opposed to just things I'm used to that work in these sort of standard situations that I've seen before. So it seems like there's an almost epidemic issue in academia or just in career training in general, especially here in the United States, where we sacrifice what's actually going to work long term or result in career success by forcing people to specialize early. And one of the examples you gave in the book, which is near and dear to my heart having married into an Asian family, is the whole like Tiger Mom scenario in which I live in Silicon Valley. There are kids that are, I think, like two or three years old that are holding violins and trying to play on the violin because their parents are just so concerned that they're already behind compared to their cousins over in China or whatever that already play the piano and the violin. It's just ridiculous.
Starting point is 00:15:28 and I can't imagine that's a set up for a happy life for a child, but that's kind of the philosophy they're going with, right? The earlier we get this thing into this kid's hands, literally, the better off they're going to be long term. That's right. And I don't actually think there's anything wrong with early exposure. It's sort of a question of, you know, but when they're that young, it's probably really all the parents' motivation, right?
Starting point is 00:15:46 And they're drilling and all this stuff. And so even like the Suzuki school that people think of as starting kids famously early, that is true. But Suzuki, Shinichi Suzuki, he actually modeled it on language learning, where he said they shouldn't be drilling early on. and they should be listening and just like messing with the instruments. And he was saying, like, you don't teach the kids grammar first. When they're doing language, you allow them to develop an ear and immerse themselves and screw up and all that stuff.
Starting point is 00:16:09 And so I think if the exposure is in that way, it can be great. When it's, you know, more of the story that the Tiger Mom told, first of all, it's odd that so many people, I think, are so rabid about classical music, particularly, given that, like, it's fairly niche in a lot of ways at this point in society compared to a lot of other things they could. be doing. But, you know, on the first page of the Battle of Hymn of the Tiger Mother, the author recounts assigning her daughter violin and has her practice five, six hours a day. And this is so-called deliberate practice, right? This is coached error correction focus practice, not like trying to improv your way through things. That really struck a chord, but people don't seem to remember the part in the book later where her daughter says, you picked it, not me, and quits. Right. And that's totally in line with what the research finds is that the musicians who are likely to stick and to have a high
Starting point is 00:16:56 practice volume later are the ones who go through a sampling period early on where they get to try a number of different instruments first. And that's true even for musicians we think of as famously precocious, like Yo-Yo Ma. He went through his sampling period faster than most musicians for sure, but he tried two instruments first. He didn't really like them. He took a little break, came back, then he found cello, and then it exploded. But we never really tell that story, even though he's maybe the most well-known modern classical player in the world. For some reason, we don't hear those stories. We only hear the Tiger Mom stories. Yeah, that is interesting. Even when I heard that Yo-Yo Ma switched instruments early on, I thought, oh, well, you know, he's clearly super talented and he's got 10,000 plus hours, so he can maybe play all of them. But it turns out that a lot of even athletes do this, right? I mean, you give the example of Tiger Woods versus Roger Federer, which I think is pretty illustrative as well. Can you explain that?
Starting point is 00:17:47 Yeah, so the Tiger Wood Story, I think probably people, even just by sort of being alive, I think even if you don't know the details of the Tiger Wood story, you probably kind of absorbed the gist just in the, by cultural osmosis. So when he was seven months old, his father famously gave him a putter. At 10 months old, he started imitating his father's swing. By two, you can actually go on YouTube and see him on national television. At three, he starts saying, I'm going to be the next Jack Nicholas, you know, I'm going to be the next great golfer. He's famous as a teenager. Fast forward to age 21, greatest golfer in the world. So it's kind of that quintessential. early start 10,000 hours sort of story. On the other hand, Roger Federer played some tennis early, certainly early exposure, swam, wrestled. His mother was a tennis coach, declined to coach him because he didn't return balls normally. He wouldn't do kind of the deliberate practice stuff. He kept trying other sports, you know, volleyball, basketball, soccer. He didn't want to move up to a level with higher, play with older boys when his coaches
Starting point is 00:18:41 wanted him to because he just wanted to talk about pro wrestling with his friends after practice. And he just went on to dabble in like a dozen sports, like rugby. handball, skateboarding, all this stuff. And he was very much not focused as a young guy on being the next great. In fact, when he got good enough to warrant an interview with his local newspaper, the reporter asked him if he ever became a pro, what would he buy with his first hypothetical paycheck? And he said a Mercedes, his mother was appalled,
Starting point is 00:19:05 and asked the reporter if she could listen to the interview recording. And the reporter obliged, and it turned out, Roger had said, Merse CDs in Swiss German. He just wanted more CDs, not a Mercedes. Oh, yeah. So he was sort of the opposite. of the tiger path. And the interesting thing I think is they're equally famous as adults, right? But we only ever hear the tiger story. Even rabbit tennis fans don't usually know the Roger's
Starting point is 00:19:26 story, even though, according to a huge body of research, his story is absolutely the norm. And the tiger one is the outlier. So it's almost like we really elevate these outlier stories. And also, golf happens to be like, in many ways, a uniquely horrible model of almost everything else that humans want to learn. It's like the epitome of the kind learning environment. So I think the idea of extrapolating that tiger story, every other aspect of life is a, is a real way. mistake. What do you mean the epitome of the kind learning environment? What does that mean? So to go back, the kind learning environment is this term coined by the psychologist Robin Hogarth, meaning it's relatively low on moving pieces. You don't have to deal with a lot of human behavior.
Starting point is 00:20:01 The rules are totally clear and they will literally never change. You have everything that you're supposed to be trying to do completely laid out for you. Like there are no unknown questions you have to come up with. When you do something, you get feedback from what you just did that is immediate or very quick, and in golf, it's immediate and very accurate. And very accurate. accurate, and the task will always look the same. So, like, the principles of good performance are known. They can be coached. You get the feedback immediately. In those situations, you tend to, just from doing, you get better. Those situations in most of the areas that most of us work in are nothing like that. They are much more like Hogarth's Wicked learning environments where
Starting point is 00:20:38 nobody's giving, nobody's handing you the rules. They're not telling you all the important questions or the goals and next steps. The rules might change. You're not always getting feedback. Feedback might be inaccurate sometimes, and it might lead to teach you the wrong things, and you can't count on the work looking the same from one year to the next. So I think golf, it's been kind of an unfortunate story that people have extrapolated to all these other aspects of the world. Why is it that sometimes the more we practice something, the worse our performance gets over time? Like, why was it that when I was practicing on the game section of the L-Sat that my performance went down over time? Why does that happen? Well, it's hard to know exactly what was going on, you know,
Starting point is 00:21:17 what was going on with you. You can't diagnose what I was doing 20 years ago in the privacy of a dorm room. I don't understand. And I mean, if it went down in the short term, that could actually be a good thing, right? Because if you're doing too well too quickly, frustration is not a sign that you're not learning, but ease is definitely a sign that you're not learning. If something's too easy, you're doing too well too quickly, you're not learning. So that means it's not hard enough.
Starting point is 00:21:36 You should be getting at least 15% of the trials you're doing in whatever you're studying wrong or else you're not optimizing your learning for sure. It's not hard enough. So if you were just doing poorly in the short term, that's fine because you're you're you were probably putting yourself through some difficulty, if it was getting worse over the long term, either you weren't forming the conceptual models that you needed to diagnose, like, the structure of problems, or you were getting a kind of feedback that was teaching you the wrong lessons, basically. And I think that was very likely part of it. I mean, I don't know exactly what you were doing
Starting point is 00:22:03 after you were doing these or how you were thinking about them. But my guess is that the feedback you were getting was either not helpful or maybe even harmful until you found this strategy of diagramming, basically. I think there's also some sort of weird blindness that comes with, things that look repetitive, but really are not the same thing over and over. So, you know, you bring in an assumption like, oh, I guess I just have to start with these three things, and it doesn't really work for all the problems, which is kind of, you see this again in medicine where people see like 10,000 common colds, and then someone comes in with coronavirus or something, and they're like, yeah, you just have a cold. Well, are you sure? Because,
Starting point is 00:22:38 yeah, you just have a cold. I see this all day. I'm not going to do the extra five minutes or five steps or whatever it is to test this, because all, All of the models and all of the experience I have says you have exactly what everyone else is walking in with. So you get misdiagnosed. Yeah, that's an interesting point. And most of the time that doctor would be right. Right. But the consequences when they're not right, away all those times they were right, basically.
Starting point is 00:23:00 Like, sorry you died because I wanted to go to lunch early because I assumed you were one of the other 10,000 people that walked through with a cold this month. Yeah, and not even that they just needed to speed to lunch necessarily, but it's just they've seen these patterns. And in certain things, like, again, in golf, we're in like chess, for example, another kind learning environment. The Grandmaster's advantage is largely based on knowledge of recurring patterns. So if you haven't started studying those patterns, if you're a competitive chess player, but you didn't start studying those patterns by age 12, your chances of reaching international master status go down from 1 in 4 to 1 in 55. International master status is one down from Grandmaster. So you need to study those patterns.
Starting point is 00:23:35 And it's good to be able to recognize those patterns. It's also why it's so easy to automate, by the way. So in areas where that pattern recognition works really well, humans may not have a ton more to add for much longer. Sure. But the problem is when we get into that sort of pattern recognition mode, even when it isn't like chess, where you're seeing these things over and over and over and over again, right? And so we'll lapse into this pattern mode, even when it's not necessarily what we should do. And so there's a huge body of research on experts in things like predicting geopolitical and economic trends, admissions officers predicting how people will do in their college, judges predicting recidivism rates, all these things where they learn these patterns, over time that allows them to think that they've developed good judgment. But in fact, the data show that they often get worse or don't get better while becoming more confident. And so that's kind of a really bad mixture. Yeah, that's horrible. So confidence goes up, but ability goes down.
Starting point is 00:24:31 I mean... Or stay static and they get more confident, which is also bad. Yeah, yeah, it's almost like the same thing. Well, we can all see the obvious consequences or potential consequences of something like that. You know, if people are familiar with thinking fast and slow and Danny Conneman's work, that won the Nobel Prize for illuminating a lot of human cognitive biases. The way he sort of got started in that, I spent some time with him, you know, before I started writing the book. And he got interested in that body of research that was showing particularly that like psychologists and doctors and psychiatrists with experience were thinking they were better at predicting like how patients would do. And they were sure that they were better, but they weren't actually getting better. And then Kahneman had this experience in the Israeli army where he was tasked with watching these really hard exercises.
Starting point is 00:25:15 Like there's really hard physical team exercises where people had to like get a telephone pole, like a team of a group of guys, a telephone pole over a wooden wall without any person or the telephone pole touching the wall. So it was like really hard and you could see like leaders emerge and sort of people who would get frustrated. And there was this group of people like him who were supposed to rate these individuals and say these are the future leaders. These are the people who should be trained as officers and all these things. And it seemed obvious because he'd say, oh, this person showed this kind of leadership, you know, in this exercise. And then they would get the results back and continually find that it was random. Their accuracy, they might as well have just been throwing darts.
Starting point is 00:25:51 And what he was surprised at was that even though they saw that over and over and over, his colleagues never stopped to say, gosh, we're not getting any better at this. We're no good and we're not getting better. And that's sort of what kick started his life's work of illuminating cognitive bias and seeing that this experience did not lead to, he described as it led to the feeling of skill, but not actual skill. You're listening to the Jordan Harbinger show. We'll be right back. Thanks for listening and supporting the show. And to learn more and get links to all the great discounts you just heard from our amazing sponsors, visit Jordan Harbinger.com slash deals. Don't forget, we have a worksheet for today's episode so you can make sure you solidify your understanding of the key takeaways. That link is in the
Starting point is 00:26:34 show notes at Jordan Harbinger.com slash podcast. If you'd like some tips on how to subscribe to the show, just go to Jordan Harbinger.com slash subscribe. Subscribing to the show is absolutely free. It just means that you get all of the latest episodes downloaded automatically to your podcast player so you don't miss a single thing. And now, back to the show. Let's talk about the concept of chunking. Athletes seem to have these superhuman fast reflexes or reactions, but your work is shown that
Starting point is 00:27:01 once we take them out of their sporting environment, these advantages actually disappear. So that's fascinating because we do look at athletes and we go, wow, this person is just absolutely superhuman. It must have been an interesting test to then throw them into a pool or an unfamiliar environment and watch them do exactly what a normal, quote unquote, normal athletic or fit human would do. Totally. And you don't even have to change the scenario that much. One of the famous examples of this was the softball pitcher Jenny Finch, who was one of the best softball pitchers in the world. And she would go around to major league baseball teams and pitch to their best hitters. And you're like, okay, these guys hit 100 mile per hour
Starting point is 00:27:40 fastballs, you know, mid-90s fastballs. Jenny throws 60 to 65, but from a 43-foot mound, but the ball's so much slower that the transit time is actually longer than what they're used to, and the ball's bigger. So naturally, they all thought they were going to crush it, right, because they have reflexes fast enough to hit a Major League fastball. Of course, they're going to hit 60-some mile per hour softball. And what actually happened was they typically, I think one guy hit like a foul ball and everyone else never even hit a foul ball off of her. And when she faced Barry Bonds, she had a cameraman there and he made the cameraman, put the camera down. So we got like
Starting point is 00:28:12 45 minutes of the dirt, you know, in his feet because Barry couldn't even hit a foul ball, so he didn't want the guy to film. And it's kind of inexplicable if they have reflexes fast enough to hit 100 mile power fastball, why they can't hit the softball. But then it turns out they actually don't have reflexes fast enough to hit 100 mile per hour fastball. So the minimum reaction time of a major is 200 milliseconds, and it's actually the same for teachers, doctors, lawyers, major leaguers. That's a fifth of a second. That's the time it takes just to see that an object's in front of you for that information to cross the synapses to the back of your brain and to initiate muscle action, just to initiate it. And that's half the total flight time of the pitch. So it's way too slow if you're
Starting point is 00:28:48 actually reacting. And we don't even have a visual system capable of tracking an object as its angular position changes really fast as it gets close to our face. So the advice that we give our kids keep your eye on the ball, it's not possible. If they could close their eyes when the ball were halfway in, if it weren't psychologically upsetting, it wouldn't make any difference to performance. So the way that these hitters have learned to basically overcome our biological limitations
Starting point is 00:29:08 is they've learned to pick up on cues from the body of the pitcher, like the rotation of the torso, the movements of the shoulder, the flicker of the pitch, which is the flashing pattern that the seams on the ball make as the ball spins. And they group it into what scientists call a chunk,
Starting point is 00:29:24 which is like one signal of all these pieces together, that as soon as the ball is released, it says balls going here, there in the future, swing or don't swing. And that's it. So really what looks like these superhuman reflexes is them picking up on these body cues that they've learned through very specific types of practice. So they need this very large amount of specialized practice
Starting point is 00:29:43 that becomes really, really effective and allows them to insurmount otherwise limited biology. But then if you change the situation just a little where you have the softball pitcher who's throwing underhand, rotation of the torso in the shoulder, totally different, spin of the ball different, they're totally stripped of that expertise that allowed them to do things that are otherwise kind of biologically impossible. So there you see sort of the power of a type of specialized practice and also its fragility when anything changes. That's fascinating. So we're not
Starting point is 00:30:13 actually reacting to the ball itself. They're looking at all these different signals. But this, I assume, is happening subconsciously. They're not going, okay, the rotation of the arm and this or the, It's just happening through practice and years of experience. They're not able to sort of break down what they're looking at, which makes me wonder how the hell they even figured that out in the first place. That's right. So in fact, sometimes if you tell them what they're looking at, they'll do worse. So there's one of the sports scientists I was talking to, he made this joke.
Starting point is 00:30:40 He said, you know, if you want your partner playing tennis to do worse, you should just go up to them and say, like, gosh, you know, the way you angled your forearm on that stroke was really great. What you want to do is get them thinking about it because these processes have to take place in sort of your unconscious mind or they'll be too slow. So yeah, so they don't know at all. And in fact, those Major League hitters thought that they were going to hit softball pitchers. Like, they were as surprised as anyone that they couldn't hit softball pitchers.
Starting point is 00:31:04 So the way this was figured out was through what's called occlusion studies where you block parts of a pitcher's body or you can give someone glasses or they go dark at a certain time and there's all sorts of different types of simulations you can do. You can run different simulations or different real life experiments to figure out what information, what visual information do you have to pull away for the person to become a novice, essentially? And one of the interesting things that came from this is that when the hitters say what it is, like when they do something well and they're asked, like, why did that work? And they tell you they're often wrong. And the scientists can sometimes prove it to them.
Starting point is 00:31:39 You know, they'll say, like, I saw this. And that's why I knew the ball was going here and hit it. You know, they can show them eye tracking data and show they didn't see that. Or they can take that information away and show that it makes no difference to their performance. And so there's this interesting aspect of types of expertise that work subconsciously. The performer is often not well equipped to explain how it actually works. Yeah, we've talked about this on the show before, and I'm trying to figure out where and when it was. I'm trying to remember this. But there's a whole lot of science that shows that our brains will kind of just rationalize
Starting point is 00:32:10 and figure out a reason why we did something. That's not the reason at all. And we're convinced that it is because our brain's like, well, I can't really explain to you, since it's a subconscious process, what's going on and why you did all this? So we're just going to say that you saw a gun and you're like convinced that that's the case. You're not lying.
Starting point is 00:32:27 Your brain's telling you you you saw a weapon or your brain's telling you that this certain thing happened and that's why you reacted in a certain way. And you're convinced that that's reality, but it's just because there's no other way for your brain to kind of communicate that to your conscious mind. And so you rationalize your actions in a certain way. It's not that you're making up a story or anything.
Starting point is 00:32:45 Your brain is doing it to you. You're fooling yourself. Yeah, I mean, people, people don't know why they do what they do is a massive theme of a lot of modern psychological research. Yeah, I find that whole field or that whole idea fascinating because of course it has spillover into marketing, sales, dating. I mean, there's a whole lot of reasons that we can't predict our own behavior and science
Starting point is 00:33:08 can. And that kind of is the crux of the whole thing. And that to me is fascinating because it means that you can program humans to do certain things and they will have no idea why. and they will think it's because of a totally different reason, that you could also give them. Totally. And sometimes we don't, the things that we think we want,
Starting point is 00:33:25 we don't even, right? Like there's this, you mentioned marketing. You know, there's this famous paradox of choice worked by Barry Schwartz where people say, you know, if you ask them like how many choices of whatever, serial or jeans or whatever they want, they say a ton, you know? They'll say a high number, like more choices always better.
Starting point is 00:33:40 And then if you give them all those choices, they're less happy with their experience and less likely to buy something. Whereas if you pare it down to like, Six choices, they're much more, you know, and they're going through the serial island. There's only six instead of 40. They're much more likely to buy something to make a decision quickly and to report being happier about it. So sometimes the things we think we want, I think we actually don't because there's, you know, our logical brain and sort of our unconscious brain aren't always on the exact same page. You mentioned before that Nobel laureates and other scientists are 22 times more likely to engage in totally unrelated fields like singing, acting, fiction writing. There's a famous example of, Steve Jobs taking a calligraphy class or something like that, and that's why the Mac had different fonts. Creative achievers often have broad interest. But how do we know that this isn't one of those
Starting point is 00:34:28 correlation versus causation situations? Like, maybe this is something brilliant people happen to do because they're virtuosos, not that they're brilliant because they do all these different things. How do you know it's one and not the other? Now, I'm sure there is some correlation in there as well. So the first thing I think that it shows is that let's say that's not time on task, so to speak, for them, it shows that that doesn't preclude them from becoming world-changing people, right? So that's the first thing you can say, whether it's correlation or not, it doesn't preclude them from doing this groundbreaking work. But then I think there's a body of other evidence that suggests that it's at least partly causal. So one angle, for example, is that people who have hobbies unrelated to their work have increased
Starting point is 00:35:05 self-efficacy. You know, they feel more confident and capable in their work, and people who have hobbies related to their work have decreased self-efficacy, where they feel less competent and capable in their work. So that's sort of one angle. There's another area of research that tried to match scientists, essentially in engineers in technological fields, mainly tried to match them for like credentials and test scores and all those sorts of things, and then look at their contributions and look at all other factors about them. And one of the things that jumped out was the people that made creative contributions also had a bunch of hobbies outside of work. It's not, can't be perfect, but it was an attempt to sort of match people for other things. And a lot of the people
Starting point is 00:35:39 without hobbies had achieved really high things. They were tenured professors at fancy places, but they had not made the creative contributions of some of their colleagues who had these wide array of interests. And that holds as well in the work of Abby Griffin, who studies the so-called serial innovators, who are people who make repeated creative contributions to their organizations. And the way she describes them, like some of the phrases that appear in her work are, wide range of interests, read more and more widely than their peers, have a need to learn across multiple domains, have a need to communicate with people with expertise outside of their own domain, tend to flit among ideas, which doesn't usually sound like a compliment, repurpose
Starting point is 00:36:14 disparate information in new ways and use things that are already available in new ways, all these things that kind of sound bad sometimes, like they're just flighty. But I think it falls in line with what these other areas of research show. And I think the research suggests, like, by picking up a hobby, I don't think you say like, oh, go take a hobby and that turns you into one of those serial innovators. The way I read the evidence is that it's hard to create those people under any circumstances, but it's really easy to stifle them by not allowing them to pursue these multiple interests. So I think the best you can do is kind of allow the fertile soil and so that you don't stifle those people
Starting point is 00:36:47 and hope that you get some of them. What's the main difference between these people and people who just aren't really good at any one thing? I don't want people to think, great, I'm not good at anything. Now that's an advantage. Thanks, Jordan. I appreciate that.
Starting point is 00:36:59 No, that's a great question. Like the dilatine, right, basically. And this reminds me of some of the research I wrote about on 3M, which has 7,000 inventors, and they have a goal that they usually make of making like a quarter of their profits from products that didn't even exist,
Starting point is 00:37:14 years ago, so they have to be really innovative. They did some interesting research looking at who succeeds at that, innovating over and over and over. And they classified people as generalists and specialists based on the number of different technological classes they had ever worked in, as categorized by the U.S. Patent Office in their career. And they saw that there were generalists and specialists, so generalists had worked in a whole bunch of different technological classes. Specialists had worked in one or two over and over and over. Then there were dilettantes who hadn't worked in that many and hadn't gone that deep in any one. And then there were polymaths who either came in with sort of one area and then sacrificed more depth for breath or went the opposite.
Starting point is 00:37:50 They came in really broad and then sort of homed in on one area. And what they found was that the generalists and specialists both made contributions separately. The dilettantes tended not to, right? So the people who had not gone very broad or very deep just tended not to make contributions. And the very best contributions came from the polymaths who didn't matter which direction they did it, but at some point they sacrificed increasing depth for breadth, but also had kind of an area or two that they could grab onto. So it's sort of that combination that were the people that really made the organization changing and in a few cases, you know, world changing impacts. One of the reasons this is so
Starting point is 00:38:24 concerning is most students, and this includes me, and I went to school 20 plus years ago now when I started college, most students are getting narrow job training for a career that not only they won't ever have, but like no one will ever have, right? I mean, I took a ton of courses on things like anthropology, and I'm not saying they were a complete waste of time, but they sure seem to like it then, and honestly, they kind of seem like it now. And most students, something like 90%, don't get a job in their major. Look, I have a law degree and I'm a broadcaster. So I feel like I'm qualified to say how ridiculous that is. I mean, I was in grad school for geology, you know, and then I became like a sports writer. Yeah. So, yeah, no, that's, as the economist, Brian
Starting point is 00:39:05 Kaplan has said, most kids in college, they're actually getting vocational training, but for a job that almost none of them will have, which is like being a professor of some really specialized thing, And I think the education system just hasn't necessarily caught up, even though with how rapid the transition to an information economy and a knowledge economy and creativity economy was so rapid that I think it's not a big surprise that the various levels of education weren't able to turn on a dime and catch up with that, the way that some areas of industry were. So we're still sort of stuck in preparing people for certain jobs when I think the thinking has to more become how do we prepare people for an uncertain way. work world, basically, so they can be adaptable. And I think in some ways we're going in the wrong direction. So the president, for example, issued an executive order saying that we should expand our apprenticeship programs to become more like Germany. But Eric Hanehach and a group out at Stanford, well, he at Stanford and then a group of international researchers, actually, they looked
Starting point is 00:40:01 at a dozen different countries. Okay, this was really impressive research. They matched people for their parents' education, their test scores, and their own years of education in various countries. The difference was, did they get career-focused education or, like, so vocational or apprenticeship? Or did they get broader general education? And the pattern was that people who got the career-focused education were more likely to be hired right out of training, more likely to make more money right away, but so much less adaptable in a changing work world that they spend so much less time in the workforce overall that they win in the short term and lose in the long run. And the biggest advantage for general education was in Germany, where they have the big apprenticeship program. So there's
Starting point is 00:40:40 this real trade-off between short-term and long-term benefit when you have this really rapidly changing work world. So I think we need to think about what are the kind of critical skills that allow people to adapt to a changing work environment as opposed to, you know, again, that sort of vocational training for a job that nobody's actually going to have. You've written that breadth of training predicts breadth of transfer. So I'd like to discuss that because I think that relates really well. One, it's very anti-Tiger Mom, right? But learners become better at applying concepts to something new that they've never seen before if you've got, I guess, what is it, a wide range of mental models that you use across various disciplines?
Starting point is 00:41:16 Yeah, and so that saying is sort of a summary of some classic findings in psychology. Breth of training predicts breadth of transfer. What that basically means is that transfer is taking knowledge that you have and applying it to problems that you have not quite seen before. Again, if your job is like basically the same thing every day and year after year, transfer is not that important for you in your work. but that's not the case for, I think, most of us and an increasing portion of us.
Starting point is 00:41:41 And so the breadth of training, like the diversity of the problems you face, and by the way, this goes for physical and cognitive skills. So the breadth of problems you face in training predicts your ability to take those knowledge or skills and apply them to situations you haven't seen. So if we think of the sports context, one of the reasons I think, like if you go to Brazil, you know,
Starting point is 00:41:59 or Argentina or wherever, you see the kids, they're not playing soccer, like on full fields the way American kids are. They're playing footsall, which is this game that's like small ball stays on the ground. They're playing on cobblestones one day, sand the next day, you know, in an alley, whatever. And so they're all tightly grouped around each other because it's a small space and it's like a different playing surface and area all the time. Within the game, they're facing this incredible diversity of problems. And so I don't think it's a big surprise that like basically all of the greatest players grew up playing that because they had this incredibly broad training for that type of problem solving early that makes you creative later on.
Starting point is 00:42:34 And that's held in research on in military responding to like various types of scenarios to just learning math. And that seems to hold in a whole host of areas where you want to diversify the problems you've faced. And it forces you instead of relying on known procedures to build these conceptual models that you can then apply and mold to situations going forward. We see something like this are akin to this. And I'm not sure exactly what the word I'm looking for is, but musicians who can't read
Starting point is 00:43:04 music but are self-taught. Many of these amazing folks learn to read music later. But what's that musician's joke? Like, can you read music? No, not enough to hurt my playing. It's like a jazz musician joke. So they can't produce a specific note on command because they're just playing by ear. But the takeaway here can't just be don't learn the specifics of your craft. So what sort of component are we looking at here? Yeah, I think it's a question of the way that you learn it. Right. And so one of the interesting things about jazz musicians is it turns out, and a lot of the teachers I talk to that it's a lot to teach a jazz player to play classical than to teach a classical player to play jazz. And so I think this is one of those areas where some scientists call it learning like a baby is a good thing, where instead of
Starting point is 00:43:44 trying to teach the grammar first, you know, like the reading first and the technique first, you let someone develop their ear and sort of be immersed and let them try to problem solve with their ear. And that's very slow, right? It's really slow. They're not going to progress as fast as someone who has a teacher who just says, do it this way and this and this and just tells you the steps. But it sets them up in a way to be, incredibly flexible. They're still learning those skills. They're just not learning them in the same way. They're having a desirable difficulty, right? They're being thrown in and they have to struggle and try to learn instead of being told what the answer is and repeating it over and over and over. And so, like, think of the way that you learned your native language compared to the way you might have learned a
Starting point is 00:44:24 foreign language, assuming it wasn't immersion, right? Somebody starts teaching you the grammar first and you're like trying to think how to apply it instead of getting an ear for it and speaking first. And so I think that kind of holds in the music realm as well. The problem is it's slow. Again, right? It slows you down to learn that way, even though it gives you some powers that you won't have otherwise. It seems a little bit counterintuitive here because if you're starting something new, shouldn't you get a coach that shows you the basics and helps you avoid big mistakes? Or is it better to self-teach? Now I'm confused between these two methods. I think it depends what it is. Again, if it's something like golf, that's this sort of pretty static endeavor for the most part, that is largely based on doing
Starting point is 00:45:04 the same thing over and over without deviation. And known ways to do it. I think technical coaching there, like, you need it, absolutely. In situations that are more improvisational and more creative where you're going to need to think on the fly and you're going to need to come up with things that the coach can't just tell you,
Starting point is 00:45:22 that's where I think it's much more up to the coach to set up situations that kind of force you to do self-teaching. So it's not that they're just like totally hands off, although I think a lot of unstructured activity or learn or lead activity is a good thing, but I think they help you set up a scenario where you're forced to do some of that self-teaching. I know that when you're self-taught, you experiment more,
Starting point is 00:45:41 and my producer has been able, for example, to solve some complex audio problems that audio engineers I've asked to solve those same problems can't seem to solve. That's interesting. And he solved it through running different plug-ins on the audio that were for, like, horn instruments. He just ran a bunch of them.
Starting point is 00:45:58 And was like, oh, this sounds better, right? And I was like, yeah, what is this? And he's like, it's a saxophone, plug-in or something. And it's just like, wait, what? And the audio engineers that I had hired to try and solve this, they were really confused. They were like, hey, this is probably the best it's going to get. I ran all these vocal plug-ins on it and changed this and that and the other thing. So they went for a really complex solution that didn't sound as good as another producer of mine just mucking around with it. And that I thought illustrates this point really well, when
Starting point is 00:46:25 you're self-taught, you experiment more. But again, if something's more kind of a matter of artistic perception, which listening really is, you know, does this sound clearer or not, is not something, you know, most of us would be able to measure without just listening. Yeah. So maybe it works for things like that. But yeah, probably wouldn't work for chess, right? Yeah. No, chess, you, they're like, I don't know, 17, 18, something like that, Grandmasters, I think,
Starting point is 00:46:50 under the age of like 15 or 16 ever. And the oldest one is probably like 40 or something like that. I mean, I'm estimating here. So that's very much a modern phenomenon, and that's because of the rise of computer chess, which allows this pattern study much earlier, right? And it shows you, was this right or was this wrong, basically? And again, that's also the reason why, like, a free app on your iPhone can beat the best chess player in the world,
Starting point is 00:47:14 is because it's so much based on known pattern recognition. And so, you know, for things that are like that, that are really amenable to that, you probably don't want to be a human, that are the most amenable, this kind of early specialization where you do the same thing over and over. you probably don't want to be in that area that much longer because they'll be automated. With respect to your audio engineer, my prediction would be that he could learn,
Starting point is 00:47:35 you know, the technical stuff that the more formally trained audio engineers learned easier than they could learn to do what he's doing because they sort of have to undo some of it because they've probably learned that tools are used in certain ways now, right? Whereas he's been a tinkerer. And so for him, tools are used for problem solving, not only in certain ways.
Starting point is 00:47:52 I bet he'd be able to learn what they do easier than they'd be able to learn what he does. So these short-term struggles, plus long-term gains, that's sort of the deep learning formula. We even have something called the generation effect where struggling to generate an answer, even if it's a wrong answer, enhances subsequent learning. This sounds a lot like law school,
Starting point is 00:48:09 where they just ask you a question that's going to not yield the correct answer because you don't know or nobody knows. And the whole class is just spending the next 45 minutes making educated guesses, and you come away with a better understanding of the concept. Is that kind of what's going on here? Yeah, yeah.
Starting point is 00:48:25 I mean, also like, you know, Socratic teaching, and stuff like that. So the generation effect is this, and the reason it's called the generation effect is because the effort of trying to generate an answer, no matter what it is, primes your brain essentially to retain the information when you do learn it. And in fact, if you're really confident of a wrong answer, you're even more likely to then retain the right answer. It's called the hyper-correction effect when you learn the right answer. So really what we should do when we're studying something, for example, instead of just going over it or highlighting it or whatever, even if you are going to get everything wrong, you should quiz yourself on it. And like, actually,
Starting point is 00:48:57 actually try to come up with an answer. That's like not a very fun thing to do to jump in and test yourself when you're clearly not ready and actually try. It's a little painful, but it might feel counterproductive, but actually it really primes you for retention. You're listening to the Jordan Harbinger Show. We'll be right back after this. Thank you for listening and supporting the show. Your support of our advertisers keeps us on the air. To learn more and get links to all the great discounts you just heard, so you can check out those amazing sponsors. Visit Jordan Harbinger.com slash deals. And don't forget the worksheet for today's episode. That link is in the show notes at Jordan Harbinger.com slash podcast. If you're listening to us on the Overcast player, please
Starting point is 00:49:38 click that little star next to the episode. We really appreciate it. And now back to the show. One of the ways this was studied was these monkeys were getting hints, which decreased their performance on memorization tests over time. I got to stop here and say, I'm just impressed that monkeys can take tests that involve requesting hints. That's amazing. What the hell is that? What's going on here? That alone was mind-blowing. The results be damned. I don't care. How are monkeys requesting hints on a memorization test? I know. I watched some video of this. It's pretty impressive. So this was these studies in Rhesus macaques, you know, which are relatively close ancestors of humans, where they were being trained to memorize lists in order. And it would be
Starting point is 00:50:19 like all these random pictures, you know, like a tulip and a goldfish and Halle Berry and some clouds or whatever. And they would come up on this digital screen and they would, you know, touch it. It was a touchscreen. And so they were supposed to learn the order. that these things should come up with in a whole bunch of different lists. And there was an area that they could hit that would show them what was next if they couldn't figure it out, if they wanted to get a hint. And sometimes when they were training, they could take hints whenever they wanted if they were stuck and they couldn't get the next one right.
Starting point is 00:50:45 They could take a hint whenever they wanted. In others, they were forced to take hints a lot of the time. In others, they only were allowed to take hints about half the time. And then in others, they weren't allowed to take hints at all. So they just had to like start hitting stuff by trial and error to figure out what the right order was, you know, and then try to remember it, basically. And so basically the pattern of results was, so they did this over and over and over and over, like hundreds of times on these various lists. And then they had kind of test time came around. And the pattern in practice was the fewer hints
Starting point is 00:51:13 they had, the worse they did. And then when the test came around, it was completely, where there were no hints allowed in the test. It was completely reversed. The lists that they had totally flopped on in practice where they had no hints, they did by far the best on the test. And the list where they had tons of hints where learning was easier, they totally flopped at on the test. And so this was just this, I thought, a fun example of something that's been shown the same in humans, which is that excessive hint giving, we like to, and I think we often don't even think about it. Our teachers often give us excessive hints or we, you know, find ways to give ourselves hints instead of kind of really struggling going forward. It really undermines your learning.
Starting point is 00:51:53 And so, you know, in some of the research I talk about in that chapter in range is really in American classrooms. or in classrooms around the world, but I sort of focused in on American classrooms that look at how students in pursuit of right answers in class often lead their teacher. I was almost going to say trick, but they're not doing it on purpose. They lead their teacher to give them hints in a way that undermines the learning.
Starting point is 00:52:15 And so that's a real problem. So we need to have methods of teaching where the teachers are aware of what's going on such that they don't give hints that undermine the learning process. Oh, that's interesting. I never really thought about that. But now that you mentioned it, I think half of classroom discussions
Starting point is 00:52:29 are sort of spent probing the teacher to correct you on something or- Exactly. You're just trying, because you don't wanna be wrong in front of 90 people, especially in law school because it's kind of a hyper-competitive environment
Starting point is 00:52:40 in the first place. So you don't wanna say something that's wild out of left field. So you either hide and don't participate or you spend a lot of time asking clarifying questions, which are just sort of like hail Mary's to try to get the teacher to say something that prompts you to get the right answer
Starting point is 00:52:56 so you look smart. I mean, once I started, I was watching video of this in classrooms with someone who researches this. And, you know, once she told me about it and I started seeing it everywhere, you realize groups of students are incredibly adept at working together just spontaneously to get hints from a teacher in one way or another. And in a way, they can totally undermine the learning process. And they're just trying to get to the right answer, right? They're just being expedient about trying to get to the right answer. But it has this effect of undermining the learning if the teacher doesn't sort of. of know these principles.
Starting point is 00:53:27 Yeah, that's fascinating. I find that a lot of school can be gameed, which is not necessarily to the advantage of the student, but also almost has to be done, because I think smart students are gonna game any system. Like, that's kind of the point, right? Maybe not the point, but that's gonna happen no matter what. You really have to be careful with that.
Starting point is 00:53:47 So you're right, training a teacher to spot that and not give in, because it's not even that these students are being crafty and trying to hack the process and be tricky. It's just some sort of human nature to not want to look bad and therefore try to get whatever advantage you can. And also it's the fact that we have this cognitive bias where fluent learning or learning that feels to us like we're just making rapid progress and coasting, we rate that as good learning
Starting point is 00:54:11 and we rate that if we feel like the learning is easy, we think our teacher is good and we think that we're learning a lot and it turns out to be the opposite. It's that feeling of ease is just a feeling of ease and it tends to be inversely correlated with how good the teacher is and how much you're actually learning. So I think part of it is just this, we're pursuing something that feels like good learning. It just turns out that it's not. One of the examples in the book is J.K. Rowling, who was this epic failure, kind of broke teacher on welfare and really feeling unfulfilled.
Starting point is 00:54:43 And she makes the switch to novelist writes Harry Potter and dot, dot, dot is I think like a billionaire now, which is pretty reassuring for those of us who feel stuck in our career or a dead-end job. But how do we know when to switch? this pick and stick mentality, and it's not necessarily the best way, even if it's trendy, but leaving something behind isn't always a lack of grit. Can you speak to that? Because grit is trendy, pick and stick is trendy. And now you're saying, hey, don't specialize too early, which is kind of the opposite. Or it seems like it might be the opposite of those concepts. Yeah. So let me give a study that sort of gives an example of this, which is his
Starting point is 00:55:19 economist who found a natural experiment in the higher ed systems of England and Scotland. What he saw was that the systems were really similar in the period he studied. The difference was the English students had to specialize in their mid-teen years to apply to a specific course of study. Scottish students could keep sampling stuff throughout university if they wanted to. And his question was, who wins the trade-off, the earlier of the late specializers. And what he saw was the early specializers jump out to an income lead because they have more domain-specific skills. The late specializers get to try more different things, and when they do pick, they have better fit, or what economists call match quality. That's the degree of fit between your
Starting point is 00:55:53 interests and abilities in the work that you do. It turns out to be super important for your sense of fulfillment, your performance, and your persistence. And so they had faster growth rates. So by six years out, they fly past the early specializers. Meanwhile, the early specializers start quitting their career tracks in much higher numbers because basically they were made to choose so early that they more often made poor choices. The late specializers lost in the short term, but one in the very long run. And I think that is emblematic of certain results that are relevant to grit. Because a lot of the grit research has been done on people who were already selected for a certain short-term goal, basically. So finding the right thing to be doing isn't part of the study. So the most famous Grit study,
Starting point is 00:56:31 so Grit, just quick refresher, psychological construct, based on a 12-question survey, half the points are given for persistence of effort and the other half of the points for consistency of interest. So, you know, I overcome setbacks on the one hand, and I don't change my interests or I don't ever leave something before I finish it. And the most famous study was in West Point, where it found the Grit survey was a better predictor which West Point cadets would get through what's called Beast Barracks, which is like this six-week, very rigorous orientation at the U.S. Military Academy. And that's great. That's a good thing to know. Grits also helps predict who will graduate. But the point of West Point isn't to get beast survivors, it's to get
Starting point is 00:57:05 the future leaders of the U.S. Army. And since about the mid-1990s, about half of those gritty cadets have been quitting the day that they are allowed. So what happened? Did they lose their grit all of a sudden? That's initially what, you know, what some high-ranking officers says they've developed a millennial grit problem overnight. Too much avocado toast, not enough mortgages or something. But these people had scored in the highest percentiles of grit. The problem turned out to be when they studied it, that the Army still had this very strict up or out. You know, you're assigned to a career track, get up or out career structure. And in the transition to a knowledge economy, now there's, we prize people who can engage in knowledge creation, problem
Starting point is 00:57:39 solving. And so they have tremendous lateral mobility that you didn't have when we were a more specialized economy where people faced more repetitive challenges. And so these young people, would learn stuff about themselves in their early 20s and realize they have no agency over career matching in the Army so they would go outside. So the Army, at first they started throwing money at people for retention bonuses and the people were going to stay anyway, took it, and the ones who were going to leave left anyway with half billion dollars, taxpayer money didn't change retention at all. Then they started programs like one called talent-based branching, where instead of saying, here's your career track, get up or out, they'd say, here, we're going to pair you with a coach
Starting point is 00:58:12 like mentor, you try this one career track, reflect on how it fits your interest and abilities with your coach. You keep track of that in an online portal. Then try this other one and these three others. You know, you'll try five, six dip your toes in different careers. As the cadets went through this, they were often surprised about what their strengths or weaknesses are. They were tracked in research. 90% of them who went through talent-based branching changed one of their top two career preferences, 90% of them. Because you don't know before you get to try stuff, or my favorite quote in range is, we learn who we are in practice, not in theory. You actually have to do stuff and then reflect on it. And it improved retention. Because as one researcher told me,
Starting point is 00:58:45 you get fit, it looks like grit. If you get someone in work that fits them well, that has high match quality, they will display characteristics of grit like hard work and persistence, even if they didn't before. And so I think we often undervalue the impact on performance and fulfillment of getting a good fit. And the only way to do that is to be allowed to try some stuff and learn about yourself, because otherwise your insight into yourself and your options is constrained by your previous experiences. So I think we need to balance our fervor for grit with systems that help people find fit. This speaks to me because I always feel like a late bloomer, right?
Starting point is 00:59:20 It's like I went to school and then I went to college and then I went to law school and then I quit that and I started a podcast and I started this other company and now I'm doing the interview based podcast and like, oh man, I'm 40 now. Like, what if I'd started this when I was 17, which is unrealistic or, you know, also just probably everybody thinks that about everything that they're doing right now. And then in 10 years, I'll be like, what if I had started that when I was 40? you know, who knows. But if we treated careers like dating, few of us would settle down so early in life, and yet here we are. No one's like, hey, you should get married, you're 17. You've got to pick
Starting point is 00:59:55 a partner and get after it and start having kids. Yes, there are some maybe religious cults that do that. Works for some people, right? But not for most people. Just not for most people, right, exactly. And people who feel fulfilled often pursue a long-term goal, but they only do so after a period of discovery. And that's a study, I think, from your work as well. So it's risky. then to commit early to a law degree or to medicine because it's so expensive both financially and in terms of time and you've done none of the discovery that you really need to do most likely unless you spent your entire childhood working with your dad and grandpa in their medical office or their law office or something like that and you're just like, I was born for this, right?
Starting point is 01:00:36 But few of us have seen the inside of a law firm before we're graduating from law school. Yeah, and usually you'll find out that you're not born for it. I mean, that's what happened with me when I went into science. I was like, I was hoping to find out that this was what I wanted to, you know, work in the lab for the rest of my life. And I found out that that wasn't what I wanted to do. You know, I found out when I was living up in a tent in the Arctic that I was, you know, start asking myself, am I the type of person who wants to spend my whole life learning one or two things new to the world that are pretty esoteric. Or much smaller spans of time learning things new to me and kind of synthesizing them and sharing them.
Starting point is 01:01:05 And I realized I was the latter. And I didn't realize that until, you know, I kind of had a chance to try those things. And so I think what you were just saying was very eloquential. basically summarizing what's called the Dark Horse Project by these two researchers at Harvard that studied people who found fulfillment in their work. A lot of these people were very materially successful also, but the dependent variable was fulfillment. But they often were also very successful in objective ways. And what these people sort of had in common, the reason is called the Dark Horse Project. It wasn't called that at first was that in their informational interviews, people would come in
Starting point is 01:01:35 and say, well, don't tell people. And these were like piano tuners, animal trainers, pro athletes, like, you know, writers. It ran the gamut of different occupations. They would come in and say, well, don't tell people to do what I did because I kind of started in med school and that wasn't for me and I left and I did this other thing and finance and that I really didn't like that. And so I bounced around and eventually had to start my own thing and so, you know, I really came out of nowhere. And not everyone. There were some people who followed a linear trajectory, but the large majority of the people in the study saw themselves as outliers because they didn't follow a linear path. That's why they called it the Dark Horse project because all these people who thought like they were the oddball, right, who had done something and didn't stick with the first thing they'd. did, but that actually turns out to be the norm for people who find high match quality in their work. I believe you mentioned this in the book as well, which I find fascinating. This is such a great way to phrase this, too. There's so much personality change between the ages of 18 to 29 that if you specialize early, what you're actually doing is trying to match a career path with a person who doesn't actually exist yet. And that is the life story of probably almost everybody in my law
Starting point is 01:02:40 school for sure and possibly just every university grad who trained for any sort of career before the age of 23 or whatever, however old we were at that time. Yeah, it's kind of interesting, right? That finding you're referring to is called the end of history illusion. So it's this finding that at every time point in life, we all recognize that we've changed a lot based on our past experiences. But then we think, but now I'm pretty much who I am. I'm not going to change that much in the future. And we're wrong at every time point in life. We always underestimate future change. And the fastest period of personality changes that 18 to the late 20s. And that's the period when we're usually pressuring people to figure out exactly who they are and what they should be doing.
Starting point is 01:03:16 It's not to say they don't have to do something, right? But I think we should be more open about it and view it as this evolutionary process over their life. Because if you recognize the personality, and this goes for everything, this goes for your values, the way you like to spend your time, what you look for in your friends, how you want the world to be, what you think your strengths and weaknesses are, like all these fundamental things about yourself. that people think are fixed, turn out to change a tremendous amount and most rapidly in late teens and 20s. And so I think we just need to think about the path as something where we should be continually zigging and zagging in search of better fit as opposed to looking for the one thing
Starting point is 01:03:52 where the light bulb's going to turn on. And, you know, that's it. This is my thing for the rest of my life. That may happen organically. And if it does great, I think don't force it. That's what I think. Now, take small risks, take small bets, test things, don't just pick some romantic grand plan. Easier said than done, because we're sort of telling kids that they need to pick what they want to do, pick a major, what do you want to be when you grow up. And then, of course, your data's like, actually don't even worry about that. Maybe just do some experimentation so you don't have what I guess would be termed premature optimization. But the message from society is the total opposite, unfortunately. Yeah, I mean, setting up these experiments, and that's an idea I should give, wasn't my idea,
Starting point is 01:04:31 from a woman named Herminia Ibarra who studies how people change careers and find good career fits. And what she suggests is she said people don't, you know, they don't tend to stick to these very long term, the longer term the goal, the less likely they are to stick with it. And the less likely they are to be happy with it as time goes on anyway, because they change, so their goals get adjusted. And so what she suggests is setting up these experiments. Like, here's something I want to learn. Here's something I want to see if I'm really interested in. I want to see if I feel like I'm good at. And so you should set up these specific experiments, like take a class, meet, someone in another field, whatever, go to something where you think you'll be uncomfortable,
Starting point is 01:05:05 and be like a scientist of yourself. You know, what's your hypothesis? I'll be good or bad at this. I'll like or won't like that. And then find a way to go test those things. And so have that self-knowledge as you go forward, I think is a good way to progress. And by the way, some of these things we've been talking about, I think show up sort of naturally in some people who have really successful career progressions. Like LinkedIn, they shared some data with me. And also they have these, you know, incredible databases, obviously. And they did research on half million members and found that the most powerful predictor of who is going to go on to become an executive was the number of different job functions that someone had worked across
Starting point is 01:05:42 in their career, the number of different job functions. So the main advice from the principal economist at LinkedIn was, for those of you want to become an executive's, work across a lot of different job functions during your career, especially earlier in your career. But we don't really usually tell people, I mean, I guess the chief economist in LinkedIn is, but we don't, we don't usually tell people to do that, right? You're like, get out there and work across a lot of lot of job functions. No, it's like find your little specialty and drill deeply down into it. So one of the things I've found is that the people who take this message the easiest are executives because they tended to get there that way anyway. So they sort of are like, oh yeah, well, yeah, of course.
Starting point is 01:06:14 So don't specialize too early. Don't believe the hype, right? If anyone's asking you, what do you want to be when you grow up? You know, you can say whatever you want, but when you think grow up, you should be thinking, what, 30 plus? How do we outline this plan for ourselves? You know, if you had to do it all over again, what would you do? What would you recommend for your own kids? I would definitely go to geology grad school again and then become a sports writer. No, I'm just kidding. I think the way that I would, you know, and I'm a new parent actually, approach this, is like something we talked about earlier, like the Army's talent-based branching process. I know it doesn't sound good to link in my parenting strategy to the Army. But, I mean, I view myself as sort of in that the role of the coach-like mentor in that process where I'm going to expose my kid to a variety of different things. So it's always a limited menu for anyone. And then instead of force them to pick something, I'm going to try to help. him get the maximum amount of signal of what he's good at and what his options are as he tries those things. Right. So get the maximum amount of learning out of each of those steps. It's got self-regulatory learning, by the way, which is the people who do score to the best
Starting point is 01:07:13 learning and get off plateaus. They spend a lot of time in reflection about their strengths and weaknesses and what they learned or didn't from an experience. So I think that's really the best thing I can do is facilitate opportunities, make sure the maximum learning comes from those things and just keep helping my kid do what that great quote from Hermionei Abara, learn who he is in practice, not in theory, right? You can't sit around and introspect. Like there's this whole industry of self-help stuff that suggests you can take a quiz or just introspect
Starting point is 01:07:39 and think of what you should do and go forth and do it. But in fact, the reality is all the research shows that you actually have to go try stuff might not work out. Then you reflect on that. So you do and then think instead of the other way around. And you keep doing that and you keep increasingly triangulating a better place for yourself.
Starting point is 01:07:57 David Epstein, thank you so much for doing the show. especially given that you had to travel somewhere in the midst of all this coronavirus craziness. I really appreciate your time. And this is, it's interesting. And it's a nice relief, I think, for a lot of folks to not have to specialize early. Or if you're 29 and you don't have your entire career passion path laid out before you already that you're not really late. Yeah. And your skills are never wasted, right? It didn't occur to me. But again, when I came from geology grad school, then I ended up at Sports Illustrated as a temp fact checker. I'm six years older probably than the people that I was doing like menial work for, and then pretty quickly
Starting point is 01:08:31 realized that it was that science background that actually set me apart. So it took something that was ordinary in one context. Then you move it to a context where suddenly it's extraordinary and it becomes an advantage. So don't think of your prior experiences as wasted, even though you're always set back in certain ways when you make a transition, but your growth rates can become faster. Thank you very much. Thanks for having me. Big thank you to David for coming on today. His book is called Range, Why Generalists Triumph in a specialized world. Of course, there'll be links to that in the show notes. And please, if you do buy the book, use the links on the website at Jordan Harbinger.com because it does help support the show.
Starting point is 01:09:09 There are also worksheets for each episode so you can review what you've learned today here from David Epstein. We also now have transcripts for each episode, and those can be found in the show notes as well. I'm teaching you how to connect with great people and manage relationships using systems and tiny habits over at our six-minute networking course, which is free, over at Jordan Harbinger.com course. Dig the well before you get thirsty. The number one mistake I see people making is not digging that well, not making those relationships until they need them. Build your network before you need it, even if you think it means starting from scratch. The drills take just a few minutes per day. Find it all for free at jordanharbinger.com slash course. And by the way, most of the guests
Starting point is 01:09:50 on the show, they subscribe to the course and the newsletter. So come join us. You'll be in smart company. In fact, why not reach out to David and tell him you enjoyed this episode of the show? Show guests do love hearing from you and you never know what might shake out of that. Speaking of building relationships, you can always reach out and or follow me on social. I'm at Jordan Harbinger on both Twitter and Instagram. This show is created in association with Podcast One. This episode is produced by Jen Harbinger and Jason DeFilippo, engineered by Jace Sanderson, show notes and worksheets by Robert Fogarty, music by Evan Viola.
Starting point is 01:10:21 I'm your host, Jordan Harbinger. Our advice and opinions and those of our guests are their own. And yes, I'm a lawyer, but I'm not your lawyer. I'm sure as heck not a doctor or a therapist. So do your own research before implementing anything you hear on the show. And remember, we rise by lifting others. The fee for the show is that you share it with friends when you find something useful or interesting.
Starting point is 01:10:41 So if you know somebody who's worried about being behind the curve or has specialized in something or is telling their kids to go do that, well, share this episode with them and see if they don't change their mind. Hopefully you find something interesting in every single episode of the show. So please do share the show with those you love. In the meantime, do your best to apply what you hear on the show so you can live what you listen. And we'll see you next time. This episode is sponsored in part by Something You Should Know podcast.
Starting point is 01:11:06 Finding a new great podcast shouldn't be this hard, so let me save you some time. If you like the Jordan Harbinger show, you'll probably like Something You Should Know with Mike Carruthers. It's one of those shows that makes you smarter in a practical, useful way. Same curiosity vibe we go for here, just in a fast, focused form. Matt, Mike brings on top experts and asks the exact questions that you'd want to ask, and the topics are all over the place in the best way. Recently, they've covered things like why we care so much what other people think, the benefits of laughter, why sports fans get so invested, and what makes people like you or not.
Starting point is 01:11:36 The through line is always the same. Smart ideas you can actually use in real life. Something you should know has been featured in Apple's shows we love, and it's got thousands of five-star reviews because it's consistently interesting. So if you want another show that scratches that I want to understand how people on the world really work itch, search for something you should know wherever you get your podcasts. Look for the bright yellow light bulb and start listening. You can thank me later.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.