Hidden Brain - The Halo Effect

Episode Date: October 19, 2021

In 1978, Judy, Lyn and Donna Ulrich were driving to a volleyball game when their Ford Pinto was hit from behind by a van. The Pinto caught fire, and the three teenagers died. This week, we revisit a 2...020 episode with a former Ford insider who played a key role in weighing the risks associated with the Pinto. And we consider what his story tells us about a question we all face: is it possible to fairly evaluate our past actions when we know how things turned out? If you like our work, please consider supporting it! See how you can help at support.hiddenbrain.org. And to learn more about human behavior and ideas that can improve your life, subscribe to our newsletter at news.hiddenbrain.org.

Transcript
Discussion (0)
Starting point is 00:00:00 From NPR, this is Hidden Brain, I'm Shankar Vedantam. It's a summer evening in Northern Indiana. Three teenagers are in their car, headed to a church sponsored volleyball game. It's 1978. The three Ulrich girls, sisters Judy and Lynn and their cousin Donna, drive down US-33 in a Ford Pinter. Judy is behind the wheel. She's 18, a recent high school graduate. Two years older than her little sister Lynn. Donna is also 18. Around 6.30, Judy slows down. She's worried she might have left the cap to the gas tank on the trunk. She puts on her hazard
Starting point is 00:00:46 lights. A few seconds behind the pinto on the same road, Roger Dugger is driving a Chevy van. He is looking for a cigarette pack on the floor. When he looks up, the slowing pinto is right in front of him. He's going about 50 miles per hour, and he doesn't have time to stop. At first, Roger doesn't think the crash is that bad. Then, he smells gasoline. Later, reporters will recount testimony from a third driver who saw what happened. There was a puff of flame about 12 to 18 inches long at the rear of the car. Almost immediately, the pinto explodes into flames. He said it was like a large napalm bomb going up.
Starting point is 00:01:40 Is it creamed down the highway and finally came to a stop. It was burning all the way. The eyewitness gets out of his car with a fire extinguisher and runs over to see if he can help. But he said the temperature and the heat was so intense that it was too hot to stay close to the car for very long. By the time the first state trooper arrives, the pinto is scorched. Inside the car, Lin and Donna are dead. Judy is outside alive, but badly injured. She's taken to a burned unit at a nearby hospital. She lives for about nine more hours.
Starting point is 00:02:20 Before she dies, Judy tells the police what happened. She also asks the nurse if her sister and cousin are okay. The nurse tells her they lived. Six months later, Judy and Lynn's mother get something in the mail from the Ford Motor Company. It's a recall notice for the car her daughters were killed in. The Ford Pinto. Today, we speak to a Ford insider who has asked himself a painful question.
Starting point is 00:02:57 Should he have done more to get the Pinto off the road? Certain circles on the certifiable villain, guilty of not protecting innocent, unsuspecting people, driving a patently dangerous car. This week on Hidden Brain, the minefield of hindsight bias. While knowing how something turned out, shapes the way we think about everything that came before it, and the insidious effect this has on our lives. Our story today starts with long ago events,
Starting point is 00:03:38 but it's not really about the past. It's about how, in the present, we think about the past, about the profound bias that shapes such thinking and the effect this bias has on our lives. We begin in 1970. The American car industry was dominated by a handful of major companies. There was General Motors, there was Chrysler, and there was another big one. Ford. There was General Motors, there was Chrysler, and there was another big one. Ford.
Starting point is 00:04:06 What makes Mustang number one? Prisonality. Elephants. For a new decade. The 1970 Thunderbird. Ford, the wagon master. But the new decade marked the end of an era of carefree car buying in America.
Starting point is 00:04:22 of an era of carefree car buying in America. The country was shedding its innocence. Young men were being drafted into the Vietnam War, and the Nixon administration would soon be marred by scandal. Two books, Rachel Carson's Silent Spring, and Ralph Nader's unsafe at any any speed were in the zeitgeist. More and more, cars were seen no longer as a symbol of freedom, but as a social problem. American car companies felt on the siege from federal regulations at home and competition from abroad.
Starting point is 00:05:03 Consumers were turning away from American cars to Mercedes-Benz's from Germany, sleek jaguars from Britain, and small, fuel-efficient Toyota's and Honda's from Japan. In 1969 alone, one million cars were imported into the United States. If American car companies wanted to keep up, they needed to match what their competitors were offering. Ford's answer was an inexpensive, fuel-efficient, subcompact car, the Pinto. This is an advertisement introducing the car. It shows a fall, presumably a Pinto horse, alone in a field.
Starting point is 00:05:56 The horse gets to its feet and gallops around a banana yellow Ford Pinto car. The commercial introduces a slogan for the car that would only become ironic later on. The little carefree car. Ford's president at the time, Leia Eccocca, had pushed for the Pinto when he was still a vice president of the company. He was set to have called the car, his baby. The company codenamed the car his baby. The company codenamed the car Phoenix. Again, the irony of this nickname would not be evident until much later. To boost gas mileage and reduce costs, the
Starting point is 00:06:55 Pinto had a stripped down minimalist design. Cars usually have a steel frame that supports the engine, the transmission, the wheels and so on, and a body that goes on top of that. But the Pinto had just one piece. The body was the frame. Executives at Ford were said to have mandated that their employees build a car that weighed 2000 pounds and cost 2000 dollars. Then, in 1973, something happened that made the Pinto a bonafide winner for Ford. The OPEC nations have decided to cut oil production by 5% and continue cutting their oil production by an additional 5% each successive month until Israel withdraws from occupied-hour blends. And the rights of Palestinian refugees is restored. In October, the Organization of Petroleum Exporting Countries, OPEC, slapped an embargo on oil ship to the United States.
Starting point is 00:07:57 The move was in response to US support of Israel during the 1973 Arab-Israeli war. Soon, they were major oil shortages in the United States. The price of gas skyrocketed. Because of the fuel shortage, General Motors has ordered additional layoffs affecting thousands of workers. President Nixon even announced a new limit on interstate highway speeds. I have called upon all the American people to drive their cars at 50 miles per hour. Interstate Highway Speeds. maybe a little longer to make the trip to see your mother-in-law. Maybe that wasn't a good idea. You wouldn't mind taking a little longer. The oil crisis disrupted American life in ways that ranged from the serious to the absurd.
Starting point is 00:08:54 There's a governor who's wearing long johns, there's a professor in Georgia who says that if we change the whole television schedule, make it earlier, people will go to bed earlier and save lights. And a Michigan restaurant man wants his customers to ride horseback to dinner and he says, if they do, he'll might throw in a bucket of oats with the meal. All of this meant that Americans started to covet small, cheap cars with excellent gas mileage, like the Ford Pinto. Sales took off and the Pinto became crucial to Ford's bottom line. But the decade that followed would not end well for Ford or the rest of the US car industry.
Starting point is 00:09:39 For the Pinto, its PR troubles began with a recall campaign led by Ralph Nader and a series of journalism exposés. The most widely referenced of these was a 1977 feature in the magazine Mother Jones. The article told the story of a woman and her 13-year-old passenger who suffered a fiery, rear-end crash involving a pinto. The woman was killed and the boy was severely burned. The mother-john's reporter, Mark Dawi, claimed this was not an isolated incident. We estimate that 500 men and women and children have burned to death in Pinto's over the past six years who would not have been seriously injured if the car had not burst into flames. That number, at least 500 deaths since 1971, or slightly more than 80 deaths on average per year, has been hotly debated.
Starting point is 00:10:34 At the time, NPR reported that Ford said the number was pure exaggeration. In 1975, there were 848 deaths associated with passenger car accidents in which fires also occurred in some parts of the vehicle. Only 12 of these 848 reported fatalities involved occupants of pentose. Later, Ford would say pentose had been involved in 35 cases of rear-impact fires. Those fires, the company said, resulted in 23 burn injuries and 21 deaths. An investigation by the National Highway Traffic Safety Administration came up with similar numbers, 24 burns and 27 fatalities. Today, it's still unclear how many people died or were injured in these crashes. Mark Dauy made other charges against the company too.
Starting point is 00:11:33 He wrote that Ford had rushed the Pinto into production, coming up with a new model in just over two years, when that process usually took closer to 3.5 years. That shortened time frame, he wrote, had consequences. For one, because of the accelerated schedule, crash testing happened after the basic design was pretty much set. According to the Mother Jones story, these tests revealed that the Pinto was vulnerable in low-speed rear end crashes. Over the years, multiple news organizations, including NPR, have highlighted potential problems with the Pinto's design. Instead of installing the tank to the front of the rear axle where the car's back wheels were mounted, it was placed behind the axle. There is virtually no crush area between the back of the car and the back of the gas tank. Just a few inches of damage to the back end of the car brings the metal of the car or
Starting point is 00:12:35 the object that's producing the impact right up against the gas tank. Some have argued that the Pinto's design wasn't much different from that of other small cars being produced by American car companies. But there was one feature that made the Pinto stand out from the herd, the studs. They're up at the top of the tank. They are again directly ahead of the splash pan on the back of the car with no protection whatsoever. They're one of the first things that actually gets hit, but they're designed in such a manner that as they bend forward, they can be pushed through the rear of the gas tank,
Starting point is 00:13:11 rupturing the tank. These were bolts that protruded from the rear axle, menacingly close to the low-hanging fuel tank. If a pinter was hit from behind, even at low speed, these bolts could poke holes in the fuel tank. If that happened, oil could spill out and ignite at the smallest spark. One lawyer called the studs, can openers. The final charge that marked how he made against Ford had to do with the company Memo that
Starting point is 00:13:42 came to be infamous. The memo laid out a cost-benefit analysis showing that fuel leakage in certain crashes could potentially be prevented with alterations that would cost about $11 per car. But the analysis determined that the cost of implementing these changes would not outweigh quote, expected benefits. Here, the word benefit meant the potential for lives saved and injuries avoided. In making its calculations, Ford valued a human life at about $200,000, a number borrowed from a report by the National Highway Traffic Safety Administration. The memo did not refer specifically to the Pinto. The calculations likely included all American cars.
Starting point is 00:14:28 Regardless, Mark Dauy's coverage of the memo painted a picture of Ford as a company that was willing to prioritize profits over safety. The 1991 movie class action is based in part on the story of the Pinto. It depicts a car company making a cost-benefit analysis. You have a defective part. You make a decision whether to replace that part in a recall or suffer the consequences of a lawsuit, whichever's cheaper.
Starting point is 00:14:57 Is that correct? Ford faced a slew of civil lawsuits relating to Pinto rear end collisions. There was even a criminal trial. In Indiana Ford was indicted for three felony counts of reckless homicide for the accident that killed Judy, Lynn and Donna Ulrich, the three teenagers whose story we heard at the top of the episode. Ford was found not guilty, but the Pinto never really recovered its reputation.
Starting point is 00:15:26 The car would go on to become the butt of jokes everywhere, in movies, on late-night TV, and in cartoons on newspaper editorial pages. In May of 1978, a federal agency issued an initial determination that the Pinto's fuel system was defective. The National Highways Traffic Safety Commission yesterday issued a tentative finding that 1,930,000 Ford Pintos and Mercury Bobcats may be dangerous. Not long after, Ford agreed to voluntarily recall one and a half million Pintos. The story of the Fort Pinto, seen from the vantage point of today, is almost a parable. It's seen as a warning sign about the risks of hubris and averis.
Starting point is 00:16:16 But as I said, our story today is not about the Pinto. It's not about relitigating what Ford knew and when. It's about how we think about the past. When we come back, what psychology reveals about the mind of a Ford insider who voted not to recall the Pintel and is now haunted by the choices he made. Denny Joya came of age during an era of big changes in the United States. I was marching for civil rights, for women's rights, and against the attitude of big business at the time. He had long hair and wanted to make the world a better place. He started with
Starting point is 00:17:06 the classes in his MBA program. I was the guy who would speak up and saying, shouldn't we account for the employees or the customers in this situation? In 1972, Denny cut his hair and took his first corporate job with the Ford Motor Company. He loved cars and he thought by becoming an insider, he might be able to shape Ford for the better. I decided, with intent, to try to change this lumbering behemoth from the inside out. He rose quickly at Ford, propelled by his expertise and his competitive spirit. About a year in, he was just 26. Denny became Ford's recall coordinator. So you were 26 and you were playing a role to
Starting point is 00:17:55 basically decide where the cars get recalled? I mean, that's astonishing. Never occurred to me that it was astonishing, but yeah, I guess it was. I was rather low in the hierarchy, but it was an extraordinarily powerful position in the sense that if I picked up the phone and called anybody and identified myself as Danny Joya from the recall office, people jumped. And it got to be pretty interesting to watch people who were ranked much higher than I was in the organization, leap to fulfill my every need. But that was the nature of the job. And it was a very important job.
Starting point is 00:18:42 I had to track everything that might become a recall. And so I started a file on everything, and the information for those files came from field reports. Ford had a series of field engineers, as I recall, the R2 in every state, and their job was to fill out a sheet identifying a potential problem, and they would send it to me. Denny would pour through crash reports, looking for patterns of something going wrong over and over again.
Starting point is 00:19:21 Breaks failing, wheels falling off, axles detaching and startling drivers, he had to keep a file on everything. But he was always on the lookout for two specific things. I had two criteria for deciding what should be a recall. One was what I called traceable cause. Something had to be breaking. I mean, I'm an engineer. You can't just engage in magical thinking because somebody somewhere says that there's a problem. You have to have evidence. So I had to have documentation that something was breaking and I had to see a pattern of failures. I never went to recall unless I had at least 20. In other words, he needed more than anecdotes.
Starting point is 00:20:10 He needed data. If he had evidence and could identify a pattern, then he would put the case up for a vote, to recall or not to recall. There were five people in his office, and everyone got a vote. If they voted to recall, he would send the case up to a high-level executive committee that would make the final decision. If the committee agreed with Denny's group, he would then initiate a recall. By the time Denny became Ford's recall coordinator, the Pinto had been on the market for about
Starting point is 00:20:44 three years. In retrospect, we know so much about the Pinto that Denny did not know in the early 1970s. We know it would soon become one of the most hated cars in America, the subject of journalistic and federal investigations, and eventually a national recall. At each 26, Denny did not know any of that. Nor he says did he know about any of the early crash tests or design flaws that were later detailed in the Mother Jones Exposé. To the Denny of 1973, the Pinto was just another car that came
Starting point is 00:21:19 up from time to time in reports. Early on, the Pinto wasn't even really on his radar until I got a filled out field report that was different from any I had ever seen. That had photographs stapled front and back from an engineer and he said to me, I spent all day on this God-for-sacant car. I can't find a thing wrong with it, except that it's a tin can. By which he meant, it's a little car, got hit by a big car, it lit up, what did you expect?
Starting point is 00:22:00 The car had caught fire in a collision. Now, Danny had an incident, but still no cause, and definitely no pattern. So he did what he always did. He started a file on the pinto and began to track it. Danny took his job as recall coordinator seriously. When he first started in the role, he would wake up at night and stare at his bedroom ceiling, worried that he might have made a decision that day that hurt someone. That feeling eventually went away. It had to. You can't have emotions rise to the surface if you're going to be an effective recall coordinator. You've got to get over that. How do you get over having an emotional response to somebody? Somebody dying in one
Starting point is 00:22:54 of your products? Well, it's not easy, but you do it. Not long after he started his file on the Pinto, Denny had an encounter that challenged his efforts to stay focused on the data rather than his feelings. It happened in a company warehouse that Ford Insiders called the Chamber of Horrors. That's where all the horrible pieces came that had broken and often hurt or killed somebody. I was out there one day when I saw a burned out pinto off in the corner under a tarp. I don't know if you've ever seen a burned out car. I have not. No. Everything's melted. All the upholstery is gone, burned away. The paint is burned off, the wiring is melted,
Starting point is 00:23:45 the glass is melted, the steering wheel is melted. And when you learn that that car was actually a death vehicle, it will turn your stomach. Still, when he got back to the office and looked in his Pinto file, he only had five cases involving rear end fires. He had no identifiable cause or pattern. In other words, he was nowhere near his usual standard for recommending the case for a recall vote.
Starting point is 00:24:19 But he decided to do it anyway. So despite my training, when I saw that car, and despite the fact that I only had five field reports, I nonetheless put it on the docket for a vote. And when you brought it up to the five-person committee, was there a robust argument? Was there a discussion? Did people just sort of roll their eyes at you?
Starting point is 00:24:43 What would actually happen? Oh, I could have's a good description. Yes, they roll their eyes at me. Why are we doing this? Because you had an emotional response to seeing a burned out Pinto, that's, that's not good enough. We got to have data. How many you got?
Starting point is 00:25:03 What's the pattern? That's not a pattern. Those could all be outliers. If you're an engineer, you have to think that way. Now, there's actually, you know, you can criticize this, but you can also say this is actually the correct way to think, because of course anecdotally, things happen all the time that are idiosyncratic to a particular car or a particular situation, the weather conditions might be bad, something happens. And if you basically base your judgments on one case, I mean, presumably we'd be recalling every car off the road,
Starting point is 00:25:33 because every car is probably going to have some idiosyncratic case where something goes wrong, no? Oh, absolutely. Now, now think about this. We're looking at a car that has been built in the cheapest way possible. And given that it's a cheap vehicle, you can identify 50 things that cost five to ten dollars to fix. If you want to take a blanket approach and fix everything, suddenly you've got a car that nobody's willing to buy.
Starting point is 00:26:05 That's not okay, especially in an era when the only thing people are buying is a Pinto. When it came down to a vote, Denny's office elected 5-0, not to recall. Even Denny voted against himself. Even Denny voted against himself. It wasn't until about a year later that Denny says something strange happened. Denny says that one day in 1974 he walked into his office and saw a report lying upside down on his desk. It turned out to be an old engineering report from 1970, the early days of the Pinto, that showed why the cars were catching fire. By now, you can probably guess the culprits, the low-hanging fuel tank, and the studs that could rupture the tank like a can opener.
Starting point is 00:27:06 It was what I call a slap-your-for-head moment, because it revealed that the Pinto's rear axle was an off-the-shelf component, which is to say it was used in some other application by the Ford Motor Company. That application was the Ford of Europe Capri. That car was more complicated. It had anchor points, called studs, on the rear axle to which suspension arms were attached. But when it was used in the Pinto, they didn't need those suspension arms, so they deleted them.
Starting point is 00:27:46 But they did not delete the studs to which the suspension arms were attached. The bolts were intended for a different kind of car with a different design. So what happened when the car was hit from behind at the federally mandated speed of 50 kilometers or 31 miles an hour. The fuel tank got pushed and got punctured by these four studs that were protruding. Wow. If the accident was anywhere over 25 miles an hour, it ripped the fuel filler neck out, sprayed gasoline all over the place, including into the rear seats. If there's a spark anywhere in the vicinity, it's going to light up. Secondly, if it's anything over 25 miles an hour,
Starting point is 00:28:35 it's going to, it's going to accordion the car. The doors get pinned shut. So you're trapped in a car that is just exploded into a fireball and you cannot get out. My God. This is a very ugly accident. Today, Denny says he still does not know who put the engineering report on his desk. But in 1974, he knew what he had to do. He called Ford's executive committee overseeing recalls. And I said, in effect, get ready. We've got a big one coming. Denny says Ford decided to see how the Pinto compared to other cars in the industry. According to Denny, Ford bought some competitor cars with layout similar to the Pinto,
Starting point is 00:29:31 but without the start problem, and tested them. And what they found was the average speed at which those cars fuel tanks would rupture. Was about 27. half miles an hour. Wait, almost the same. Pretty close. 25 versus 27 and a half. So what do you do now? Let me put you in the position
Starting point is 00:29:58 of being the recall coordinator. How would you vote? Would you vote to spend $30 million for two and a half miles an hour? Now it leads to a really interesting dilemma because when you hear these numbers, you can get sucked in. You can go, the math doesn't add up. And yes, human lives are at stake, but what's the value that should prevail here? So if it's a values-based decision, of course you recall.
Starting point is 00:30:39 Of course you recall. But if it's a business decision, do you spend $30 million for two and a half miles an hour when the cars that have a problem are not statistically significantly different from the cars that don't? I don't know what to do. Still, Denny had to make a decision and for the second time, he voted not to recall the Pinto. Denny left Ford in 1975. Three years later, Ford admitted there was a problem and recalled the car.
Starting point is 00:31:28 When we look back at moments in our lives that turned out badly, it can be easy to say what we might have done differently. We zero in on the moment things went wrong and say, that's what did it. That's the moment I would go back and change. In hindsight, it all seems like common sense. But what if it isn't so simple? What if these thoughts say less about the past and more about us, about the comfort we seek in dealing with a chaotic and unpredictable world?
Starting point is 00:32:03 Stay with us. When something good happens, we tend to think that everything that led up to it was also good. If a rocket launch is successful, then we assume all the preparation and engineering that went into it must have been handled well too. And when something bad happens, let's say a plane crashes or a company goes bankrupt, our first question usually is, who messed up? Hidden in this question is an assumption many of us make. If there's a bad outcome, then the processes that led up to it must have been flawed too. So when we think about the fiery accident that killed the three Ulrich girls in 1978, it's easy to look at someone like Denny Joyer and say, there must have been something in his recall process that was rotten.
Starting point is 00:32:53 Some big failure or misstep that he could and should have prevented. But an engineer at On Sociologist Duncan Watts says we shouldn't jump to that conclusion so quickly. He says this way of thinking reveals something fundamental about the way we often fail to understand the past and plan for the future. To explain this idea, Duncan tells a story about another car crash. This is a terrible story and I picked it because it's a terrible story. This time instead of a Ford Pinto, the car is a minivan.
Starting point is 00:33:28 It's the summer of 2001 in Brooklyn. Joseph Gray is wrapping up an overnight shift at the precinct where he works as a police officer. I was actually supposed to be golf that day and it was kind of like overcast and drizzling a little bit in the morning. This is Steve from an interview Joseph Gray did a few years later with a statin island advance. When Joseph's golf plans are cancelled... He decided to have a couple of beers with his colleagues. We wound up in a bar and then, you know, that was that. And a couple of beers turns into 12, 13, 15 beers, he spends all day drinking and then he
Starting point is 00:34:10 gets in his mini van and he drives home. So he's well, well, over the limit, more than double the legal limit. And on the way home, he has the terrible accident. I remember going to hit the brakes as soon as I saw somebody able to buy that and just to lay. He runs a red light and he hits a young family. These next details are hard to describe. Maria Herrera and her 16-year-old sister are crossing the street. They are killed instantly. Maria's four-year-old sister, crossing the street. They are killed instantly. Maria's four-year-old son is with them.
Starting point is 00:34:48 His body is dragged 100 feet under the Minivan's bumper. Maria is also eight months pregnant. Later, her child is delivered by Cesarean section, but he doesn't survive. Joseph Gray is a face of a criminal trial and he is just, you know, understandably demonized by the media, by the family of the victim, by her husband. Eventually, Joseph receives a maximum sentence of 15 years. At the time, a lot of people felt that wasn't long enough, like Joseph was getting off easy.
Starting point is 00:35:27 What punishment could possibly be severe enough for such a terrible accident? But pay attention to this word, accident. We want to think that this incident was caused by Joseph Grey's recklessness, and of course, it was. But what's harder to think about are all the other things that had to happen for the accident to occur. What if it hadn't been raining that morning and Joseph Gray went golfing instead of to the bar?
Starting point is 00:35:55 What if he went to the bar and got drunk, but the bartender had told him he couldn't drive and called him a cab? What if he had started driving, but got stopped before he hit the Herrera family? Let's imagine that everything that happened happened, except that two minutes before he had the accident, Joseph Gray got pulled over by another police officer. What do you think would have happened?
Starting point is 00:36:20 He would have been one of these people who gets caught with a high alcohol level driving and people say, oh, that's really bad. You shouldn't do that. And you know, you should maybe you should lose your license for six months and you should do some community service or, you know, pay a fine. But nobody would say, you're a murderer. You're a monster. In this scenario where Joseph Gregg gets pulled over before he can hurt anyone, there's nothing in his behavior that is any different. He behaves exactly the same way he did in the real-life scenario when he killed Maria and her family. Of course, when Joseph decided to get
Starting point is 00:36:59 behind the wheel after so many beers, he made it much more likely that something bad would happen. But in the hypothetical situation where no one gets hurt, it's not because Joseph decided not to drink and drive. In this other world, he would have behaved in exactly the same irresponsible way. And nobody would think that he should go to jail for 20 years. Or else, if they do, then there's a lot of people who should be going to jail for 20 years. Anybody who's texting while driving or anybody who's had a few drinks too many, anybody who's distracted, all of these people are potentially going to kill somebody.
Starting point is 00:37:41 And there's some other random thing out there that is determining whether something bad happens or not. This idea that outcomes might in part be random and the result of good luck or bad luck can make us uncomfortable. When something happens good or bad, we are powerfully motivated to see the hand of intentionality and purpose. This bad thing happened because that bad person did something. Take that away from us and we are left not just with the terror of randomness, but the terror of meaninglessness. People associate randomness with an absence of meaning and I've often actually gotten this response from people
Starting point is 00:38:25 when I sort of walk them through this logic, they sort of look at me with this tired expression on their face and say, then nothing means anything, right? And I sort of find that to be a strange response because meaning is something that we create. The world doesn't create meaning. The world just does whatever the world does. We're the ones who decide what it means. So if you randomly get on a plane or get bumped onto a different flight one day
Starting point is 00:38:58 and the person you sit next to becomes your spouse, that will be a tremendously meaningful event, right, in your life. But it's still random. In a complex world, random things are bound to happen all the time. Most are mundane, some are delightful, a few are heartbreaking. We are mostly okay when the random shapes the mundane, the traffic light turns red as I pull up at the intersection. But when it comes to good things, and especially when it comes to bad things, the notion that wonderful and terrible things happen for no reason leaves us
Starting point is 00:39:38 dissatisfied, uneasy. I ask Duncan why he thinks this is. The short answer is I don't know. My best guess is that it's extremely adaptive to believe that you understand the world, right? That you want to think that you know what's going to happen because that means you can get out of bed, you can take action, you can invest in the future. And I think that's probably where it comes from, is that it's just a sort of adaptive response to the uncertainty of the world. Duncan is not saying that Joseph Grace punishment was too harsh or too lenient. He's saying that because we know what happened to the Herrera family, it changes how we think about Joseph Gray's actions. Yes, we might be willing to concede that many
Starting point is 00:40:31 random things had to happen for the tragedy to occur, but we prefer to ignore them when we make our calculus of right and wrong. We focus on Joseph Gray's negligence because it gives us a feeling of control. We can do something about Joseph Gray. We can lock him up and throw away the key. We can't do anything about all the other random stuff, and that's terrifying. The same thing could be said of the Fort Pinto. Once something terrible has occurred,
Starting point is 00:41:03 it becomes nearly impossible to look back on the actions of the people involved, with any sense of dispassion. Our psychological defense systems demand a tidy explanation. We shrink away from anything that suggests messiness, randomness, uncertainty. randomness, uncertainty. It's possible there was negligence or wrongdoing at Ford. Over the years, some have claimed that Ford didn't intentionally make a dangerous car, while others have argued that the early Pinto crash test revealed that executives at Ford knew the Pinto was a dangerous car even before it left the assembly line.
Starting point is 00:41:48 We reached out to Ford for comment and they declined our request. But our story isn't about the executives at Ford and what they did or did not know. It's about Denny Joyer, a mid-level employee who says he did not know about the Pinto's fuel tank problem until he discovered the mysterious report on his desk in 1974. Up until that moment, and through the end of his tenure at Ford in 1975, Denny followed a clear process for deciding whether to recall cars. Since the company couldn't initiate a recall every time something went wrong with any car on the road, it needed a system for determining if a problem was a real problem or just a fluke.
Starting point is 00:42:31 If Denny wanted to recommend a recall, he needed to be able to show two things, evidence that something was broken and a pattern of failure. The Pinto never rose to that standard. Denny sent up red flags about the car twice, but both times he looked at the evidence himself and voted not to recall. You might hear this and think we're letting Denny off the hook. Maybe Denny should have resigned in protest when he saw the burned out Pinto in the company warehouse.
Starting point is 00:43:05 Or maybe he should have blown the whistle to the media when the mysterious report turned up on his desk. Or maybe he should have just voted to recall the Pinto even if it meant ignoring his standard. That last thought has plagued Denny himself. In certain circles I'm a certifiable villain guilty of not protecting innocent, unsuspecting people, driving a patently dangerous car. This is tape from a voice memo Denny sent us in 2019.
Starting point is 00:43:35 It was in response to a callout seeking stories from listeners who felt haunted by something in their past. Am I haunted by something in their past. the right thing, and voted not to recall the pinto. Denny's conscience is heavy with the same question that Duncan Watts is asking. Just because the outcome was bad, does that mean that Denny did the wrong thing, back when he was at Ford? Do the terrible deaths of the three Ulrich girls mean that Denny's criteria for instigating a recall were
Starting point is 00:44:25 bad. Or is it possible that sometimes bad things happen even when good people are doing their best? This is very hard to accept psychologically. Bad outcomes cast a halo around everything that came before them and it's next to impossible to see through the halo to reality. Duncan Watts again. So the halo effect shows up in lots of circumstances where, you know, for example, people who are good-looking tend to be rated as more intelligent than people who are not good-looking.
Starting point is 00:45:00 Even though looks and intelligence have nothing to do with each other, that is just something that our human psychology does. And the same thing is true for success and failure. So if a company is successful, we look at the things that it's doing and we say, well, those must be really good things, right? Those are good processes. Now that good leadership, good teamwork, good communication, good vision, good execution. And if the same company is not successful, we say, oh, all those things are bad. This halo effect really is very deep and profound and hard to shake, right?
Starting point is 00:45:38 We think we're evaluating a process that led to some outcome, but really we're just reflecting the outcome itself. And this really gets in the way of evaluating processes. The story of Danny Joya is more than just a story about a car company and a defective car. It's a story about how we think about the past and what that means for how we think about the future. When we look back, our minds create stories that explain how events came about. We trace bad things to bad people, good things to good people. We already know how things turned out, so it's easy to
Starting point is 00:46:25 telepart the good guys from the bad guys. But notice how this breaks down when we think not of the past, but of the future. Now, we don't have the final outcome to guide our conclusions. Now, things look confusing. Messy. Random. Just like now, everybody's saying, well, of course, we had a pandemic. You know, people were warning about it. If only we'd paid attention to them. We would have stopped this, right? So we really, we have this view that whether we explicitly say it or not, that, you know, there is this thread that goes from the past into the future. We think that there is this one trajectory that the world is going to take.
Starting point is 00:47:11 And if only we were smart enough, we could somehow know what thread that is. And that is wrong. And there is no thread. There is just sort of an infinite cloud of possibilities. The future has not been created yet. What did that infinite cloud of possibilities look like to Denny in 1974? Let's try to time travel back to the Ford recall office that year. Denny is looking through his files on Ford's various vehicles. He looks a little tired, maybe from another sleepless night worrying about work. As we watch him,
Starting point is 00:47:49 perhaps he opens his file on the pinto. We can tell it's bothering him, but it has not yet risen to a standard for recommending a recall. So he closes the file and gets back to his other work. This younger Denny does not know what we know, that the file he just put away will be the beginning of a long and terrible ordeal. Of course, even in our imaginary time machine, it's difficult to ignore what we already know. Even Denny, who lived through it, has trouble getting back in his 27-year-old head.
Starting point is 00:48:25 So if you were to go back in time right now to make that decision over again based on the data that you're telling me, if you could just go back with your, with, with more maturity and experience, but not necessarily the knowledge of how things turned out for Ford, would you vote differently? The honest answer is I don't know. I told Duncan Watts about the Fort Pinto story, and shared with him Denny's intuition. Denny's a situation where he knows something terrible has happened, but the techniques and rules he had to detect problems
Starting point is 00:49:06 did not alert him that there was a problem. So he's not quite sure right now whether to abandon his rules or to accept that sometimes good rules lead to bad consequences. If you accept the process that they had at the time as the right process, then I think I agree with him, right? Like, you know, it's very hard for him to to unlearn what he knows now, but you know, he can't for sure say that he would have made a different decision because he believes that they had a good process. And it just happens to be a
Starting point is 00:49:37 good process that didn't work in that particular case. All of this begs a question. How much do we really understand about the past? How much can we understand? According to Duncan, not much. That's why he advocates for something called epistemic humility. We should be humble about what we think we know and even humble about what we think we know, and even humble about what we can know. And I think that if we just were more comfortable with not knowing the answers to things, we would be less confident about the answers that we come up with, and we would be less inclined to make confident predictions
Starting point is 00:50:24 based on really shaky assumptions, right? And I believe that would help us to avoid some particularly damaging overreaches associated with hubris. But where does that leave us? What do we do once we realize we don't know as much about the past as we think we do. In a world shaped by epistemic humility, we would commission reports and launch congressional inquiries not just when things go wrong, but also when they go right.
Starting point is 00:50:56 We would see that good outcomes can sometimes be produced by bad systems. We would ask how we can fix problems that haven't happened. We might also be more humble when it comes to confident conclusions when things go wrong. Yes, it's easy, pleasurable even, to blame our political opponents or our rivals when tragedy strikes. But it would be more honest to acknowledge that the choices that led to bad outcomes were made in the context of confusion and doubt. The uncertainty we all experience when we think about the future, that same confusion was experienced by Kat Shuknecht and Parth Shah. It was edited by Tara Boyle and Raina Cohen. Our team includes Laura Quarral, Jenny Schmidt and Thomas Liu. Engineering support from Joshua Noah. Our unsung hero this week is Erin Register.
Starting point is 00:52:09 Erin is an associate project manager at NPR, but her business cards should probably read person who makes things happen. Erin is the person who brings together different teams from across NPR to make sure the launch of new shows and other big projects go smoothly. Her job is one part hurting cats, one part people management, both difficult tasks that she handled beautifully.
Starting point is 00:52:33 Thanks so much for everything you've done to help us at Hidden Brain, Erin. For more Hidden Brain, you can follow us on Facebook and Twitter. If you liked this episode, please be sure to share it with a friend. I'm Shankar Vedantam, and this is NPR. you

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.