Hidden Brain - Episode 51: What Happened?

Episode Date: November 15, 2016

On the morning after election day, pundits, pollsters, politicians, and citizens woke up feeling stunned. All signs, all year, had been pointing towards a victory for Democrat Hillary Clinton. So, what happened? We ask one of the few people who didn't get it wrong: the historian Allan Lichtman.

This is Hidden Brain, I'm Shankar Vedantam. Democrats were not the only ones to grin after the US presidential vote. Donald Trump's election has sent shockwaves through the world of pollsters and political analysts. Pundits on both the left and right had predicted Hillary Clinton would walk away with a race. Today, we're talking to one expert who got it right. There are several surprising things about him. For one thing, Alan Lickman is a historian, not a data scientist. For another, this wasn't a fluke. This is the ninth time in a row he's called the election correctly.

Finally, and this is the craziest part, Alan often calls the winner months and sometimes years before an election. He sometimes calls elections before he knows which candidates are running. Alan says his secret is sitting in plain sight, but most of us are too consumed with the drama of campaigns and candidates to see it. Alan Lichtman, welcome to Hidden Brain. Thank you so much. Alan, you're in the Middle East right now in a hotel room and cutter. I want to take you back more than a quarter century.

You were at Caltech and you sat down to dinner next to another academic. You were an odd couple. You're a historian with an interest in American politics, and he was a geophysicist. Since our story begins at that dinner, can you tell me who you sat next to and what you talked about? Yes, this was in 1981, and I was sitting next to Valygia-Kyla's Borak, a geophysicist, the world's leading authority in earthquake prediction. And it was Kyla's Borak who suggested that we should collaborate. And of course, being a precient, force-sightful scholar, my answer was absolutely not. What does geophysics have to do with elections?

And then I began to think about it a little bit. And everything we know about elections, we derive from geophysics anyway. Tremors of political change, volcanic elections, political earthquakes. So why not explicitly steal from geophysics? And what we did was we reinterpreted elections in geophysical terms. That is not as Republican versus Democrat, liberal versus conservative or caught versus Reagan. Remember this is 1981, but in earthquake terms, as stability, the party holding the White House keeps the White House and upheaval, the party holding the White House keeps the White House, and upheaval, the party holding the White House is turned out of office.

We'll talk in a moment about the specifics of the model you built, but to make things clear what you're saying is that you said, let's look at every presidential election as a referendum on the party currently holding the White House. That's exactly right. Our thesis was that elections are primarily judgments on the strength and performance of the party holding the White House. And all the twists and turns of the campaign, the ads, the speeches, the campaign tricks, the debates, count for little or nothing on election day.

But of course this was just a theory and to test our theory and to create a model we examined every American presidential election from the election of Lincoln in 1860 to the election of Reagan in 1980. And from that examination we came up with indeed the 13 keys to the White House. It's a very simple concept. The 13 keys are true false questions that can be answered prior to an upcoming election, sometimes years in advance if they fall into place. And an answer of true always favors the re-election of the party in power. An answer of false always predicts political upheaval the party in power will lose.

And the decision rule is really simple. The party in power will lose if six or more of the thirteen keys are false. That was the model we came up with in 1981. So what you did, Alan, is you looked at every election starting in 1860 and you said, what are the factors that might have influenced this election? And you used that to come up with this model of 13 keys. What are these keys? Tell us a little bit about these keys and these 13 questions. Yes, these 13 questions primarily gauge the strength and performance of the party holding the White House. There are four political keys that have to do with midterm elections, contests for the White House party presidential nomination, whether

the sitting president is running or not, third parties. Then there are a whole series of performance keys, short and long-term economy, scandal, social unrest, policy change, foreign policy successes, and failures. Only two keys relate to the candidates at all, and they're very high threshold keys. They ask whether the candidate of the White House party is one of those once in a generation charismatic candidates like a Ronald Reagan or John F. Kennedy. And

then they ask whether the challenging party candidate is charismatic. That is the only key, the 13th key, that is anything to do with the challengers. So this is fascinating because of course when we think about presidential elections and we think of the way the media cover presidential elections, we think it all comes down to the candidates and we pay enormous attention and you would say that is actually inordinate attention. That's right. I think the media covers elections as though they were horse races with candidates sprinting ahead

and falling behind according to the twists and turns of the campaigns with the pulsters keeping score. But the whole point is that's not how elections really work. The American people are fundamentally pragmatic and they are asking whether or not the White House Party merits for more years of office. And it's the record of the four years, the keys go term by term, that really counts not all of these events of the campaign that the media spends hundreds of millions of dollars covering each election. And as a result, almost all of the media coverage is not only irrelevant, it is largely misleading. It sends listeners and viewers and readers down into blind alleys.

It's not quite right to say you are looking into a crystal ball. What you've really done is you've said looking back historically at dozens of elections, what are the different factors that played a role in each of these elections and you're saying history can be a guide when we look into the future. Absolutely, I'm not a psychic. I don't look at crystal balls. I don't have a pipeline to the Almighty. I'm an historian and my system is guided by a deep study of history that covers a very broad span of time all the way back

to 1860 and thus is an extremely robust system that is it has survived enormous changes in our economy and our society our politics, in our technology. We go all the way back to the horse and buggy days of American politics. And that's the beauty of looking at history and using this pattern recognition methodology. When we come back, we're going to explore some of the extraordinary features of this model. It allows Alan to sometimes call elections long before candidates announce they are running. Stay with us. This is Hidden Brain, I'm Shankar Vedantam.

Alan, I believe that in 2010, you called the election for Barack Obama before his eventual opponent, Mitt Romney, had even declared his candidacy? That's correct. I was able to call the 2012 election, a very difficult election to call, with the polls almost even on the eve of the election in 2010. And the reason I could do that was I was programming the underlying structure of elections and Looking ahead to where the keys would likely fall I was able to ascertain that it was Extremely unlikely that six or more of the keys would fall against the White House party the party of Obama

And therefore Obama was going to win. I want to talk a little bit about the implications of this work a little later in this conversation, because I think it does raise really fascinating questions about how we come to know what we know and how we understand elections and how we should think about politics. But I want to stay a little bit with the model and your predictions. I understand that in 1991, you got a call from an obscure governor in Arkansas and Bill Clinton's people wanted to know if you thought that George H. W. Bush was vulnerable in the 92 election. That's exactly right. My first book on the keys, it's now in the sixth edition, came out in 1991. And at that time, George H. W. Bush had successfully

conducted the Gulf War. His approval rating hit the highest of any president in history, around 90%. And every big name Democrat was tumbling over every other big name Democrat to get out of the race. Mario Cuomo, Al Gore, Richard Gephardt, Jesse Jackson, none of them wanted any part of HW Bush. But I wrote in my book that based on my historical study, Bush is a codder, not a Reagan or one term president.

None of the big shots, of course, listen. But I get a call from a woman and she says, Professor Lickman, this is K-Gosk Hall and from Little Rock, Arkansas, Special Assistant to Governor Bill Clinton down here. And then she asks me, Lickman, are you serious that George Bush can be beaten in 1992? I said, yes, I am. And the rest is history. When did you call the 2016 election for Donald Trump? This was, of course, one of the most difficult and puzzling elections in all of American history to call because of the unprecedented nature of the Trump candidacy and other factors that were not entirely clear.

I made my call, I believe it was September 23rd in an interview with the Washington Post. My new, this was before the sex tape, before the allegations that about a dozen women came out with with regard to sexual harassment by Donald Trump before the Colme bomb shell letter about the Clinton emails. So this is an odd question to ask given that you call the election more than a month before it happened, but why were you so late this time? I was so late because we had in Donald Trump a history smashing candidate. And I was wondering if Donald Trump was so far outside the patterns of history that perhaps he could change the historical odds and he could

destruct a pattern that had existed all the way back since 1860. We'd never seen a candidate who had no record of public service whatsoever, who had enriched himself at the expense of others, who had demeaned women, Muslims, African-American, the disabled, who had all kinds of scandals on his record. So, after you made this call and the access Hollywood tape is leaked where Donald Trump talks about how he groped women without their consent. Many Republicans denounced the candidate and some even said that he should drop out. Did you ever think at that point in October, early October of changing your call? No, I didn't. I was nervous about my

call and I had a lot of pressure with respect to my call, but I doubled down on my call even after all of that dirt on Donald Trump was revealed and before the Komi letter that kind of reopened the issue of Hillary Clinton's emails. In other words, if I'm to be true to my system, I am not going to let events of the campaign. However, dramatic, and regardless of what the pundits and the politicians might be saying, I'm not going to be influenced by that, because I think the polls are very badly misused, and I don't think the pundits actually understand how elections work, and therefore, a punditry is not a guide to understanding elections, predicting elections or explaining their implications.

Now to be fair Alan, we have talked in the past multiple times after elections and you've told me in the past that the model correctly forecast a winner of the popular vote. In 2000 for example you call the election for Al Gore, even though George W. Bush won the electoral college in that disputed election. This time Hillary Clinton appears to have narrowly won the popular vote. So I guess it's fair to ask you, would it be more accurate to say that this is actually your first mistake in nine elections because Donald Trump didn't win the popular vote. That is a very fair question to ask. And what has happened that has changed my insights into the relationship between the popular

vote and the electoral college vote is a fundamental change in our politics that is critically important not only for the keys but for understanding all of American politics. And it's something that really has not been broadly acknowledged. When I developed my system in 1981 and really up to 2000, the popular vote drove the electoral college vote. You had to go back all the way to 1888 to find a divergence between the popular vote and the electoral college vote. But in recent years,

that relationship has been severed. And the reason is very simple. You have two huge uncompetitive democratic states, California and New York, where nobody campaigns for president. And those states roll up many millions of extra popular votes for the Democrats, even though those millions of votes don't count for anything in terms of the electoral college. And there is no comparable set of states that roll up those votes for the Republicans. The only example would be Texas, but Texas is no longer nearly for the Republicans as uncompetitive as New York and California is for the Democrats. So there has been a fundamental change in the dynamics of our elections, which is why

when I made my call, I did not draw the distinction between the popular vote in the electoral college, but simply said, this is going to be a change election, and the party holding the White House is going to lose. If you will, you might say, you know, I was wrong in 2000, although I don't think so, because there were some very special circumstances that gave those 537 votes in Florida and Bush, including the suppression and the discarding of many, many thousands of votes cast by African Americans. When we come back, we're going to talk more about the 2016 election and we'll talk about

some of the deeper implications of Alan's work. If someone can tell you who's going to win, months or years before an election, does it really make sense to follow the ups and downs of the election for 24 months before the big day? Stay with us. This is Hidden Brain, I'm Shankar Vedantam. Alan, I want to start by asking you about your call in September. I understand that you're not a personal fan of Donald Trump, and you know many people

who were appalled at your call. And this was presumably difficult for you to make, difficult emotionally. I couldn't sleep at night when I made this call. I have to tell you. Personally, I think Donald Trump is a very, very dangerous leader who's brought out the worst elements in our society, the Ku Klux Klan, the neo-Nazis, the white supremacists. I've written about these issues.

I wrote a book called FDR in the Jews. I'm a Jewish American myself and very sensitive, of course, to religious and racial prejudices. So I had many, many sleepless nights when I made this call. I teach at American University in Washington, DC, not exactly a hotbed of republicanism, and I had a lot of pressure from some very good friends of mine and some very smart scholars to change my call. And I had that pressure from the time I made the call, and certainly after I doubled down on that call right up to the election. So emotionally and spiritually, this was the most gut wrenching call I had to make but I felt I had to be true

to my system. I had to be true to the verdict of history. Has it given you any satisfaction to be right? No it really hasn't given me a whole lot of satisfaction. It has in the sense that I think people may now start rethinking how they understand elections and understand how important governance is. That is governance, not campaigns that turn elections. And I have been preaching this for decades now and the politicians don't seem to get it. They think elections are one or lost during the campaign. I've argued they want in lost during the four years of the term of the

administration and it's the governing that really counts. I have nothing against the pollsters. A lot of them are good friends of mine. They're very competent people. But I am saying polls are not predictors. Polls are misused and abused as predictors. I also think that polls lead to lazy and misleading journalism. You don't even have to get out of bed in the morning to write a story about the polls and it leads to this misconception that elections are horse races and it misses all the deeper tides that drive elections. It misses the implications of elections for governance in this country.

Look how the pundits tied themselves into pretzels. Right before the election they said, oh, based on the polls Donald Trump can't win. A day later they had to twist themselves around to explain why what they said couldn't happen actually did happen. And it was all after the fact and meaningless punditry. I have to say that as somebody who was not involved in covering this election, but somebody who was watching it very closely, there was something about watching the numbers that I saw on a lot of media websites and political websites that assigned a probability to Hillary Clinton's win that lent it an air of

certitude. So even though people said in the caveats and the footnotes, look there's uncertainty, look we don't quite know what's going to happen and unpredictable things can happen. When you said Hillary Clinton has a 75% chance of winning the White House and 85% chance of winning the White House, you really had a sense of whiplash on election night because you said how could you switch around from saying you're 85% that Clinton's going to win to being 85% that Trump's going to win in a matter of 45 minutes. This is a classic example of what I call the fallacy of false precision. It looked like those of very precise and accurate numbers.

They are not. They are simply based upon the underlying polling data. And if the underlying polling data is flawed, then those numbers are not only meaningless, they are extremely misleading. They do not really tell you an accurate probability of winning because they're based on polls, which may or may not be right. And none of these analysts go beyond the polls to really probe whether or not the polls are correct. You and I talked in 2012 and you laid out this model for me and I remember doing stories about it.

Of course, it made no difference to the way people thought about elections in the next four years. I want to talk a little bit about that because I feel like there are many, many forces that really would not want to hear the message that you have. Certainly, you raise serious questions about the efficacy and value of political campaigns. You raise questions about political punditry. You raise questions about media coverage. You even raise, I think, disturbing questions for people who are voters, because

I think people who are voters at some level enjoy the ups and downs of the campaign. They want to be gripped by the drama of who's up and who's down and who's who's suffering from a scandal and who's had a good day and who's won the new cycle and who's lost the new cycle. And what you're saying is deeply disparaging in some ways to all of these different constituencies because you're saying it doesn't matter. The keys are very deconstructive. And obviously they're very destructive to the polling industry

and to the media industry. Because the media makes money by covering the elections as an exciting horse race. By saying who's had a good day, who's had a bad day. They make money by covering the elections day by day. And the pollsters make money by keeping score in the horse race, telling us who's ahead and who is behind.

And my model suggests all of that is misleading or worse. And if you covered it according to the deep structure, it would put a lot of pollsters out of business, and perhaps vastly diminish the revenue that flows into the media during an election campaign. This is the time, of course, when the media cash is in. There are also some very big lessons about campaigning from the keys that of course nobody has followed. The keys suggest that

conventional campaigning takes us in the wrong direction. That all of these negative ads, all of these attacks on one another are the wrong way to campaign. That the right way to campaign based on the keys is to build a mandate for governing over the next four years. That might not be as exciting as email or sex scandals, but that's the way you establish a basis for governing. That's for the good of the country, but campaigners and the media don't follow that because it doesn't have the same excitement and drama of negative campaigning and day-to-day

horse race coverage. Alan, I'm going to ask you to make a prediction, and I want to make a prediction as well. There's much of what you say that I find persuasive, but I'm going to predict that in two years time, we're going to start hearing about the ups and downs of the 2020 campaign, and the next election is going to be just as frenetic and just as poll driven and just as down to the wire excitement coverage as we've had in 2016. What's your prediction? Well, you just depressed me immensely, but I have to say, for over 30 years,

I have been arguing against exactly what you mentioned. So far, I haven't made a dent in the way campaigns are covered or in the way candidates campaign. But I have never had the kind of attention that I've had after this kind of contrary to everybody else's prediction of a Trump win. And one that certainly does not reflect

my own political views. It was hardly an endorsement, it was a prediction. So maybe perhaps the attention I've gotten from this prediction will make people rethink even a little bit the way they look at elections, the way they look at our politics, and maybe, maybe bring together politics, governing, and history the way the keys do. Adam Lichtman, I want to thank you for talking with me today. Shankar was a great conversation.

The Hidden Brain podcast is produced by Tara Boyle, Jenny Schmidt, Maggie Penman and Renee Clarre. For more Hidden Brain, you can follow us on Facebook and Twitter and listen for my stories on your local public radio station. If you like this episode, please do a couple of things. Make sure you are subscribed to our podcast so you get new episodes. And please tell one friend who doesn't know about us to listen to our show. Our unsung hero this week is Tanya Blue.

Tanya works in NPR's development department and she has played a vital role in getting this project launched. She's also been a voice of Y's council and someone who has always looked out for us. Thank you, Tanya. I'm Shankar Vedantam, and this is NPR. you