The Diary Of A CEO with Steven Bartlett - WARNING By Sam Harris: ChatGPT Could Be The Start Of The End. AI "Could Destroy Us, The Internet And Democracy"

Episode Date: August 7, 2023

In this new episode Steven sits down with philosopher, neuroscientist, podcast host and author Sam Harris. In 2004, Sam published his first book, ‘The End of Faith’, this stayed on the New York Times bestseller list for 33 weeks and won the PEN/Martha Albrand Award for First Nonfiction. He has gone on to author 5 New York Times bestselling books published in over 20 languages. In 2009, Sam obtained his Ph.D. in cognitive neuroscience from the University of California, Los Angeles. In 2013, he began the ‘Waking Up’ podcast which covers subjects from meditation to AI. Sam is also the co-founder and CEO of Project Reason, a nonprofit foundation devoted to spreading scientific knowledge and secular values in society. In this conversation Sam and Steven discuss topics, such as: How to change peoples beliefs Why he is not optimistic about AI How to live an examined life Why you become what you pay attention to The reason the mind is all you really have moment by moment Why AI is not aligned with human wellbeing How it is too late to turn back the progression of AI The danger of misinformation Why we’re going to have to abandon the internet You can access the ‘Waking Up’ meditation app here: https://bit.ly/3Qp51D7 Follow Sam: Instagram: https://bit.ly/3DHwOHy YouTube: https://bit.ly/3DE8RAy Follow me: https://beacons.ai/diaryofaceo

Quick one. Just wanted to say a big thank you to three people very quickly. First people I want to say thank you to is all of you that listen to the show. Never in my wildest dreams is all I can say. Never in my wildest dreams did I think I'd start a podcast in my kitchen and that it would expand all over the world as it has done. And we've now opened our first studio in America, thanks to my very helpful team led by Jack on the production side of things. So thank you to Jack and the team for building out the new American studio. And thirdly to to Amazon Music, who when they heard that we were expanding to the United States, and I'd be recording a lot more over in the States, they put a massive billboard in Times Square for the show. So thank you so much, Amazon Music. Thank you to our team. And

thank you to all of you that listened to this show. Let's continue. Artificial intelligence is superhuman. It is smarter than you are. And there's something inherently dangerous for the dumber party in that relationship. You just can't put the genie back in the bottle. Sam Harris. Neuroscientist, philosopher. Author, podcaster. He goes into intellectual territory where few others dare tread. Six years ago, you did a TED Talk.

The gains we make in artificial intelligence could ultimately destroy us. If your objective is to make humanity happy, and there was a button placed in front of you, and it would end artificial intelligence, what would you do? Well, I would definitely pause it. The idea that we've lost the moment to decide whether to hook our most powerful AI to everything is just, oh, it's already connected to the Internet, got millions of people using it. And the idea that these things will stay aligned with us

because we have built them, yet we gave them a capacity to rewrite their code, there's just no reason to believe that. And I worry about the near-term problem of what humans do with increasingly powerful AI, how it amplifies misinformation. Most of what's online could soon be fake. Can we hold a presidential election 18 months from now

that we recognize as valid? Like, is it safe? And it just gets scarier and scarier. I worry we're just going to have to declare bankruptcy to the internet. The internet. The internet. If your intuition is correct,

are you optimistic about our chances of survival sam six years ago you did a ted talk um i watched that ted talk a few times over the last week and the ted talk was called can we build ai without losing control over it in that ted talk you really discussed the idea whether um ai when it gets to a certain point of sentience and intelligence will will wreak havoc on humanity six years later later, where do you stand on it today? Do you think, are you optimistic about our chances of survival? Yeah, I mean, I can't say I'm optimistic. I'm worried about two species of problem here that are related.

I mean, there's sort of the near-term problem of just what humans do with increasingly powerful AI and how it amplifies the problem of misinformation and disinformation and just makes it harder and harder to make sense of reality together. And then there's just the longer-term concern about what's called alignment with artificial general intelligence, where we build AI that is truly general and by definition superhuman in its competence and power.

And then the question is, have we built it in such a way that is aligned in a durable way with our interests? And, I mean, there's some people who just don't see this problem. They're kind of blind to it. When I'm in the presence of someone who doesn't have, doesn't share this intuition, they don't resonate to it. I just don't understand what they're doing or not doing with their minds in that moment. Let's say I'm wrong about that. Well, then, you know, it's just the other person's right. And so we just, we just have fundamentally different intuitions about, about this particular point. And then the point is this. If you're imagining building true artificial general intelligence that is superhuman, and that is what everyone,

whatever their intuitions, purports to be imagining here. I mean, there's people on both sides of the alignment debate. There are people who think alignment's a real problem and people think it's a total fiction. But everyone, you know, virtually everyone who's party to this conversation agrees that we will ultimately build artificial general intelligence that will be superhuman in its capacities. And there's very little you have to assume to be confident that we're going to do that. And there's really just two assumptions. One is that intelligence is substrate independent, right? There's no, it doesn't have to be made of meat. It can be made in silico, right? And

we've already proven that with narrow AI. I mean, there's just this, we obviously have intelligent machines and, you know, your calculator in your phone is better than you are at arithmetic. And it's just, that's some very narrow band of intelligence. So as we keep building intelligent machines on the assumption that there's nothing magical about having a computer made of meat, the only other thing you have to assume is that we will keep doing this. We will keep making progress. And eventually we will be in the presence of something more intelligent than we are. And that's not assuming Moore's Law. It's not assuming exponential progress.

We just have to keep going, right? And when you look at the reasons why we wouldn't keep going, those are all just terrifying, right? Because intelligence is so valuable, and we're so incentivized to have more of it. And every increment of it is valuable. It's not like it only gets valuable when you double it or 10x it. No, no. If you just get three more percent, right, that pays for itself. So we're going to keep doing this. Our failure to do it suggests that something terrible has happened in the meantime, right? We have had a world war. We've had a global pandemic far worse than COVID.

We got hit by an asteroid. Something happened that prevented us as a species from continuing to make progress in building intelligent machines, right? So absent that, we're going to keep going. We will eventually be in the presence of something smarter than we are. And this is where intuitions divide. My intuition, and it's shared by many people, I know at least one who you've spoken to. My intuition is that there is something inherently dangerous for the dumber party in that relationship.

There's something inherently dangerous for the dumber species to be in the presence of the smarter species. And we have seen this, you know, based on our entanglement with all other species, dumber than we are, right, or certainly less competent than we are. And so by reasoning, by analogy, it would be true of something smarter than we are.

People imagine that because we have built these machines, that is no longer true right but and here's where my intuition goes from there that is that imagination is born of not taking intelligence seriously right because what intelligence is is a you know a mismatch in intelligence in particular is a fundamental lack of insight into what the smarter party is doing and why it's doing it and what it will do next on the part of the dumber party, right? So, I mean, you just can imagine that, by analogy, just imagine that the dogs had invented us as their super intelligent AIs, right? For the purpose of making their lives better, you know, just securing resources for them, securing comfort for them, getting them medical attention. It's been working out pretty well for the dogs for about 10,000 years there's some exceptions

we mistreat certain dogs but generally speaking for most dogs most of the time humans have been a great invention now it's true that the mismatch in our intelligence

dictates a fundamental blindness with respect to what we've become in the meantime. We have all these instrumental goals and things we care about that they cannot possibly conceive. They know that when we go get the leash and say, it's time for a walk, they understand that particular part of the language game. But everything else we do when we're talking to each other and when we're on our computers or on our phones,

they don't have the dimmest idea of what we're up to. And if we ever, if something happened, if we, I mean, we love, the truth is we love our dogs. We make just irrational sacrifices for our dogs. We prioritize their health over all kinds of things that is just amazing to consider. And yet, if we learn, if there was a new global pandemic kicking off, and some xenovirus was jumping from dogs to humans, and it was just kind of super Ebola,

right? It was 90% lethal. And this was just a forced choice between, I mean, what do you value more, the lives of your dogs or the lives of your kids, right? If that's a situation we were in, it's totally conceivable. I mean, it's not a, you know, by no means impossible. We would just kill all the dogs, right? And they would never know why, right? And it's because we have this layer of mind and culture and just the new sphere, right? There's this realm of mind that requires a requisite level of intelligence to even be partied to, to even know exists, that they have no idea it exists, right? And it's, so this is a fanciful analogy because the dogs did not invent us, but evolution invented us, right? Evolution has coded us, as I said, to survive and spawn, and that's it. So evolution can't see everything else we've done with our time and attention

and all the values we've formed in the meantime and all the ways in which we have explicitly disavowed the program we've been given. So evolution gave us a program, but if we were really going to live by the lights of that program, what would we be doing? We would be having as many kids as possible guys would be going to sperm banks and donating their sperm and finding that the best use of their time and attention

the idea that you could have hundreds of kids for which you have no financial responsibility that should be the most rewarding thing that you could possibly do with your time as a man. And yet, that's obviously not what we do. And there are people who decide not to have kids. And everything else we do, from having podcast conversations like this

to curing diseases. Literally everything we're doing with science, with culture, is, yes, there are points of contact between those products and our evolved capacities. It's not magic, right? We are social primates that have leveraged certain ancient hardware to do

new things. But the code that we've been given doesn't see any of that. And we've not been optimized to build democracies. Evolution knows nothing. It can know nothing. If evolution were a coder, there's just no democracy maximization in that code, right? It's just not there. So the idea that these things will stay aligned with us because we have built them, because we have this origin story that we gave them their initial code, and yet we gave them a capacity to rewrite

their code and build future generations of themselves, right? There's just no reason to believe that. And the mismatch in intelligence is intrinsically dangerous. And you could see this by, I mean, Stuart Russell, I don't know if you had him on the podcast. He's a great professor of computer science at Berkeley, and he literally co-wrote one of the most popular textbooks on AI. He has some arresting analogies, which I think are good intuition pumps here. And one is just think of how you would feel if you knew, like let's say we got a communication from elsewhere in the galaxy

and it was a message that we decoded and it said, people of Earth, we will arrive on your lowly planet in 50 years. Get ready, right? That, anyone who thinks that we're going to get super intelligent AI in let's say, 50 years, thinks we're essentially in that situation, and yet we're not responding emotionally

to it in the same way. If we received a communication from a species that we knew just by the sheer fact that they were communicating with us in this way, we knew they're more competent and more powerful and more intelligent than we are. And they're going to arrive. We would feel that we were on the threshold of the most momentous change in the history of our species. And we would feel, but most importantly, we would feel that it's because this is a, a, a,

a relationship and unavoidable relationship that's being foisted upon us. Right. It's like we, like something, a, a new creature is coming into the room, right. With its own capacities. And now you're in relationship. And what, and one thing is absolutely certain it is smarter than you are right by by what factor i mean ultimately we're talking about by by factors you know just by so many orders of magnitude it's it our intuitions completely fail i mean even if even if it was just a difference

in the time of processing, even if it, let's say there was no difference in the actual native intelligence, but it's just processing speed. A million fold difference in processing speed is just a phantasmagorical difference in capacity. So just imagine we had 10 smart guys in a room over there and they were working and thinking and talking

a million times faster than we are. Well, so they're no smarter than we are, but they're just faster. And we talk to them once every two weeks just to catch up on what they're up to and what they want to do and whether they still want to collaborate with us. Well, two weeks for us is 20,000 years of analogous progress for them. So how could we possibly hope to constrain the opinions and collaborate with and negotiate with

people no smarter than ourselves who are making 20,000 years of progress every time we make two weeks of progress. It's unimaginable. And yet there are many people who just think this is just fiction. All the noises I've made in the last five minutes are just like a new religion of fear right and it's just there's no reason to think that alignment is even a potential problem if your intuition is correct and that analogy of us getting a signal from outer space that someone is coming in 30 years which by the way a lot of people that speak on this subject matter um don't believe it's even going to be 30 years yeah until we reach that sort of singularity moment i think they speak of artificial general intelligence i've heard people like elon

say you know many fewer decades 10 10 years 15 years 20 years etc if that is correct then surely this is the most pressing challenge conversation issue of our time and there's no logical reason that i can see to refute your intuition that i i can't see a logical reason the rate of progress will continue don't necessarily see anything that will wipe out or pause our rate of progress um i mean let me just to uh be charitable to the other side here. There are other assumptions that they smuggle in that they, that some people, I mean, some do it without being aware of it, but some actually believe these assumptions.

And this spells the difference on this particular intuition. So it's possible to assume that the more intelligent you get, the more ethical you become by definition right now. And we might draw a somewhat more equivocal picture from just the human case where we see that, oh, there's some very smart people who aren't that ethical. But I believe there are people, and I've talked to at least a few people who believe this, there are people who assume that kind of in the limit, as you push out into just far beyond human levels of intelligence, there's every reason to believe that all of the provincial, creaturely failures of human ethics will be left behind as well. It's like you're not like the selfishness

and the basis for conflict. These are not going to, the apish urges of status-seeking monkeys is just not, it's not going to be in the code. And as you push out into just kind of the omnibus genius of the coming AI, there's a kind of a sainthood that's going to come along with it, right?

And a wisdom that will come along with it. Now, I just think that's quite a gamble. I would take the other side of that bet, and I would frame it this way. There have to be ways, in the space of all possible intelligences that are beyond the human, right? There's got to be more than one possible. It's just like there's many different ways to have a chess engine that's better than I am at chess. They're different from each other, but they're all better than me, right? There's got to be more than one way

to have a superhuman artificial intelligence. And I would imagine there are, you know, not an infinite number of ways, but just a vast number of... In the space of all possible minds, there are many locations in that space beyond the human that are not aligned with human well-being, right? There's got to be more ways to build this unaligned than aligned, right? And what other people are smuggling into this conversation is the intuition that, no, no, once you get beyond the human, it's just going to get, it's just, you're going to be in the presence of, you know, just the Buddha who understands quantum mechanics and oncology and everything else, right?

I just see no reason to think that that's so. And we could build something that is, again, taking intelligence seriously. We're going to build something that we're in relationship to. It's really intelligent in all the ways that we're intelligent. It's just better at all of those things than we are. It's, by definition, superhuman because the only way it wouldn't be superhuman, the only way it would be human level, even for 15 minutes,

is if we didn't let it improve itself, if we wanted to just keep it stuck at, you know, we built a college undergraduate and we wanted just to keep it stuck there, but we would have to dumb down all of the specific capacities we've already built, right? Just like every AI we have, narrow AI, is superhuman for the thing it does. You has access to all the information on the internet. It's got perfect memory. It can perfectly copy itself. When one part of the system learns something, the rest of the system learns it because it just can swap files. Again, your phone is a superhuman calculator. There's no reason to make it a calculator that is human level.

And so we're never going to do that. We're never going to be in the presence of human AGI. We will be immediately in the presence of superhuman AGI. And then the question is how quickly it improves and how much headroom is there to improve into. On the assumption that you can get quite a bit more intelligent than we are, right, that we're nowhere near the summit of possible intelligence, you have to imagine that you're going to be in the presence of something that is, again, it could be completely unconscious, right? I'm not saying that there's something that's like to be this thing,

although there might be, and that's a totally different problem that's worth worrying about. But conscious or not, it is solving problems, detecting problems, improving its capacity to do all of that in ways that we can't possibly understand. And the products of its increasing competence are always being surfaced, right? So it's like we've been using it to change the world. We've become reliant upon it. We built this thing for a reason. I mean, one thing that's been amazing about developments in recent months is that those of us who have been at all cognizant

of the AI safety space for, you know, now going on a decade or more for some people, always assumed that as we got closer to the end zone, we'd become, that the labs would become more circumspect. We'd be building this stuff air-gapped from the internet. You know, it's like we have this phrase air-gapped from the internet. Like we thought this was a thing, like this thing would be in a box. And then the question would be, well, do we let it out of the box and let it do something, right? Like, is it safe? And how do we know if it's safe, right? And we thought we would have that moment. We thought it would happen in a lab at Google or at Facebook or somewhere. We thought we would hear, okay, we've got something really impressive, and now

we just want it to touch the stock market, or we want it to touch our medical data, or we just want to see if we can use it. We're way past that. We've built this stuff already in the wild. It's already connected to the internet it's already got millions of people using it it already has apis it's already i mean it's already doing work so that meant from an ai safety point of view that's it's amazing like we didn't even have the moment the choice point we thought was going to be so fraught of course we didn't we we because there was such pressing incentives for people to press forward regardless of that conversation. But everyone thought, I mean, I was never,

I don't believe I was ever in conversation with someone, someone like Eliezer Yudikowsky or Nick Bostrom or Stuart Russell, who assumed we would be in this spot. Like I just, everyone, because I'd have to go back and look at those conversations, but there was so much time spent, it seems quite unnecessarily, on this idea that circumspect,

we'd make a certain amount of progress and circumspection would kick in like even the people who were who were doubters would become worried and there and there would be like in the final yards you know as we go cross into the end zone there'd be some mode where we could sort of slow down and figure it out and try like try to deal with the arms race dynamics like let's place a phone call to china and and like, let's talk about this. We've got something interesting. But the stuff is already being built in connection to everything.

And there's already just endless businesses being devised on the back of this thing. And all the improvements are going to get plowed into it. And so just imagine what this looks like even in success, right? Like, let's say it just starts working wonders for us and we get these great productivity gains and, okay, so then we cross into whatever the singularity is, right? At whatever speed, we find ourself in the presence of something that is truly general. After all of this stuff is, all of this narrow stuff, albeit superhuman narrow stuff, is something that we totally depend on, right? Like every hospital requires it, and every airplane requires it, and all of our missile systems require it. And it's, we're just, this is the way we do business. There is no, there's nothing to turn off at that point. I mean, I just don't, you know, it's like,

I guess, I mean, I put this to Mark Andreessen on my podcast and he said, yeah, you can turn off the internet. I mean, I don't, I can't believe he was quite serious. I mean, yes, if you're North Korea, I guess you can turn off the internet for North Korea, and that's why North Korea is like North Korea. But the idea that we could, I mean, just the cost of turning off the internet now would be, I think it would be unimaginable. In the economic, just the economic cost alone,

it just would be... So anyway, I mean, just the idea that we've lost the moment to decide whether to hook our most powerful AI to everything because it's already being built more or less in contact with, if not everything, so many things that you just can't put the genie back in the bottle. That is genuinely surprising to me. And yeah, I mean, incentives.

Is this not the most pressing problem then? Because I was going to start this conversation by asking you the question about the thing that occupies your mind the most and the most important thing we should be talking about and i i in part assume the answer would be artificial intelligence because the way that you talk about your intuition on this subject matter you've got children yeah you think about the future a lot um if you can see this species coming to earth in the next even if it's in the next 100 years um it strikes me to be the most pressing problem for humanity well i do i'm as as interesting as i think that problem is and and consequential as it is i'm i'm worried that that life could

become unlivable in the near term before we even get there. I'm just worried about the misuses of narrow AI in the meantime. I'm worried about, just take the current level of AI we have. We have GPT-4. I think within the next 12 months or two years, let's say, let's say we, whatever GPT five is, we're going to be in the presence of something where most of what's online that purports to be information could soon be fake, right?

Where like just most of the text you find on any topic is just fake, right? Like someone has just decided, write me a thousand journal articles on why mRNA vaccines cause cancer and give me, you know, 150 citations, write them in the style of nature and nature genetics and Lancet and JAMA.

And publish them. And just put them out there, right? Right. One teenager could do that in five minutes with the right AI, right? It's just like, GPT-4 is not quite that, but GPT-5 possibly will be that. I mean, it's like, that is such a near-term advance, right? Or just when you imagine knitting together the visual stuff like mid-journey and DALI and stable diffusion with a large language model.

Just imagine the tool. Again, maybe this is 18 months away. Maybe it's three years away, but it's not 30 years away. The tool where you can just say, give me a 45-minute documentary on how the Holocaust never happened, filled with archival imagery. Give me Hitler speaking in German with the appropriate translations and give it in the style of Alex Gibney or Ken Burns

and give me 10,000 of those, right? Like that's all the friction for misinformation has been taken out of the system and yeah i worry we're just going to have to declare bankruptcy with respect to the internet like just like we just are not going to be able to figure out what's real and when you when you look at how hard that is now with social media in the aftermath of COVID and Trump and how just the challenge of holding an election that most of the population agrees was valid, right? That challenge already is on the verge of being insurmountable in the US, right? I mean, it's just like,

it's easy to see us failing at that, AI aside. Now, when you add large language models to that and the more competent future version of it, where it's just the most compelling deep fakes are indistinguishable from real data and everyone is siloed into their tribes are indistinguishable from real data. And everyone is siloed into their tribes where they're stigmatizing the information that comes from any other tribe.

And the internet is now so big a place that there really isn't the ordinary selection pressures where bad information gets successfully debunked so that it goes away. It's just you can live in a conspiracy cult for the rest of your life. If you want to, you know, you can be queuing on all day long if you want to.

And now we've got deep, deep fakes shoring all that up and just spurious, you know, scientific articles shoring all that up. All of this just becomes a more compelling form of psychosis, culturally speaking. And so I'm just worried that it's going to get harder and harder for us to cooperate with one another and collaborate

and that our politics will just completely break and that'll offer an opportunity for lots of, you know, bad actors. And I mean, leaving aside, you know, there's cyberterrorism and there's synthetic biology that, you know, the moment you get, you turn AI loose on the prospect of engineering viruses and, you know, all of that, it's like, it potentiates, I mean, the asymmetry here is that it seems like it's always easier to break things than to fix them or to prevent people, categorically prevent people from breaking them. And what we have with increasingly powerful technology is the ability for one person to create more and more damage or one small group of people.

And so it just turns out it's hard enough to build a nuclear bomb that one person can't really do it, no matter how smart. You need a team. Traditionally, you've needed state actors, and you need access to resources, and you have to get the fissile material. It's hard enough,

but this isn't, this has been fully democratized, this tech. And so it's, yeah, I worry about the near-term chaos. I've never found the narrow-term consequences of artificial intelligence to be that interesting until now, until what you said.

That image of like the internet becoming unusable. So that was a real eureka moment for me because I've not been thinking about that. Yeah, me too. I was just concerned about the AGI risk. And now, really in the aftermath of Trump and COVID, I see the risk of, you know, if not losing everything, losing a lot that matters just based on our interacting with these very simple tools that are reliably misleading us. I'm amazed at what social media,

I forget about, I'm amazed at what Twitter did to me. I mean, you know, even with all of my training and all, you know, with my head screwed on reasonably straight, I mean, it's amazing to say it, but almost all of the truly bad things that have happened to me in the last decade that just really like just destabilized relationships and, and just priorities and really kind of got plowed back into me. It became a kind of professional emergency, you know, stuff I had to respond to, you know, in writing or on podcasts. It was all Twitter.

It was my, my engagement with Twitter was the thing that produced the podcasts, it was all Twitter. It was my, my engagement with Twitter was the thing that produced the chaos and it was completely unnecessary. Um, and it was just, it was amplifying a kind of signal for me that I felt compelled to pay attention to because I was on it and I was trying to communicate with people on it. I was getting certain communication back and it was giving me a picture of the rest of humanity, which I now think is fundamentally misleading. But it was still consequential. Even believing that it was misleading wasn't enough to inoculate me against the delusion of the opinion change that was being forced upon me.

And I was feeling like, okay, these people are becoming unrecognizable. I know some of these people. I've had dinner with some of these people. And their behavior on Twitter is appearing so deranged to me and in such bad faith that people who I know to be non-psychopaths are starting to behave like psychopaths, at least on Twitter. And I'm becoming similarly unrecognizable to them.

It all felt like a psychological experiment to which I hadn't consented and which I enrolled myself somehow because it was what everyone was doing in 2009. And I spent 12 years there getting some signal and responding to it. And it's not to say that it was all bad. I mean, I read a bunch of good articles that got linked there and I discovered some interesting people but um the change in my life after i deleted my twitter account was so enormous i mean it's embarrassing to admit it i mean it's just it's like it's like getting out of a bad relationship i mean it was just it was a fundamental um

just freedom from from this this chaos monster that was it was always there ready to disrupt something but based on its own dynamics and when did you delete it um yeah like december i think it was december i would and i'm not someone that really takes sides on things i like to try and remain in the middle i think politically so you must have a very different twitter experience than i was having no no no so i don't tweet anything other than this podcast trailer don't tweet anything else right okay so i just the only thing you'll see on my twitter is the podcast trailer that's it yeah and for all the reasons you've described and more interestingly i wanted to say in the last eight months as someone that tries to be doesn't get caught up too much in the media oh elon bought this it's a hundred percent

gone in that direction as in my timeline now is i say to my friends all the time and some of my friends who again i think are nuanced and balanced have said to me the there's something that's been turned up in the algorithm to increase engagement that has planted me in an unpleasant echo chamber that i didn't desire to be in and if i wasn't somewhat conscious i would 100 be in there my timeline my friend tweeted the other day my friend cackle tweeted he's never seen more people die on his twitter timeline than he has in the last six months they're prioritizing video so you're seeing a lot of like death and cctv footage that i've never seen before and then the debate around gender um politics right-leaning subject matter has never been more right down your throat yeah

because it's been it's almost like something in the algorithm has been switched where it's now it's now like people have been let out the asylum that's the only way i can describe it and it's made me retract even more so when zuckerberg announced threads the other the other couple of weeks ago it was kind of like a life raft right out of the titanic um and i really really mean that and i'm not someone to get easily caught up in narrative you know as it relates to social media platforms it's been my industry for a decade but But what I've seen on Twitter, and it's actually made me believe this hypothesis I had five years ago, where I thought there would be, I thought the route, the journey of social networking would be would have way more social networks, and they'd be more siloed. I thought we'd have one for our

neighborhood, our football club. And now I believe that even more than ever. Yeah, that seems right. And I think it's, I mean, whether it's possible to have a truly healthy social network that people want to be in and it's a good reason to be there. And it's, it's, uh, I don't know if that's possible. Uh, I'd like to think it is, but it's, um, I think there are certain things you, you have to clean up at the outset so as to make it possible. And I think anonymity is a bad thing. I think probably being free is a bad thing.

I think you sort of get what you pay for online. And if it's, I just think there might be ways to set it up that way would be better, but. I don't think it'd be popular. What was that? I think with the thing that makes it popular makes it toxic right right and even the anonymity piece i've played this out a couple of times in my mind and the rebuttal i always get is well there's people in syria who have news to break important news to break and they they'd be

hung if they so we need a anonymous version of the social internet right yeah well i guess there could be some exception there but um i don't know it just doesn't it actually doesn't interest me because i just feel such a different sense of my being in the world as a result of not paying attention to my online simulacrum of myself. Twitter was the only one I used. I've been on Facebook this whole time. I guess I'm on Instagram too, but my team just uses those as marketing channels.

It sounds like that's the way you use Twitter now. But Twitter was the one that I decided, okay, this is going to be me. I'm going to be posting here. If I've made a mistake, I want to hear about it. And I just wanted to use it as an actual basis for communication. And for the longest time, it actually felt like a valid tool in that respect you know it reached a

crisis point i decided this is just pure toxicity there's just no reason even the good stuff can't possibly make a dent in the bad stuff so i just deleted it and then i was i was returned to the real world right where i've where I actually live and to books and to, I mean, I'm online all the time anyway, but it's not having the, it's the time course of reactivity when you don't have social media, when you don't,

and you don't have a place to put this instantaneous hot take that you're tempted to put out into the world because there's literally no place to put it. Like for me, if I have some reaction to something in the news, I have to decide whether it's worth talking about it in my next podcast that I might be recording four days from now. And rather often people have been just bloviating about this thing for four solid days

before i ever get to the microphone and then i get to think what is is it still worth talking about and most almost nothing survives that test anymore right it's like the conversation's moved on so there's actually no place for me to just type this thing that either takes me 10 seconds and then rolls out there to get to detonate in the minds of you know my friends and enemies to opposite effect uh and then i see the the result of all that you know on a again on a this sort of reinforcement loop of every 15 minutes. Not having that is such a relief that I just don't even know why I would. So like when Threads was announced, I think I'm on Threads too, but it's not me.

It's just, you know, just yet another marketing channel. But yeah, I feel such relief not exercising that muscle anymore where's like, I don't know how often I was checking Twitter, but it was, I was, you know, I was not checking it just to see what was happening to me or what the response to my last thing I tweeted. I was checking it a lot because it was my newsfeed. It's like, I'm following, you know, 200 smart people. They're telling me what they're paying attention to. And so I'm fascinated. So yeah, I want to see that next article or that next video. Just that engagement and the endless opportunity to comment

and to put my foot in my mouth or put my foot in someone else's mouth or have someone put their foot. It's just not having that has been such a relief that I would be, I mean, it's not impossible, but I would be very cautious in reactivating that because it was, it was so much noise. And again, it would, it created, there's so much, it became a, it became an opportunity cost, but it became a, just this endless opportunity for misunderstanding, but especially misunderstanding of me and, you know,

everything I've been putting out into the world. And then my sense that I had to react to it. And then you just can't plow that back into the, you know, that becomes the basis for further misunderstanding. And it just constantly was giving me the sense that there's something, there's something I need to react to on my podcast, in an article, on Twitter, that it's just, this is a valid signal. Like this is, this is, this is like, this is a five alarm fire. This is like, you got to stop

everything. Like you're by the pool on the one vacation you're taking with your family that summer, and this thing just happened on your phone. It can't wait. You actually have to pay attention because the conversation is happening right now. So it was a kind of addiction to information and, on some level reputation management or, or, or, um,

and it was just, I mean, just to just be free of it is, I mean, it's such a relief apart from like, you know, health issues with certain family members, virtually the only bad things that have happened to me have been a result of my engagement with Twitter over the last 10 years. So it's just, it's just, you know, I, you know, I guess if I'm a masochist, I would be back on Twitter. But like, that would be the only reason to do it. Narrow AI. I asked you the question a second ago, which we, I really wanted to get a solution to it because i'm mildly terrified i completely believe your believe your um the logic underneath your opinion that narrow ai will cause this

destabilization and unusability of the internet so just focusing on narrow ai what what would you consider to be a solution to prevent us getting to that world where misinformation is rife to the point that it can destabilize society politics and culture well i think it's something i've been asking people about on my podcast because it's not actually my wheelhouse and i would just need to hear from experts about what's possible technically here but um But I'm imagining that paradoxically or ironically, this could usher in a new kind of gatekeeping that we're going to rely on because the provenance of information is going to be so important.

The assurance that a video has not been manipulated or there's not just a pure confection of of deep fakery right so you get so it could be that we're we're meandering into a new period where you're not going to trust a photo unless it's come it's coming from you know getty images or you know the new york times has some story some story about how they have verified every photo that they put in their newspaper. They have a process. And so if you see a video of Vladimir Putin seeming to say that he's declaring war on the US, I think most people are going to assume that's fake until proven otherwise. It's just going to be too much fake stuff.

And it's all going to look so good that the New York Times and every other organ of media that we have relied upon, as imperfect as they've been of late, they're going to have to figure out what the tools are whereby they can say, okay, this is actually a video of Putin, right? And if the New York, I mean, I'm not going to be able to figure it out on my own, right? If the New York Times doesn't have a process or CNN doesn't have a process that they go through before they say, okay, Putin really said this. And so this is, we have to now react to this because this is real. Whatever that process is, and whether there's some kind of digital watermark that's connected to the blockchain,

there's some tech implementation of it that can be fully democratized where you, by just being in the latest version of the Chrome browser, can know that you can differentiate real and fake video, say. I don't know what the implementation will be, but I just know we're going to get to some spot where it's going to be, all right, we have to declare epistemological bankruptcy. We don't know what's real. We have to assume anything especially lurid or agitating is fake

until proven otherwise. So prove otherwise. And that's, you know, that'll be a resetting of something. I don't know what we do with that in a world where we really don't have that much time to react to certain things that are, you know,

a video of Putin saying he's launched his big missiles is something that, you know, 30 minutes from now, we would understand whether it's real or not. I mean, forget about, again, forget about everything we just said about AI. Look at all of our legacy risks. Look at the risk of nuclear war. the risk of stumbling into a nuclear war by accident has been hanging over our head for 70 years. I mean, we've got this old tech. We've got these wonky radar systems that throw up errors. you know, one Soviet sub commander decided based on his just gut feeling, his common sense that the data was almost certainly an error. And he decided not to pass the, the, the obvious

evidence of a, an American ICBM launch up the chain of command, knowing that the chain of command would say, okay, you have to fire, right? And he reasoned that if the U.S. was going to attack the Soviet Union, they would launch more than, I think in this case, it looked like there were four missiles. That was the radar signature. If the U.S. is going to launch a first strike against the Soviet Union, this was like the mid-'80s, they're going to launch more than four missiles. This has to be bad data.

But if we automate all this, will we automate it to systems that have that kind of common sense? But we've been perched on the edge of the abyss based on the possible, forget about malevolent actors who might decide to have a nuclear war on purpose. We have the possibility of accidental nuclear war. You add this cacophony of misinformation and deep fake to all of that, and it just gets scarier and scarier.

And this is not even AI. This is just, you know, you know, narrow AI amplified misinformation. How do you feel about it? Well, I mean, this is the thing that worries me. I mean, I worry about the next election. You know, I think the next president, if we can run the 2024 election in a way that most of America acknowledges was valid, that will be an amazing victory, you know, whatever the outcome. I mean, obviously, I would not be looking forward to a Trump presidency. But I think even more fundamental than that is, can we hold a presidential election 18 months from now that we recognize as valid? I don't know what kind of resources are being spent on that particular performance, but that

is hugely important. And I don't think our near-term experiments with AI is going to make that easier. Why is it so important? Well, it's just, I mean, if you think the maintenance of a valid democracy in the world's lone superpower is of minor importance, I'd like to drink the tea you're drinking. Are you optimistic? I mean, I can um, I'd like to drink the tea you're drinking. Um, but you're optimistic. I mean, I, I'm, I can't say I'm optimistic. I'm, you know, it's, it's a paradoxical state. I mean, because I, I definitely have, I, I tend to focus on what's wrong or might be wrong. I tend to, I think have a, a pessimistic bias, right? Like I, I, I think, have a pessimistic bias, right? Like I tend to notice what's wrong as opposed to what's right. You know, that's my bias.

But I'm actually very happy, right? Like I have a very good life. I'm just like everything is, I just, I'm incredibly lucky. I'm surrounded by great people. It's like, it's all great. And yet I see all of these risks on the horizon. So I'm not, I just, I have a very high degree of well-being at this moment in my life. And yet I, what's on the television is scary.

And so it's a very interesting juxtaposition. And yet, what's on the television is scary. And so it's a very interesting juxtaposition. You know, I'll be very relieved if we have a... I just feel like we're in a very weird spot. I mean, like, I haven't seen a full post-mortem on the COVID pandemic that has fully encapsulated what I think happened to us there. But my vague sense is that we didn't learn a whole hell of a lot. I mean, basically, what we learned is we're really bad at responding to this kind of thing. This was a challenge that

just fragmented us as a society. It could have brought us together. It didn't. And it amplified all of the divisions in our society, politically and economically and tribally in all kinds of ways. The role of misinformation and disinformation and all of that was all too clear and I think just getting worse. So I think, you know, as a dress rehearsal for some future pandemic that is inevitably going to come and is, you know, could well be worse, I think we failed this dress rehearsal. And, you know, I have to hope that at some point our institutions will reconstitute themselves so as to be obviously trustworthy and engender the kind of trust we actually need to have in our institutions. Like we need a CDC

that not only that we trust, but that is trustworthy, that we, that we, that we're right to trust. Right. And so it is with an FDA and every other institution that is relevant here. And we don't quite have that. And half of our society thinks we don't have that at all. And so we have to rebuild trust in institutions somehow. And I just think we have a lot of work to do to even figure out how to make an increment of progress on that score because we're, again, the siloing of large constituents into alternate information universes is just not functional. And that's so much of what social media has done to

us and alternative media. I mean, like, you know, I call it, you know, you and I are podcasters, but I call it podcastistan, right? I mean, we have this, this landscape of, I mean, there's now whatever, a million plus podcasts and there's, you know, email newsletters and everyone has now just decided to curate their information diet in a way that's just bespoke to them. And you can stay there forever and you're getting one slice of, and it could be a completely fictional slice of reality, and we're losing the ability to converge on a common picture of what's going on. And you,

that's not optimistic. I didn't hear the optimism. You tell me. No, I, no, I, but I,

again, I can't refute anything you've said on like a logical basis. It all sounds like that is the direction of travel that we're going in. Unfortunately. I have faith that there'll be surprising positives there always tends to be surprising positives that we also didn't factor in um well yeah i mean it's easy to see i mean if there's anything if there's any significant low-hanging fruit technologically or or scientifically that could be AI enabled for us.

I mean, just take a cure for cancer, a cure for Alzheimer's. I mean, just having one thing like that, that would be such an enormous good. And that's why we can't get off this ride, and that's why there is no brake to pull. Because the value of intelligence is so enormous. I mean, it is just, it's not everything. I mean, it's not, you know, there are other things we care about and are right to care about beyond intelligence.

I mean, love is not the same thing as intelligence, right? But intelligence is the thing that can safeguard everything you love right like even if you think the whole point in life is to just get on a beach with your friends and your family and just hang out and enjoy the sunset okay you don't have to augment you you don't need superhuman intelligence to do any of that right you have you you're you're fit to do it exactly as you are you could have done that in the 70s and it would just be just as good a beach and they'd be just as good friends but every gain we make in intelligence is the thing that safeguards that opportunity for you and

everyone else how would you i feel like we've not defined the term artificial general intelligence. From my understanding of it, it's when the intelligence can think and make decisions almost like a human. Yeah, I mean, loosely, this is kind of just a semantic problem, but intelligence can mean many things, but loosely speaking, it's the ability to solve problems and meet goals, make decisions in response to a that in across in many different situations all the sort of situations we encounter as people and to have one's capacity in one area not you know as i get better at deciding whether or not this is a cup i don't magically get worse at deciding whether you know you just said a word right it's like i can do but a word. I can do multiple things in multiple channels.

That's not something we had in our artificial systems for the longest time because everything was bespoke to the task. We'd build a chess engine and it couldn't even play tic-tac-toe. All it could do was play chess and we just would get better and better in these piecemeal, narrow ways. And then things began to change a few years ago, where you'd get, you know, with like DeepMind would have its algorithms that were, you know, the same algorithm with slightly different tuning could play Go, right? Or it could, you know, it could

solve a protein folding problem as opposed to just playing chess, right? Or it could, you know, it could solve a protein folding problem as opposed to just playing chess, right? And it became the best in the world at chess and it became the best in the world at Go. And, and amazingly, I mean, to take, you know, Alpha, what AlphaZero did, it, you know, before AlphaZero, all the chess algorithms were, they just had all of our chess knowledge plowed into them. They had studied every human game of chess and they just, it was just, you know, it was a bespoke chess engine. AlphaZero just played itself, I think for like four hours, right? It just had the rules of chess, and then it played itself. And it became better, not merely than every person who's ever played the game, it became

better than all the chess engines that had all of our chess knowledge plowed into them. So it's a fundamentally new moment in how you build an intelligent system. And it promises this possibility. Again, this inevitability, the moment you admit that we will eventually get there, the moment you admit that it can be done in silico, and the moment that you admit that we will just keep going unless a catastrophe happens and those two things are so easy to admit that i just don't at this point i don't see any place to stand where you're not forced to admit them right i don't see any neuroscientific or cognitive scientific argument for substrate dependence for intelligence um given what we've already built. And again, we're going to

keep going until something stops us, right? We'll hit some immovable object that prevents us from releasing the next iPhone, but otherwise we're going to keep going. And then, yeah, so then whatever general will mean in that first case, there'll be a case where we've built a system that is so good at everything we care about that it's functionally general. Now, maybe it's missing something. Maybe it's missing something that we don't even have a name for. We're missing all kinds of—there are possible intelligences that we haven't even thought about because we just haven't thought about them. There are ways to section the universe, undoubtedly, that we can't even conceive of because we have the minds we have. Elon was asked a question on this by a journalist. The journalist said to him, in a world where you believe that to be true, that artificial general is around the corner when your kids come to you and say daddy what should i do with my

life to find purpose and meaning what advice do you now give them if you hold that intuition to be true that it's around the corner what do you say to your children when they say what should i do with my life to create purpose and meaning? Did you say that Elon answered this question? What did he say? It's one of the most chilling moments in an interview I think I've seen in recent times because he stutters. He goes silent for about 15 seconds, which is very un-Elon. He stutters. He stutters.

He stutters a bit more. like is he can't he and then he says he thinks he's suspended he's living in suspended disbelief because if he really thought about it too much what's the point he says what's the point of me building all these cars he was in his tesla factory what's the point of me building all these cars and what's the point i do think that sometimes so i think i have to live in as his words were suspended disbelief right well i would encourage him to ask what's the point of spending so much time on Twitter? Because he could clearly benefit from rethinking that. But that aside, I mean, my answer to that is, and I think other people have echoed this of late, I mean, it's sort of surprising to me. My answer is that this begins to privilege a return to the humanities as a kind of a core, like the center of mass intellectually for us. good at and it's among the last

things that can be plausibly automated and if we automate it we may cease to care about it so it's like learning to write good code is something that is going to be it's being automated now

I'm not a programmer but I have it on good authority that already these large language language models are improving code and something like half the time they're writing better code than than people uh that's all going to become like chess right it's just it's going to be better than people ultimately um so being a software engineer is something that you know and being a radiologist and being like those things, it's easy to see how AI just cancels those professions or at least makes one person, you know, so effective at using AI tools that, you know, one person can do the work of 100 people. So you got 99 people who don't have to be doing that job. But creating art and writing novels and being a philosopher and talking about what it means to live a good life and how to do it. That's something that if we...

We have to look at those... We have to look at where we're going to care that we're actually in relationship to and in dialogue with another person who we know to be conscious. Where we don't care about that, we're not going to care. We're going to want just the best version of it. If the cure for cancer comes from an insentient AI,

I do not give a shit. I just want the cure for cancer. There's no added value where I find out, okay, the person who gave me this cure really felt good about it, and he had tears in his eyes when he figured out the cure. Every engineering problem is like that. We want safer planes.

We just want things to work. We're not sentimental about the artistry that went into all of that. And when the difference, when the gulf between the best and the mediocre gets big and consequential we're just going to want the best we're just going to want the best we're all the way down the line but what is the best novel right what is the best podcast conversation what is it and can you subtract out the the conscious person from that

and still think it's the best? And so someone once sent me what purported to be, I didn't even listen to it, so I'm not even sure what it was, but it looked like it was an AI-generated conversation between Alan Watts and Terrence McKenna. Both guys who I love, I didn't know either of them, but fans of both have listened to hundreds of hours

of both talk. As far as I know, they never met each other. It would have been a fascinating conversation. I realized, when I looked at this YouTube video, I realized I simply don't care

how good this is because I only care if it was actually Alan Watts and Terrence McKenna talking. Like, a simulacrum of Alan Watts and Terrence McKenna in this context, I don't care about, right? So another use case I stumbled upon, I was playing with ChatGPT, and I asked it, you know, the causes of World War II, you know, give me 500 words on the cause of World War II, and it gives you this perfect little, you know, bullet-pointed essay on the cause of World War II.

That's exactly what I want from it. That's fine. That's like I don't care that there was no person behind that typing. But when I think, well, do I want to reread Churchill's history of World War II? It's on my shelf to read. It's one of these aspirational sets of books. I haven't read it yet.

I actually want to read it because Churchill wrote it. And if you could give me an AI version of Churchill, saying this is in the style of Churchill, even Churchill scholars say this sounds like Churchill. I actually don't care about it. Like, that's not the use. I'll take the generic use of, you know, give me the cause of World War II. The fake Churchill is profoundly uninteresting to me. The real Churchill, even though he's dead is is interesting to me so the rebuttal i give here and this is what my mind is doing is saying this the distinction

you're you're presenting the the difference i see is that in the case of the conversation between two people you respect that has been generated by ai someone has signaled to you that that it is fake if you remove that because say churchill thought bloody hell why would i write a book when i could just click a button and this thing will write it in my in my voice in my tone of voice with my you know with the entire the entire back catalog of things i've written before and it'll produce my my account and it'll save me time so i'll just click a button my publisher maybe maybe i'll do it for me and then i'll sell that to Sam on the basis that it is my thoughts, which I imagine,

I can imagine a very near future. If we just do it by percentage, how many books are going to be increasingly written by artificial intelligence? To the point that when you look at a shelf, I imagine at some point in the future, if the intelligence does increase by any measure, that most of it would be words strung

together by artificial intelligence and it will be selling potentially better than the words written by humans so again when we go back to the conversation with your your your children there might not be a career there either because artificial intelligence is faster can produce more can test and iterate on whether it sells better. Clicks gets more clicks. It can write the headline, create the picture, write the content. And then I can just take the check because I put my name to it. Yeah.

So even in that regard, what remains? Well, so in the limit, what I think we're imagining is a world where, and so none of the terrifyingly bad things have happened. So it's just all working. We're just producing a ton of great stuff that is better than the human stuff and people are losing their jobs. not talking about any other kind of political catastrophe or cyber apocalypse, much less AGI destroying everything, then I think we just need a different economic assumption and ethical intuition around the value of work. I mean, our default norm now in a capitalist society is you have to figure out something to do with most of your time that other people are willing to pay you for, right? You have

to figure out how to add value to other people's lives such that you reliably get paid. Otherwise, you might die, right? Like we've got a social safety net, but it's, it's pretty meager. You know, we're not, we're, there are cracks you can fall through. You could wind up homeless and we're, and we're not going to figure out what to do about that all too well, you know? And, um, your, so your claim upon your existence among us is you finding something to do with your time that other people will pay you for. And now we've got artificial intelligence removing some of those opportunities, creating others. But in the limit, and I do think it is different. I think analogies to other moments in technological history are fundamentally flawed.

I think this is a technology which in the limit will replace jobs and not create better new jobs in their wake. This just cancels the need for human labor ultimately. And strangely, it replaces some of the highest status most cognitively intensive jobs first right you know it replaces replaces elon musk before it replaces your electrician or your plumber or your masseuse way before right so we have to internalize the the reality of that if again this is in is in success. This is all good things happening, right? And we have to have a new ethic. We have to have a new economics based on that ethic, which is, you know, UBI is one solution to this. Like, you shouldn't have to work to survive, right? Universal basic income. Yeah, there's so much abundance now being created. We have to figure out how to spread this wealth around, right?

We've got a cure for cancer over here. We've got perfect, you know, photovoltaic-driven economies over here where it's like we've solved the climate change issue. You know, we're just pulling wealth out of the ether, essentially. We've got nanotechnology that is just birthing whole new industries, but it's all being driven by AI. There's no room in the city. Whenever you put a person in the decision chain,

you're just adding noise. This is the best thing. This should be the best thing that's ever happened to us. This is just like God handing us the perfect labor-saving device, right? The machine that can build every other machine that can do anything you could possibly want. We should figure out how to spread the wealth around in that case, right? This is just powered by

sunlight no more wars over resource extraction it can build anything we can all be on the beach just hanging out with our friends and family right like did you believe we should do universal basic income where everybody's given like a month something We have to break this connection. Again, this is what will have to happen in the presence of this kind of labor force dislocation enabled by all of this going perfectly well, right? Like this, again, just as pure success, just AI is just producing good things. And the only bad thing is,

is putting all these people out of work. It's coming for your job eventually. I've heard this and my issue with it and my rebuttal when i talk to my friends about this idea of universal basic income when we you know we hand out enough cash or resources to people so that they're stable which i'm not necessarily against but just just want to play with it a little bit is humans seem to have an innate an innate desire for purpose and meaning yeah and we seem to be designed and built psychologically for labor and for discomfort.

But it doesn't have to be labor that's tied to money. Like we will get our status in other ways and we'll get our meaning in other ways. And again, these are all just stories we tell ourselves. I mean, like, you know, you're talking to a person who knows it's possible to be happy actually doing nothing, right? Like, like just sitting in a room for a month, right? And just staring at the wall, right? Like that's possible, right? So, so, and yet that's most

people's worst nightmare, you know, solitary confinement in a prison is considered a torture, right? And I know people who spent 20 years in a cave, right? So it's like there are capacities here that are worth talking about. But just more commonly, I think we want to be entertained. We want to have fun. We want to be with the people we love. We want to be useful in relationship. And insofar as that gets uncoupled from the necessity

of working to survive, right? It doesn't all just go away. We just need new norms and new ethics and new conversations around what we do on vacation, right? I mean, it's like what you're imagining is that if you put everyone on vacation, on the best vacation, you can make the vacation as good as possible, a majority of people will eventually be miserable because they're not back at work, right? And yet most of these people are working so that they have enough money so they could finally take that vacation, right? We will figure out a new way to be happy on the beach. Right. I mean, like if you can't, if you get bored with Frisbee, we will figure something else out that is fun. You know, you, you can read, you know, I'll be able to read the Churchill

history of world war two on the beach and not be rushed by any other imperative because I'm, you know, I, I, I'm happily retired, right? Because my AI is creating the thing that is solving all my economic problems, right? Um, you know, we should be so lucky as to, as to have that be our problem, like how to be happy in conditions of no economic imperative, no basis for political strife on the basis of scarce resources, and no question about... The question of survival is off the table with respect to what one does

with one's time and attention, right? You can be as lazy as you want and you'll still survive. You can be as lazy as you want and you'll still survive. You can be as unlucky as you want and you'll still survive. And the awful situation we're in now is that differences in luck mean everything, right? Someone is born without any of the advantages that we have. We don't have a system,

we don't have an economic system that reliably gives them every advantage and opportunity they could have. It's like we just, we don't have the, apparently we've convinced ourselves we either don't have the resources or we've convinced ourselves

we don't have the resources. We don't have the resources or we've convinced ourselves we don't have the resources. We don't have the incentive such that we access the resources so as to actually come to the help of people we could help. Right? I mean, the idea that people starve to death is just, it's unimaginable. And yet it still happens. You know, that's not a scarcity problem. It's a political problem wherever it happens. And yet all of this is tied to a system where everyone has convinced themselves that it's normal to really have one's survival be in question if one doesn't work. Right.

And by choice or by accident. Like if you get, if you haven't, you know, I think it's still true that in the, at least in the US, this is almost certainly not true in the UK, but in the US, the most common reason for a personal bankruptcy is, you know, overwhelming medical expense that just comes upon you for whatever reason. You know, your wife gets cancer, you guys go bankrupt solving the cancer problem or failing

to solve the cancer problem. And now everything else unravels. Right. And we have a society which thinks, yeah, well, unlucky you, you know, that's, you know, if you wind up homeless, just don't sleep in front of my store because I need my, you know, you're going to hurt my business. Successful AI that cancels lots of jobs, it would only be canceling those jobs by virtue of producing so many good things, so much value for everybody, that we would have to figure out how to spread that wealth around.

Otherwise, we would have to figure out how to spread that wealth around. Otherwise, we would have an amazingly dystopian bottleneck for a few short years, and then we would just have a revolution. communities, making trillions of dollars based on them having gotten close enough to the GPUs that they that, you know, some of it rubbed off on them. Yeah, they'd be dragged out of their houses and off their Gulf streams. And, you know, we would have a fundamental reset, we have a hard reset of the political system. If I had to put you in a yes or no situation and ask your intuition the question now that if your objective was to which i'm sure it is is to encourage the betterment of humanity and to increase our odds of happiness and well-being 100 years from now and there was a button placed in front of you and it would either end the development of artificial intelligence as we've seen it over the last decade,

so we'd never proceed with developing intelligent machines, or not. So you could press a button and stop it right now. What would you do? Stop it permanently such that we never then do that thing? We just never figure out how to build intelligent machines? Pause it indefinitely. Well, I would definitely pause it

to a point where we would get our heads around the alignment problem. Permanently. If the button was a permanent pause that you couldn't undo. Well, the question is, how deep does that go so like we we have everything we have now but we just never gets better than yeah we never make progress from here right um and your objective is to make humanity happy and prosperous i mean it's hard because

when you when you begin imagining all of the good stuff that we could get with super with with aligned superhuman ai well then you know then the it's just you know cornucopia upon cornucopia it's just everything is everything is potentially within reach yeah i mean i i take the existential risk scenario seriously enough that i would i would pause it you know i would say it. I think we will eventually get to it. If curing cancer is a biomedical engineering problem that admits of a solution, and I think there's every reason to believe it ultimately would be, we will eventually get there based on our own muddling along

with our current level of tech, currently information tech. I'm reasonably confident of that. Because our intelligence shows every sign of being general. It's just it's not as fast as we would want it to be it's not it's not what the thing that ai is going to give us is is going to give us uh speed that is um i mean there's speed and there's the the access there's memory right it's like and like, we can't integrate, we don't have the ability, we have, no person or team of people can integrate all of the data we already have, right? So like the real promise

here is that these systems will be able to find patterns that we wouldn't even know how to look for and then do something on the basis of those patterns. I think an intelligent search within the data space by apes like ourselves will eventually do most of the great things we want done. And there isn't... I mean, the problems we need to solve so as to safeguard the career of our species and to make civilization durable and sane

and to remove this sort of Damocles that is over our heads at every moment, that at any moment we could just decide to have a nuclear war that ruins everything or create an engineered pandemic that ruins everything. We don't need superhuman intelligence to solve all those problems. And we need an appropriate emotional response

to the untenability of the status quo. And we need a political dialogue that eventually transcends our tribalism. You and I'd say a few others, maybe two or three others helped change my mind about one of the most profound things I think anyone could believe, which was when I was 18, I believed in Christianity.

And then there was a couple of moments that shook my belief nothing on a personal level just a couple of ideas that managed to sort of infect my operating system that led my curiosity towards um your work and i changed my mind profoundly it's such a profound change that i had um how do we change our minds and i and i really want to i really want to focus that question on the the individual the individual's mind like i want to change my mind i want better beliefs better ideas in my head that are going to allow me to get out of my own way um because i i'm not a cheat i'm miserable i'm not living the life that i

i would say i i know i can live but some people don't even know they can live live a better life Because I'm miserable. I'm not living the life that I... I would say I know I can live, but some people don't even know they can live a better life. I'm not happy. That's the signal. And I want to rectify this in some way. Yeah, well, there are a few bright lines for me. I mean, take our ethical lives and our relationships to other

people, right? So there's the problem of individual well-being that kind of is still real, even if you're in a moral solitude, if you're on a desert island by yourself, you really don't have ethical questions that are emerging because you're not in relationship to anybody else, but you still have the problem of how to be happy. But so much of our unhappiness is in collaboration with others, right? We're unhappy in our relationships. We're unhappy professionally. And it's worth looking at how we're behaving with other people. For me, the highest leverage change I ever made, and it's, again, it's very easy to spell out and it's very clear, and ultimately it's pretty easy, is just to decide that you're not going to lie about anything, really. I mean, there might be some situations in extremis where you'll feel forced to lie,

but those, in my view, are analogous to acts of violence that you may be forced to use in self-defense, right? So lying is sort of the first stage on the continuum of violence for me, right? So I'm not going to lie to someone unless I recognize that this is not a rational actor who I can possibly

collaborate with. This is someone I have to be I have to avoid or defeat or otherwise contain their propensity to do me harm. So yes, if the Nazis come to the door and ask if you've got Anne Frank in the attic, yes,

you can lie or you can shoot them these are not normal circumstances but that aside every other moment in life where people are tempted to lie is one that I think you can categorically rule out

as being unethical and being beyond unethical. It's just not, it's, it's creating a life. You don't, when you, when you examine it, you don't want to live. Right. I mean, the moment you know that you're not going to lie to people and they know that about you. It's like all of the dials get,

the social dials get sort of recalibrated on both sides. And then you find yourself in the presence of people who don't ask you for your opinion unless they really want it, right? And then when you're honest i mean then then it's it's not it's a night and day difference when you're giving people feedback critical feedback and they know you're honest right they know they're they they you know their their bullshit detector is not going off because they just know you're, even when it's not convenient, you're being honest. Or even when it's not comfortable, you're being honest.

One, that's incredibly valuable because basically you're giving them the information that you would want if you were in their shoes. Because we have this sort of delusion that takes over us. Whenever we're tempted to tell a white lie, we imagine, okay, this person doesn't want, it'd be much better for me to just tell them the kind fiction than tell them the uncomfortable truth, right? But we don't do the, so we don't even calculate for the golden rule there most of the time and we if you if you just took a moment you'd realize oh wait a minute does someone who is actually doing a bad job want me to tell them that they're doing a good job and then just send them out into the world to bounce around other people who are going to be recognizing as I just did that the thing they're doing isn't so great right um you're just not doing them a favor right this is part of the

nature of belief change isn't it that when someone we believe that someone is on our side or we believe from like a political standpoint that they they represent the 99 of the views that we represent we're much more likely to change our beliefs I spoke to Tali Sharot about this the neuroscientist and i wrote about this in a chapter in my upcoming book about how you how you change people's minds and they showed in the elections that if like a flat earther says something to a flat earther about the nature of the earth i believe it but if nasa says something to a flat earther they will just dismiss it on site because the source of that information is not one that they believe or trust or like or believe is well-intentioned i mean this this is a bug not a feature i mean it's understandable but this is something we have

to grow beyond because the the truth is the truth right so you can't i mean it goes in both directions the person on your team who you love and respect is capable of in their very next sentence of speaking a falsehood right and you need to be able to to detect that and conversely you know the the person you least respect is capable of saying something that's that's quite incisive and worth taking on board and and so that's we have to we have to have this sort of meta-cognitive layer where we're noticing how we're getting played by our social alliances and recognize that the truth, and rather often important truths, are evaluated by different principles.

I mean, it's not a matter of the messenger the messenger you know you shouldn't shoot the messenger and you shouldn't worship him you mentioned lying as being a well removing lying and being more honest as being a significant step change in your own happiness is that accurate in my happiness yeah yeah yeah um so immensely so because it's it's how practically and specifically how so you and when you look at how people ruin their reputations and their relationships and their businesses their careers the gateway to all of the misbehavior that accomplishes that is line it's i mean look at somebody like Lance Armstrong, right?

I mean, just, or Tiger Woods, right? These guys are the absolute apogee of sport. Everyone loves them. Everyone's just amazed at what they've accomplished. And yet, you know, the dysfunction in their lives just gets vomited up for all to see at a certain point. And it was just enabled at every stage along the way by lying. before they became rich, before they became tempted to do anything that was going to derail their lives later on, if they had decided they weren't going to lie, right,

they would have found everything else they did to screw up their success impossible. So when I decided, and this was in the book, this was a course I took at Stanford. It was a seminar with this brilliant professor, Ron Howard, who many people, I think some people in Silicon Valley have taken his course as well. I mean, this course was just like a machine. undergraduates and graduate students would come in on one side and then 12 weeks later would come out convinced that basically lying was no longer on the menu. It's just, it was, the whole seminar was an analysis of the question, is it ever right to lie? And really we focused on white lies, truly tempting lies

as opposed to the obvious lies that screw up people's lives and relationships. It's just so corrosive. And it's corrosive of relationships in ways that you, unless you're a student of this kind of thing, you don't necessarily notice. I mean, one example I believe is in that book is that I remember my wife was with a friend and the two of them were out and the friend had something she had to do with another friend later that night, but she didn't really feel like doing it. And she got a call from that friend in the presence of my wife. And she just lied to the friend to get out of the plan. She said, oh, I'm so sorry, but my daughter's got this thing. And it was just an utterly facile use of dishonesty to get –

or she could have just been honest, right? But it was just too awkward to be honest. So she just got out of it with a lie. But now it's in the presence of my wife. And my wife is now, the immediate question is, how many times have I been on the other side of that conversation, right? How many times has she lied to me

in an equally compelling way about something so trivial, right? And so it just eroded trust in that relationship in a way that the liar would never have known about, would never have detected it, because it's just, she just went right back to having a good time with, you know, they were just out to lunch and they continued, you know, having their lunch and they're still having a good time and it's all smiles. But my wife has just logged something about kind of the ethical limitations of this person. And the person doesn't know it.

Right. And so once you sort of pull on this thread, you basically your entire life becomes, at least for the transition period, until this just becomes a habit you no longer have to consider um suddenly it's your your the world becomes kind of mirror thrown up to your mind and you and you're you meet yourself in all these situations where you were avoiding yourself before so like someone will say you know do you want to have plans or do you want to, do you want to collaborate with me on this project? And if previously you, you always had recourse to some kind of white lie that just got you out of, you know, the awkward truth, which is the answer is no. And there are actually reasons why not, right? You never have to confront the awkwardness of that.

You're this kind of person who has these kinds of commitments and this kinds of, you know, it's like, you know, I mean, the most awkward one would be, you know, someone declares a romantic interest in you and the answer is no. And it's no for a totally superficial reason, right? Like this person is, they're not attractive enough for you, right? Or they're overweight or whatever. I mean, it's just like you have your reason why not,

and this is something you feel you cannot say, right? Now, I'm not saying that you should always go out of your way like someone with Tourette's who just helplessly blurts out the truth. Like there's a scope for kindness and compassion and tact. But if someone is going to really drill down on the reasons why not, if the person says,

no, I want to know exactly why you don't want to go out with me. There's something to discover on, on, on either side of that true disclosure, right? Like either you are cast back on yourself and you have to realize, okay, I'm such a superficial person that it doesn't matter who anyone is if they're 10 pounds overweight i'm not interested right that's that's the mirror held up to your mind it's like okay all right so you're that kind of person do you want to still be that kind of person do you really want to just decide that everyone no matter what their virtues right and no matter what has been going you know what no matter what chaos is going on in their life, this person might actually lose those 10 pounds next month and you would have a very different situation. But are you really filtering by weight in this way?

And are you really comfortable with that? And are you comfortable saying that if somebody forces you to actually be honest we have a closing tradition on this podcast where the last guest leaves a question for the next guest not knowing who they're going to leave it for the question that's been left for you impeccable handwriting where do you want to be when you die describe the place time people smell and feeling well this actually uh connects with an idea i've i've had i mean i think what we need we haven't talked about psychedelics here but um there's there's been this renaissance in research in psychedelics and it's hard to know.

I'm worried that we could recapitulate some of the errors of the 60s and roll this all out in a way that's less than wise, but the wise version would be, I think we need to recapitulate something like the mysteries of Eleusis, where we have rites of passage that are enabled by, in many people's case, psychedelics and the practice of meditation. I just think these are just fundamental tools of insight that are... I mean, for most people, it's hard to see how they would get them any other way, right? I just think, you know, there's a longer conversation about which molecule and how and all that.

But another component of this is, I mean, a hospice situation where the experience of dying is as wisely embraced and facilitated as is possible. And I think psychedelics could certainly play a role for many people there. So I imagine something like we need a, we need places that are truly beautiful that where, you know, people have gone to die and their families can visit them there. And it is just a final rite of passage that is embraced with all the wisdom we can muster there. And yeah, so in my case, I would want to be in...

Currently, I'd be happy to be home, but wherever home is at that point, I would want a, um, I would want a view of the sky, you know, and it could be an ocean beneath the sky. That would be ideal. Um, I just, I mean, there's, there's basically nothing that makes me happier than just looking at a blue sky with just, just watching like cumulus clouds move across a blue sky. I mean, it's just like I can extract so much mental pleasure just looking at that. Right.

It's just, I mean, it's, um, so yeah, if, if I'm going to spend my last, uh,

hours of life looking at anything, if my eyes are going to be open, you know, looking at the sky and having the stars with the sky the daytime the sky the daytime yeah yeah i mean if i were if i light pollution is enough of a thing in my world that i go for i feel like i go for years without seeing a good night sky um so i've kind of given up hope there but I do love that but yeah just a view of the sky and with the people I love

at that point who are still alive at that point yeah I mean I'm not worried about death in that sense I mean I really I think it's the death part is not a problem. I mean, I can't say I'm looking for, I can imagine there could be sort of medical chaos and uncertainty and all of

the, you know, the weirdness that happens around the dying process, right? Depending on, um, and there are all kinds of ways to die that I wouldn't choose. Um, but having a nice place to do that, um, with a view of the sky would be the, the only solution I think I would require. The question asks the smell. Give me the smell, smell it. Give me an ocean breeze. I have put an ocean there. So yeah, an ocean breeze would be perfect. Sam you so much thank you for um not just

this conversation as i said to you before you sat down you were pivotal in um really helping me to unpack some problems when i was younger some conflicts i should describe them as with my my view on religious belief and um and the nature of the world but i think more more importantly you didn't you didn't rob me of my religious beliefs and leave me with nothing. You left me with something else, which is something that was really important to me, which was the idea that there can still be great meaning

and there can be what you describe as spirituality in the absence or in the place of that religious belief. Religious belief gives people a lot of things. And it's funny because when I was religious and I went on the journey to becoming agnostic let's say um i was in conflict with people as in i would want to have a debate with everybody yeah and i spent those two years watching everything that you and richard dawkins and hitchens had all done and then i came out the other side and it was peaceful yeah and it's you believe what you want i'll believe what i want um as long as

we're not causing any conflicts with each other and you're not doing any harm it's okay yeah and then i discovered what i would call my own spirituality which is my meaning the meaning that i see in the world around me and um and the self and things like psychedelics and it's a it's a better place to be and it removed my fear of death which i had as a religious person oh nice that's good. So thank you. Yeah. Thank you for that.

And all your subsequent work, you know, incredible books. You've written so many of them that are absolutely incredible. You've got an unbelievable podcast, which I was gorging on before you came here as well in an app, which I mean, if you could speak just a few sentences about the meaning of the app and what you do. I know it's much more than meditation now, but I think people listening to this might be compelled to check it out and download it. Yeah. Well, so I had that book, Witcher Hole and Waking Up, which is where I talk about my experience in meditation and just how I fit it into a scientific secular worldview. And it just turns out that an app is a much better delivery system for that

kind of information. I mean, it's just hearing audio. You don't even need video. I think audio is the perfect medium for it. So when that technology came about or when I discovered it, I just felt incredibly lucky to be able to build it. And so it's kind of outgrown me now. There are many, many teachers on it and many other topics beyond meditation that are touched. But it really subverts all of the problems that some of which we touched upon here with the smartphone. I mean, like the smartphone has become

this tool of fragmentation for us. It fragments our attention. It continually interrupts our experience, depending on how you use it. But most of what we do with it, you know, you're checking Slack, you're checking your email, you're checking your social media. You're just, it's punctuating your life with all these, you know, at this point, seemingly necessary interruptions. But this app or, you know, any, really any app like it that's delivering this kind of content subverts all that because it's just, this is, this is, it's just a platform where you're getting audio that is guiding you in a specific, very specific use of attention and a sort of reordering of your priorities and getting you to recognize things about your experience that you wouldn't otherwise see.

And yeah, an app is just by sheer good luck, it turns out it's just the perfect delivery system for that information. So yeah, I just felt very lucky to have stumbled upon it because again, 10 years ago, there were no apps and it was just all I could do was write a book. Sam, thank you. Yeah, thank you.

Thank you so much for your generosity. Yeah, a pleasure to meet you as well. Congratulations with everything. It's really, I was catching up on your podcast in anticipation of this. And it's amazing the reach you've got now. So, it's wonderful. No, we're all still trying to catch up with it,

but it's a credit to all of the team. And I really want to say from the bottom of my heart, thank you. Because the work you do is really, really important. It's been important in my life, as I've said, but it's just really important. And I feel like we're living in a world where like nuance and all the things you've talked about

and openness to debate and honest dialogue us we're getting further and further away from there so if there's anyone left in this world that's still willing to engage on that level i feel like they must be protected at all costs and i see you as one of those people so thank you nice nice well to be continued Thank you.