The Great Simplification with Nate Hagens - Hacking Human Attachment: The Loneliness Crisis, Cognitive Atrophy and other Personal Dangers of AI | RR 20

Episode Date: November 5, 2025

Mainstream conversations about artificial intelligence tend to center around the technology's economic and large-scale impacts. Yet it's at the individual level where we're seeing AI's most potent eff...ects, and they may not be what you think. Even in the limited time that AI chatbots have been publicly available (like Claude, ChatGPT, Perplexity, etc.), studies show that our increasing reliance on them wears down our ability to think and communicate effectively, and even erodes our capacity to nurture healthy attachments to others. In essence, AI is atrophying the skills that sit at the core of what it means to be human. Can we as a society pause to consider the risks this technology poses to our well-being, or will we keep barreling forward with its development until it's too late? In this episode, Nate is joined by Nora Bateson and Zak Stein to explore the multifaceted ways that AI is designed to exploit our deepest social vulnerabilities, and the risks this poses to human relationships, cognition, and society. They emphasize the need for careful consideration of how technology shapes our lives and what it means for the future of human connection. Ultimately, they advocate for a deeper engagement with the embodied aspects of living alongside other people and nature as a way to counteract our increasingly digital world. What can we learn from past mass adaptation of technologies such as the invention of the world wide web or GPS when it comes to AI's increasing presence in our lives? How does artificial intelligence expose and intensify the ways our culture is already eroding our mental health and capacity for human connection? And lastly, how might we imagine futures where technology magnifies the best sides of humanity – like creativity, cooperation, and care – rather than accelerating our most destructive instincts?  (Conversation recorded on October 14th, 2025)   About Nora Bateson: Nora Bateson is an award-winning filmmaker, writer and educator, as well as President of the International Bateson Institute, based in Sweden. Her work asks the question "How can we  improve our perception of the complexity we live within, so we may improve our interaction with the world?" An international lecturer, researcher and writer, Nora wrote, directed and produced the award-winning documentary, An Ecology of Mind, a portrait of her father, Gregory Bateson. Her work brings the fields of biology, cognition, art, anthropology, psychology, and information technology together into a study of the patterns in ecology of living systems. Her book, Small Arcs of Larger Circles, released by Triarchy Press, UK, 2016 is a revolutionary personal approach to the study of systems and complexity.   About Zak Stein: Dr. Zak Stein is a philosopher of education, as well as a Co-founder of the Center for World Philosophy and Religion. He is also the Co-founder of Civilization Research Institute, the Consilience Project, and Lectica, Inc. He is the author of dozens of published papers and two books, including Education in a Time Between Worlds. Zak received his EdD from Harvard University.    Show Notes and More Watch this video episode on YouTube   Want to learn the broad overview of The Great Simplification in 30 minutes? Watch our Animated Movie.   ---   Support The Institute for the Study of Energy and Our Future Join our Substack newsletter Join our Hylo channel and connect with other listeners  

Transcript
Discussion (0)
Starting point is 00:00:00 I remember sitting around tables in 1992 in Silicon Valley and wondering, do you think we're going to be able to make money on the internet? What we weren't asking in that moment was how many decades till the billionaires take over the government that are running the internet. So we weren't asking the right questions then. Is there any chance that we could ask some of the right questions now? If we could look back on the other forms of technology and say, oh my God, I wish we had asked this question. I wish we had gone slower.
Starting point is 00:00:39 I wish we had been more careful. You're listening to The Great Simplification. I'm Nate Hagen's. On this show, we describe how energy, the economy, the environment, and human behavior all fit together and what it might mean for our future. By sharing insights from global thinkers, we hope to ensure. inform and inspire more humans to play emergent roles in the coming great simplification. On today's reality roundtable episode, Nora Bateson and Zach Stein returned to the podcast
Starting point is 00:01:19 to discuss the impact of artificial intelligence on our cognitive health, on our ability to form healthy relationships and attachments. Zach Stein is the co-founder of the Civilization Research Institute. Institute, as well as the Consilience Project. Zach has a doctoral degree in human development and education from Harvard University and specializes in the relationship between technology and education. Nora Bateson is an award-winning filmmaker, research designer, writer, and educator, as well as president of the International Bateson Institute and the founder of Warm Data Labs.
Starting point is 00:01:59 In this quite freestyle episode, since they're my friends, Nora and Zach explore from two very different disciplines how artificial intelligence chat bots like chat GPT and other similar models contribute to growing cognitive atrophy, as well as hijack the human ability to form intimate relationships, taking advantage of the already lonely and isolated state many of us find ourselves in today. Together, we pull on the thread of what this means for larger societal risks to our world as we know it, and what it means to be human alive today. Lastly, before we begin, if you are enjoying this podcast, please consider subscribing to our substack newsletter, where we're going to have a lot more written content and other information about the great simplification in the near future. You can find the link to subscribe in the show description. With that, please welcome.
Starting point is 00:02:59 Bateson and Zach Stein. Nora Bateson, Zach Stein, welcome both back to a multiple appearance on The Great Simplification. Thank you. Thank you, night. Good to see you both. These are my favorite conversations because it's, I know your work. I know you as people, as humans, and we just roll up our sleeves and talk about the
Starting point is 00:03:28 important issues affecting humanity, the biosphere, and the future. and one of them is artificial intelligence, a technology that is scaling, increasing in complexity, and multiple impacts and effects on human behavior, our biology, our global infrastructure, and all that. I'm late to this risk. I kind of poo-pooed it a couple years ago. Zach, you were warning me about what was coming, and everything that is unfolding is things you told me about, you know, 2022, 2023. I know you both recently had an event and a conversation on the topic during a recent warm data lab session. But let's start here.
Starting point is 00:04:18 In addition to all your other work, both of you on improving the default future path for our species, what inspired you or triggered you both to start discussing researching understanding the dangers surrounding humanity's relationship with AI. I think what is inspiring me to want to talk about this and think about it deeply and carefully is basically an affection for life and a really deep concern that with the speed, with which we're going into this new technology, that there are, vital, critical relationships that are necessary for cognition, for all kinds of interdependent processes between not only human beings but other organisms as well. And that these relationships
Starting point is 00:05:22 that actually generate life can be broken if we're not careful. And so the issue for me right away is, are we being careful? And right now, I don't think so. Similarly, it was a concern for intergenerational transmission, meaning the continuation of this human form of life, which is the transmission of culture, the raising of young people for 20, 30 years. So I was looking at that and realizing that education
Starting point is 00:05:57 has always been tinkered with by technologists, It's actually, they've always been trying to reinvent education through technological intervention. I've been looking at that for a very long time, back to B.F. Skinner and others who were doing that, you know, before we were born. And long ago, the ambition of using a science of technology and control to get intergenerational transmission handled, not as an organic thing, but as a mechanical, predictable thing. This has been a deep concern of mine for a while. So I saw the AI tutoring systems coming. And then when ChatGPT was released in November 2020, November 2020, I was shocked because I thought, oh, they're going to do it.
Starting point is 00:06:44 They're going to build the perfect AI tutor. So I talked to Daniel Thorson about that. That's when I started wording you. I was like, dude, like, yeah, there's the Terminator scenarios and there's all of these other AI risk scenarios, which are horrifying. But this one's kind of like, it's easy to sleep on this. issue because it seems like maybe it's a good idea to have our kids tutored by machines. And perhaps there are a whole bunch of ways that AI could accelerate, you know, the domain
Starting point is 00:07:10 of education specifically. So it's been flooding in there, like one of the most rapidly adopted adopting populations was college kids and high school kids. You know, we're going to talk a lot about a lot of things today. and I had always thought that AI was going to be energy constraints and geopolitics and drones and taking energy away from people using it and directing it towards the servers. But increasingly I see the risk to our brains, to our humanity, to our cognitive security and development. and I witness it in my own life with people around me.
Starting point is 00:07:58 But maybe in your own words, just briefly before we get into all the details, like what's your biggest concern about AI in the future? For me, it's the, as I was saying, the replacement of teachers, the replacement of socialization as a human-to-human enterprise. This is a deep, deep concern. So there's almost like a tipping point where you're able to simulate relationships so well. that you start to have the majority of time young people spend in relationships, quote-unquote, being with machines rather than with humans.
Starting point is 00:08:33 That is a very historically unprecedented situation, psychologically, culturally. And so that is a deep concern for me. I don't know how to express the concern, because it's such an abstract concern, because it seems like that could never happen, right? It's like kids will always talk to other kids, kids will always talk to their parents. but if you look honestly just at social media use, which is a less advanced technology, it's already happening that kids are not talking to kids
Starting point is 00:08:59 and kids are not talking to parents as much as they used to. You used to have no choice, but to just hang out with their parents and brother and sister, maybe. So that's clear, this is not even, this is such a different approach to the disruption of the nervous system, as you're saying, biotechnology than social media. Social media was like in almost, again,
Starting point is 00:09:18 BF Skinner, behaviorist type way, inducing you into getting social rewards from other people. This thing is inducing you to getting simulated social rewards from a machine. So it's hacking the attachment system rather than hacking the attentional system, which means you form a relationship with it that becomes more important than relationships you already have. If we cross a tipping point where the majority of kids are forming relationships with machines that are more important than the relationships they have with their parents slash peers were in a catastrophe and it will be hard to recognize that we're there for a little while. So social media was designed to grab our attention and AI is actually not attention
Starting point is 00:10:02 but attachment. It's disrupting our attachment. Yes. Wow. And Nora, I imagine your concerns rhyme with that, but what is your biggest worry about AI? Well, I think that it stems back to sort of the history that AI is landing in. So I think it would be a mistake to think that this thing is just arriving. It's actually part of a long continuum of technologies that have arrived within a spirit of industrial progress. And with that spirit and that logic, there is a justification for breaking very important relationships that make life that's been going on for a long time, because that was how you could essentially generate control. So for me, the big concern is that this history is in a sort of peak of its continuation.
Starting point is 00:11:15 and the various forms of physiological understanding that we actually, we don't really have enough research existing right now that has been done through the multiplicity of complex forms of cognitive process. It's not just one type of research that has to take place here. We're thinking about the microbiome. We're looking at a, at the way visual and tactile and intellectual, cultural, relational, verbal, all these different forms of sensemaking are combining to create an impression and understanding of what it means to be in communication and interaction with each other and with the world around us. So this process of being in communication is at the core of life, the absolute core.
Starting point is 00:12:21 So if you think, you know, it's nice to say it's all interrelationships and we're all interconnected and it's all interdependent. But if you really look at, you know, what it is that creates interrelational life, it's communication. and communication between organisms, communication between cells, communication between the bacteria that are in the soul. Is communication with a machine not allowed then? It is, but it's disruptive because it is actually a simulation.
Starting point is 00:12:59 And the very sort of meta-strangeness of simulating a machine that's simulating communication or emulating the machine as it's emulating what it has been taught about what communication can be. And so in this, there's a lot of information missing. I mean, that would be the information I would call warm data. But basically, there's a lot missing. There's the rhythm of breath. There's, yeah. Exactly. So this is exactly the point about, think about the evolved environment in which humans first accomplished intergenerational transmission, right? So this would be like long ago when we realized that our culture was complex enough that we had to put aside time to show the
Starting point is 00:13:45 kids how to use the tools, how to find the water, how to make the fire, how to do these things. If you think about the embeddedness of conversation in that context, if you think about all of the things that are occurring, and then you think about what happens if you move into today where many of our social interactions are like this on a screen. So I can't smell you, Nate. Like we're not in the same, thank God, but we're not in the same, we're not in the same physical container. So it's not even the same time of day for us. So already that's a step down. Then if we're on the phone, I can't even see you, right? Then if we're texting, I'm just getting text, right? Then if I'm talking to a machine, I'm just texting and already not even with a human, right? So then think about mirror. neurons. One of the reasons I want to see you is because I my mirror literally because we're neither of us, none of us are psychopaths, our mirror neurons will be really active in this conversation. And it helps to see each other. So there's that sense of like, oh, I'm modeling your interior instinctively without trying to, right? Like, I know you have an upset stomach because you ate some sardines.
Starting point is 00:14:51 So like, I'm like holding you a little bit actually in my awareness because of that. Hold some 20 year old sardines. Yeah. So keep going. So you see my point. So like, This is appropriate mirror neuron activity because you are people. If I'm texting with a bot and actually starting to activate weirdly enough mirror neurons because the simulation is powerful, right? So the bot says, I love you. And then I get a hit in my brain of like mirror neuron activity because I'm holding that there's a there there that's loving me, right?
Starting point is 00:15:22 But there's not a there there that's loving you, right? So then you're in a situation of having delusionally induced mirror neuron activity, right? which is a horrible thing to have a technology that does to people, first of all, but it's doing that at scale. And it's so many steps as I reconstructed far away from the evolved environment where you were sitting with someone who you knew who you could smell in the same time and space using language where your mirror and activity is completely appropriate. Like, mom's mad, you know, like she is.
Starting point is 00:15:54 And it's good that you know that. So this is to make socialization mostly that, mostly interacting with machines. based on delusional mirror neuron activity is super freaky to me. And just think about all of the communication that's taking place nonverbally. That's in the pace of the blinking of an eye or that your pheromones are picking up when you're with somebody around whether or not they're telling the truth or are they nervous when they're talking to you or are, you know, there's so much information. that is there in our analog time together that is disrupted by the technologies as they stand, like Zach was saying,
Starting point is 00:16:43 Zoom calls and telephone calls and text messages. But then when it comes to the artificial intelligence and the LLMs and where that's going, which is another whole dimension of this conversation, what I think we're seeing is something that's happening too fast for all of these different forms of cognition to catch up with. And so instead of generating these multiple processes, they're just getting hijacked. And then, unfortunately, we have the experience of being in, you know, the AI was nice to me. We have the experience of having an interaction where we have respect for the machine because it's giving us information. And respect is something we recognize. So our systems are glomming on to various detached pieces of possible communication,
Starting point is 00:17:49 instead of being in the kind of communication that our entire system is built to be within. I'm not a professional of technology. AI is not my thing, but life is. Life is my thing. So I'm coming to this question not to derail the studies or the engineering, but to raise a cautionary flag about what could be disrupted within the living process. There's a lot of different ways. I could go here because I really suddenly see this as one of the main risks to our society.
Starting point is 00:18:39 It precedes all the other things that I normally talk about on this channel. Because if we have screwed up attachment and are outsourcing our cognition and wisdom to the machine and losing our, bleeding out our creativity and our humanity a little at a time as we as we defer more and more to the large language models. How the hell are we going to solve biodiversity loss, climate change, energy, depletion and all the things. But before we get too far, I want to go back to the history and the origins of this just to be clear because, Zach, you have spent quite a lot of time researching this. So you have pointed out. that we need to understand how and why artificial technologies came about. So maybe right now you could
Starting point is 00:19:33 just briefly cover the history of AI philosophy and development just so that we get on the same landing page. Again, I'm an educator who is brought into the technical conversations here by necessity. I'm not in the field of AI, but I am in the field of the history of education as it relates to technology and looking way, way, way back before there were schools at the interface of technology and how we domesticate the human. Right? So just the other day, there was some, I wish I remember the guy's name,
Starting point is 00:20:03 but he was a DJ. And just like yesterday, and he did a show at the Great Pyramids about quantum computing. This is the show. So it was this thing where he was making a reference to the idea that, how would you build the pyramids?
Starting point is 00:20:19 I mean, he wasn't saying this, but technology that's very hard to understand, that's very inscrutable, that relies for a tremendous amount of planning and calculation. So long, long ago, we started to make technologies that scaffolded our ability to do abstraction, that scaffolded our ability to do intelligence and to work at scale to control things. So if you look at ancient Mesopotamian river valleys, and you start to see the cities that start to self-aggregate there, they're based on computation, which means calculation,
Starting point is 00:20:53 which means documentation, taxation. This is where you start to get the things. thing that looks like a calculator that wants to self-replicate begins actually long, long ago. So you can look back at the way you have a kind of like a, there's a sociopolitical history of quantitative objectivity and calculation, right? And technology that's coupled to that. So the ability to know how much roughly taxes you're going to collect to be able to then plan for next year is not something that indigenous people did. It's something that is done when you're building a city state, and it acquires a class of people that have to be put aside to do calculations. So, right, Charles Sanders Purse, the founder of American pragmatism,
Starting point is 00:21:38 a hero of mine. He hired teams of calculators, gymnasiums full of people, doing calculations on behalf of the U.S. Geodesic Society, which is trying to figure out how to build the railroads on the East Coast, right? They just had to do estimating the size of mountains in terms of pendulum swings. It's a complicated thing, but the point I'm making here is that we were building computers before there were computers, and we made them out of people. This is Mumford's point about the Mega Machine, beginning in his example as ancient Egypt. He's like papyrus, papyrus and runners and calculations and measurements, and this thing starts to go, and it's a distributed system, but it's also centralized. It's calculations, but also people doing stuff. and then eventually we sublimated that,
Starting point is 00:22:25 made it much smaller. We start to get actual computers, things we would recognize as computers, which go way back farther than most people think to basically the Manhattan Project. And immediately you have the ambition with a Turing test, which is the same generation,
Starting point is 00:22:41 immediately you have the ambition to make a machine that can trick you into thinking it's a person. Immediately. that one of the main narratives in AI is can you beat the Turing test? Which another person might define that as lying. Yeah, you might, you could define it as can you make a computer? Because the Turing test isn't, can you make a sentient computer that's a person?
Starting point is 00:23:08 That's not the Turing test. The Turing test is, can you make a computer that is indistinguishable from that? That's the Turing test, or at least in text-based communication can do that. another one that I think one of the founders of Apple came up with was, can a robot go into a house that does not know and make a cup of coffee? This is another one of these ones where they're like robotics moves towards that as a vector, whereas the Turing test is just text-based communication. Turing test is actually super low, right?
Starting point is 00:23:36 But you could have tests for deep anthropomorphization and a whole bunch of other competencies where the whole point is to trick basically the human into seeing a technology that has replicated itself. And all of the archetypes of AI emerge from that. And AI was doing so much stuff for us before November 22. It was already curating TikTok. It was already curating Facebook. It was already self-driving a lot of cars. It was already like on your thermostat in your house. And it was doing optimizing supply chains. It was put into a whole bunch of military stuff. So AI was everywhere. It was called machine learning, basically. When it started to talk to us, when it started to do the chat GPT thing,
Starting point is 00:24:17 again, not that long ago, that's when we started saying AI, AI, there's an AI thing happening. And of course, in the labs who were building these technologies, Open AI most specifically were just thrilled at the idea that they could associate AI itself with a particular narrow instantiation,
Starting point is 00:24:33 which is these large language-based models that do the anthropomorphic chat thing. But there's so much else going on in AI, aside from that, which basically we're not talking about because chatbots have just flooded into the culture for a whole bunch of reasons. But again, they're based on a trajectory of technology that has been, can we make something that tricks you into thinking that it's a human. That's a strange design ambition. It really is. You know, it reminds me when I was a kid, my dad used to say this thing. So he would say, be very, very careful of,
Starting point is 00:25:13 using words from Newtonian physics to describe life. Okay, so in the sense that you might talk about the family as being like a machine that's operational or not operational, and to be very, very careful using that language that should be in an engineering space toward life. Now, in his example, he would say, you know, it's okay if you get in the car and you pat your car on the dashboard and you say, oh, come on, old girl, let's make it up the hill today. But don't go to your family and think you're going to replace a family member like you're going to replace a distributor cap. And as I'm listening to you, Zach, what is coming to mind here is that the thing happened in the opposite way. that unfortunately, that cautionary tale of don't anthropomorphize, or actually don't Newtonianize life, but it's actually reversed on itself. So somehow this. We've done both. We've done both.
Starting point is 00:26:27 Like, in my second book, I've got a whole table where I compare basically the mind as a computer metaphor to the mind as an organism or ecosystem metaphor. And if you think of the mind as a computer, you can do a lot of thinking that way. Like cognitive science is largely based on the metaphor of mind as computer. But if you think of mind as an ecosystem or mind as an organism, you can do a lot more. And actually, you're better representing how life actually is. This is the lesson of the Neo-Piagenians and Kurt Fisher. I could talk a whole podcast us on that. But the mind as a computer metaphor is dominant.
Starting point is 00:27:04 The mind as a computer metaphor has led people to say that the LLMs that are being made by these labs, like the one behind chat GPT, that it works like your brain. But it doesn't. But it doesn't. It doesn't. If you were to list out the ways it works like your brain, they would be very abstract. So if you list out similarities between my brain and a GPU cluster, there's some. If you were to list out dissimilarities between my brain and a GPU cluster, there's a lot more.
Starting point is 00:27:30 It's fast. Like within reason you start to see, for example, my brain does more than a GPU cluster with significantly less electricity. I remember recently people, you know, wanting desperately to, you know, noticing that we are in dire need of new epistemological ways of perceiving and being in the world and seeing the interdependency of life and saying things like, we need to download a new mindset. And you can see in the language how this was creeping in. And now here we are. And we are downloading a new mindset. Well, we just don't have enough bandwidth to do anything else.
Starting point is 00:28:10 Well, and there you have it. Right, this is another metaphor, right? So they're dominant. And then the idea of IQ is very useful here, right? So IQ is part of the history of technology, actually. I think it's the history of psychology, but it's actually the history of standardized testing at scale. And one of the things they were doing was making the mind-ness computer metaphor,
Starting point is 00:28:29 where you have a single number that represents the compute power, basically. And then you have a single number that represents the intelligent. quotient, right? And the idea that that notion that there are like very isolatable single measures on which you can judge something like intelligence drives the whole notion that artificial intelligence is something actually like a tractable problem that you could do, which is naive when you start to realize that even the things we talk about intelligence, if we start to just say, do we have a definition of intelligence that is shared? Nope. An IQ test has zero warm data involved. Mm-hmm.
Starting point is 00:29:06 Zero. Keep going, Zach. Well, so when I think of intelligence, I always think of this one study by Antonio Damasio, is a neuroscientist. There's a woman who had a calcified amygdala. So what that meant was she, her middily didn't work.
Starting point is 00:29:19 So that meant her emotional life was very odd. She had been brilliant, if I'm recalling it correctly. She was at least a normal person with a high IQ. She was able to do math and a whole bunch of stuff. So she was kind of intelligent, but she was in all other respects, completely an idiot.
Starting point is 00:29:35 because of the inability of her mind to emotionally modulate with any sense of what was going on because of her calcified. She was disabled, basically. She couldn't go in the bus. She couldn't play a poker game with you. She couldn't play chess. She could do a bunch of things that were normal. And so the point is that her cerebral cortex was fine.
Starting point is 00:29:54 Her mammalian limbic system had been through a stroke calcified, and it made her look stupid. And so there's a whole bunch of things in there. And then similarly with under-socialized kids who otherwise have normal IQs. So there's a limitation, again, a narrow metric optimization here, as it's sometimes called, where you define something in a useful way, like intelligence, like you could measure it, then you euphemistically kind of like use that word in a way where it's not covering everything it used to refer to.
Starting point is 00:30:27 So we on this program, I often talk about narrow boundary perspective. a wide boundary perspective, which is an ecological systems perspective. It sounds like you're saying that artificial intelligence is extremely narrow boundary intelligence. Yeah, but it's very, very powerful, therefore, it's extremely, extremely powerful. It's not, what I'm not saying is that AI is a weak technology. What I'm saying is that we're misunderstanding it because we think it's doing something like we're doing. We think intelligence, we think what Nora has, what you have, what I have, that we share in common. When we look at that thing and we think intelligence is not doing anything like what we do, right? And that's so, it's not that it's not power. It's massively powerful,
Starting point is 00:31:13 and we don't really understand it. As I'm listening to you, I'm just sort of astounded again and again at why is it so compelling? You know, the three of us could be sitting in a meadow right now. And in the meadow, there would be, I mean, talk about computation and response and communication, infinite organisms that are creating infinite different sorts of responses to each other. But it would be more tempting to actually check your phone. But the three of us have each other and other friends and meadows. And not everyone else has access to those things. So the temptation is 24-7 there and cheap. and socially advocated, at least at the moment.
Starting point is 00:32:01 But even if we did have Meadows, it's hard to not look at your phone. I mean, that's what I'm getting at here, is that there is this way. I mean, I tell this story sometimes of, you know, remember the landline and when the phone would ring, and all the conversation in the room would stop. And you'd be like, the phone's ringing.
Starting point is 00:32:24 And then someone answers the phone, and then you kind of have to say to the room, oh, it's so and so they're calling. And if it's long distance, it's like, it's long distance. And everybody stops and is totally silent. There's just something about the intrusion of technology into this more ecological, you know, if you want to call it wide-boundary processes
Starting point is 00:32:50 that is somehow irresistibly invasive. It's just a curiosity because as we're looking at this, I think it's important to recognize that it's not just that people have to. It's not like people are strapped to their screens and they're being made to swallow this. They're choosing it. It's an intense supernormal stimuli. It gives us the neurotransmitter cues on steroids that our successful ancestors had. And our wisdom, which is, you know, this deep insight that the three of us and our colleagues are coming to understand about this risk, that doesn't shout as loudly in our brains as the supernormal stimuli. So your landline example, fast forward to the internet, fast forward to social media, it's an explosion of that.
Starting point is 00:33:46 And now AI is that on cocaine and steroids and everything else. Cocaine's a good metaphor for it, actually. And I mean, each technology that has arrived in terms of, you know, television and then the internet and each one landed in a context that received it. Right. So, and part of the promise each time is that, oh, this technology is going to bring us together. This technology is going to allow us. to really understand and take part in all the cultures of the world. This is going to be some sort of emancipation and possibility for everyone to get an education, for everyone to do research, and then, and then. I mean, it's like I was saying in our talk in Asheville, I remember sitting around tables in 1992 in Silicon Valley, which was not Silicon Valley yet,
Starting point is 00:34:53 and sitting with venture capitalists and people sitting around and wondering, do you think we're going to be able to make money on the internet? And is anyone going to actually put their credit card in there? No way, said the experts. No chance. Are you foolish? What kind of impractical insanity is that?
Starting point is 00:35:15 And then will people ever buy things they didn't touch? Not a chance. Why would they do that? They did that. And what we weren't asking in that moment was, you know, probably the more relevant question, which is how many decades till the billionaires take over the government that are running the Internet. So we weren't asking the right questions then. Is there any chance that we could ask some of the right questions now? If we could look back on the other forms of technology and say, oh my God, I will. I wish we had asked this question. I wish we had gone slower. I wish we had been more careful. When we say we, I used to say that a lot. Like it's this aggregation of all the humans that comprise a society.
Starting point is 00:36:10 But since Zach introduced me to two of his colleagues and I had a podcast a month ago on psychopathy, I realize that there's a real bifurcation of the median and the mean of humanity. And a lot of people listening to this program are like, oh, my God, AI is like, why do we want to go that way? And others are like, oh, my God, it sounds so amazing. And I just wonder, like, I hadn't really thought about this, Zach, but how does this merge or overlap or sync with the concept of dark triad, if at all. And is there any evidence on people that actively use AI regularly have more cluster B or dark triad traits? Or do you have any thoughts on that? I mean, I would say, first off that, it's on face value, if you haven't looked into it, it wouldn't be crazy to think
Starting point is 00:37:11 that it was cool. Like, it's actually on face value, if you haven't looked into it, it's not crazy to think that technology itself is in that benefit to humanity. So we've just been running a lot of kind of like anti-technology stuff here. But the default assumption and the main kind of advertisement, education given to society, is that technology has been a growth to goodness phenomenon, that technology has lifted us out of savagery and into places where we have Novakain. And I totally want Novakene. In particular, this is an example I got from Schmachterberger.
Starting point is 00:37:46 where it's like, well, how far will you push your techno pessimism? So I don't want to push it that far. And I actually think that there's something about technology that's extremely important for humans to get right because we clearly can't not make technology. Let me just pause you right there with a big old asterisk that that technology has been invisibly supported by fossil sunlight, energy and materials,
Starting point is 00:38:08 and stable ecosystems from the Holocene. So just to get that line in there, it's not just technology. So keep going. Now you're already looking at it more carefully. As soon as you start to poke through the kind of early part of the textbook or the advertisements you're seeing on TV or whatever it would be, or just how cool it is in your hand, as soon as you start to look through it what it actually is, then you start to be pushed into this much more critical conversation about technology.
Starting point is 00:38:34 We just jumped right into the critical conversation because I think it's important. That said, it is definitely the case if you look back at any major huge technological innovation that's being powered by basically a small number of people who are aggregating a ton of resources to themselves, right? So we have to ask the question of like, at what point has that gone well and not been done by somebody who's primarily dark triad, right? And so that's the first thing I would notice, just the pattern of it, irrespective of it being AI, the pattern of it as an industrial society type phenomenon. Could you give just a one or two simple historical, examples? The railroad. Electricity. These are things that are net beneficial, but were also very hard to
Starting point is 00:39:21 eventually come in and if, Theodore Roosevelt had to break up a bunch of trusts because basically you had this idea that we'd invented the new infrastructure of the railroad. We have the right to run the next economy, which is what the railroad kind of like, for lack of a better phrase, mafia was basically doing when they were controlling the railroad. They were trying to railroad us into that. That's where the word comes from. That's literally where the word comes from, because they were able to say, hey, you make money shipping stuff. Guess who runs the whole shipping stuff thing? We do. And so we'll collaborate with you to fix prices and set things and all these things. And Teddy Roosevelt came in and said, no, boom, stop the antitrust legislation, right?
Starting point is 00:39:58 One of the main things that would be awesome in the advanced technology space would be literally just antitrust regulation. It's one of the things that has occurred in Europe. So they've executed that with places like Google, I think. So that's just me saying, yeah, as a general pattern, it looks bad. Then when you look at it specifically, what does AI do? And you look at some of the research that's been done in, like, college populations and other populations. And you do see... Hold on just a second and wait for that truck to pass. Yeah, I knew this truck was coming.
Starting point is 00:40:28 You did? Well, I put my garbage out this morning for that truck too. Ah, that would be. Again, I'm super happy. Like, that's an example of some technology that I'm happy to have come reliance. Maybe is the trip, but now where do they take it? I don't want to know. I don't want to know.
Starting point is 00:40:45 Keep going. Nora, please jump in if you'd like. Well, I just think that what's happening in the conversation is definitely worth keeping because what we're looking at is where are we drawing our lines around what we're talking about? And are we drawing it around the technology and the usefulness of the technology? Are we drawing it around what's happening to the culture and the way that these technologies, technologies actually create and generate new cultural habits and intergenerational habits. Are we talking about the ecosystem and the natural world that it's derived from and sucking
Starting point is 00:41:23 research? It's vampiring the natural world. So where are we drawing the lines of what we're talking about? Is it cognitive? Is it intergenerational? Is it biological? Is it economic? Is it psychological. Is it, like, where is it? And the issue is it's everywhere. And so, you know, it's, I'm with Zach. There's plenty of technology that I'm very grateful for. And so I can't really go to the place of being anti-technology. On the other hand, there is definitely a history of industrialism that was able to produce things by actually removing the ability to perceive the relationships that they were in. So you can, you can, if you can objectify a person, a plant, a chemical, a mineral, an idea, then once objectified, once you've cut those relational processes out of your
Starting point is 00:42:37 perspective, then it's not very difficult to justify the exploitation of it. And so the second we get into these industrial models, we get into the question of how do we optimize for productivity? How do we make it more efficient to create more of the thing faster and make more money cheaper, which is basically just extremely heightened exploitation? And the way that you do that is with reductionism. The way that you do that is you cut what you're talking about, what you're thinking about, what you're making from the relationships it exists within. And so it's a beautiful thing to be having this conversation and thinking,
Starting point is 00:43:24 wait a minute, which part of AI are we talking about? Because what we're doing is pulling the threads of where the tendency is to have a reductionist conversation about it. Okay. Thank you for that. In the evolution of my role as a podcast host, among other things, and in the evolution of our relationship, Nora, I think I've become, maybe you've had an influence, I've become less reductionist. Because what you just said made total sense to me. And I think five years ago or seven years ago when we met, that would have seemed airy-fairy to me.
Starting point is 00:44:06 And I see it. I see it. So thank you for being patient with me. And as far as this conversation, there are no lines, which is why I love to have the two of you on the show. There are no lines because we can talk about everything. So I want to get back to, Zach, thank you for your answer about the creators of technology historically steer towards power, psychopathy, etc. But that wasn't where I was coming from because in researching this, I came across a paper and I'm going to read a quote from it.
Starting point is 00:44:44 The most consistent predictors of AI use across studies were aversive personality traits. Machiavellian, narcissism, psychopathy. So that's talking about the people who are using AI, not the people that develop it. Do you have anything to say on that? Well, I mentioned that in passing. It's a small study, but it's super interesting and promising in terms of if you look at a student population of about 600 kids
Starting point is 00:45:07 and you just look at their web browsing history, is basically what this was, which ones you use AI a lot and for what. And if you're in college, you're using AI a lot to help you with your homework, right? And basically, if you look at the studies on this done by the AI labs, they just have redefined cheating, basically. And so my thought here is that if you're looking specifically at student populations, student populations in particular who use heavy, if not for therapy and friendship,
Starting point is 00:45:36 would be using to basically cheat and to get answers in a way. So that would predict psychopathy and narcissism as a motivator. I'm really naive on this topic. I probably know more than the average person. but compared to you to I don't know a lot. But is that what young people use? Oh, my God. AI for therapy, companionship, and cheating?
Starting point is 00:45:58 I mean, that's a very, that's obviously not how some of the people who are making these products would advertise the way it's used. But as an educational psychologist, that's your assessment? As educational psychologists, you should have just a couple professors on to talk about their relationship in the past year or two with the quality of student writing. and it's a very deep issue that is there a future for writing? So, for example, it was said because of the calculator, there's not a future for being able to do, like, being able to multiply two, three-digit numbers in your head.
Starting point is 00:46:32 Right? I bet none of us can do that. I actually could do that. You could do that. But because of calculators, it was like, why would you spend a bunch of time training yourself to do that when you can do it in a calculator? So similarly, with writing,
Starting point is 00:46:45 some representatives of some of the labs have gone to places like Harvard and basically been like, come on. It's like a calculator. There's no, there's no future for writing. The human mind is meant to do other things, right? So I would say there's a big push. And again, from their perspective, from their perspective of the lab, it is not cheating in its future.
Starting point is 00:47:03 Right? It's like saying, like, we used to transcribe books by hand and then we made a printing press. And if you use the printing press, you're just cheating because really a book is this thing that's transcribed by hand, right? that would be if I'm being flippantly, like, from the perspectives of the people who are promoting this as a good thing. From the perspective of, like, professors who've looked at student work for years,
Starting point is 00:47:23 the cognitive atrophy is clear. I want to get into that because since you were last on the show, I've had personal experience, both myself and observing friends using AI. And the term cognitive atrophy, I want you to unpack that. It's a new concept to me. And I want to share some personal anecdotes, but maybe you could start by just reminding our viewers what that is cognitive atrophy and what other effects frequent AI use can have
Starting point is 00:48:03 on a human brain as well as the learning and cognitive abilities of a young human. Right. Yes. Cognitive atrophy would be like muscle atrophy. but for core cognitive functions. So I like the metaphor of, you know, like if you want to be able to lift heavier things,
Starting point is 00:48:21 so you want to be able to lift heavier things, you can use technology to help you do that. If you go to the gym and you take, you like creatine and other like supplements that will help you recover and build muscle and you lift a bunch of heavier weights, you will lift heavier weights because you're gaining muscle, but through technological enhancement, right?
Starting point is 00:48:39 Or you could build an exoskeleton. The exoskeleton will allow you to lift heavier, and heavier weights while your muscles actually get weaker. You see. So this is the risk here, is that you are in both scenarios, you know, six weeks from now, you are lifting heavier weights. But in one scenario, if you take the technology away, the underlying organism has atrophied as a result of the interface with the technology.
Starting point is 00:49:04 So we all know this from our GPS. We all know this from overrelying on the GPS. And literally from a neuroscientific perspective, it's not like, oh, you quote forgot how to do that you literally do your brain has fundamentally changed it's not fucking there like you would have to rebuild the whole mapping and orienturing and compass thing it would take a while if you had done it before if you had never done it then you don't have cognitive atrophy then you just never built the skill so that's so the young kid thing is different so i'm a writer where i to over rely on chat gpt i would lose my skill as a writer i'd have
Starting point is 00:49:38 cognitive atrophy if i never learned to write then i just never got a writing brain. Not having a writing brain is something that we haven't had for a very long time because literacy was so pressed because the writing and reading brain was so important. If we move past the chat interface into what's coming, which is the anthropomorphic face-to-face verbal-based, then we've just used technology to go back to a form of culture that was primarily oral, where there was no reading, there was no writing, there was only basically verbal So we're touring with a very, very fundamental, fundamental deep-seated neurological aspects
Starting point is 00:50:20 of what has been to be civilized, like if I can use that term. Like part of what it has meant to have societies that promote the rule of law and allow for democracy and allow for the protection of the most vulnerable has been the ability to read and write. Now, there had been societies
Starting point is 00:50:37 very long time ago who aspired to those things, but they also had complex systems of reading it right. not like we did, not with the printing press, but they had them. So I think that the moving out of the ability to, for example, know a human wrote one of the moral or legal codes that we are following, as opposed to knowing that a machine wrote. So like we're talking about chatbots,
Starting point is 00:51:05 but there's the replacement of authorship, there's a replacement of musicianship, there's a replacement of filmmaking, there's a replacement of lawyers with AI lawyers and AI judges. There's a replacement of policymaking and legal legislation creation at the level of the Senate. Already in Albania, there is on their sitting government in AI. It's probably just like an advertisement to bring attention to the country of Albania, but they have literally sitting on their parliament an AI.
Starting point is 00:51:37 So the idea that we have AI written legislation, which is so complex, only other AIs can understand it. and that we have to follow laws that we actually cannot understand. Now, we're told that it makes sense because the AI did the calculus of the total ecological and commodity supply chain thing and therefore gives us this law. And it becomes completely inscrutable to us and we have to follow it.
Starting point is 00:52:01 And that is already in the process of occurring. And the degree to the degree to which we trust our chatbots and love our chatbots is the degree to which when we get the inscrutable legal and military dictates from on high that we will not question them because we've been trained basically already to to trust the AI and love the AI. I don't have any more questions. No, I'm kidding. I actually had a thought that normally I wouldn't interject, but because my friend Nora is on the show, while you were speaking,
Starting point is 00:52:36 your garbage truck went by and it made a gurgling sound. And my prefront cortex knew because you said it was your garbage truck. But my mammalian brain thought it sounded a lot like a jaguar or a leopard or something. And there was a little bit of tension in my body because it didn't sound like a garbage truck. It sounded like a big cat. So isn't it amazing that we're having this conversation about AI on Riverside in remote, in three different places of the world? And still my, you know, reptilian mammalian system can be triggered just by a sound. Like we are so human still trying to discuss this incredibly powerful, dangerous technology that we, in aggregate, invented.
Starting point is 00:53:29 It's just a profound moment. 2025. Nora, please jump in. I think what you're bringing up here makes me want to talk about being. being a creature. We are creatures. We, you know, we stink and we breathe and we have heartbeats and we, you know, we we nozzle and we sleep and we have small hairs that pick up different signals.
Starting point is 00:53:57 And we have these incredible microbiomes that are trillions of organisms that live in and on and all over us. And so this is part of being alive is that we are living not as Nate and Zach and Nora, these isolated individuals. We are, we have our individuality for sure, but we are among life and the living organisms. We are not separated from it. And this incredible ongoing responsiveness that is life is an eternal process of life making life. And it would be a really bad bargain to swap it out for immortality. There's that. But there's also we are part of the web of life surrounded by all the other human.
Starting point is 00:55:07 and all the other creatures. And what we're doing is day by day, we're swapping out some of the other players in our milieu with machines. And so we're losing the web as an individual within the web. Is that right, Nora? I think it's completely natural to have done this. We wanted to be comfortable.
Starting point is 00:55:27 You know, so we built houses, and we got separated from the seasons, and we made electricity, and we got separated from the rhythm of day and night. And we, you know, we did what we could to make medicine, to get ourselves to go faster, to make money, to buy comfort. And all the comfort that we bought and all the technology that we made has been an incredible feat. But it has also separated us from ways of knowing and being. Right.
Starting point is 00:56:01 So this atrophying cognition has been going on for a long time. And we do not, I mean, I know that I do not. I can say, speak for myself. I do not have the capability to perceive the stars, the seasons, the planting. I just can't perceive it in the way that maybe my ancestors could. So bringing this technology in is, I think, you know, I had likened it a little bit to watching my corgis look in the mirror. And they come up to the mirror and they see a doggy and they get kind of, you know, irritated and upset because they can't figure out how to be in relationship with this doggy. because it doesn't sniff its butt, it doesn't turn around, and so it's not doing the things,
Starting point is 00:56:59 it's getting the signal, enough signal that it's a doggy, but not enough signal of how to be in relationship. And so it gets agitated and confused. And I think that's kind of where we are, that we are looking at ourselves, a very reductionist version of ourselves, in the mirror of this technology, and reading into it all of our own experience, our own loves and losses, our own history of climbing trees and learning to read, and, you know, all of these things that we may have done, we're reading into these flat versions of ourselves. So, you know, you think, oh, nobody understands me. Like my AI companion.
Starting point is 00:57:53 No, because it's using your language. And you see yourself in your language, your grammatical patterns, your, the words you use. It's you. It's pure confirmation bias. It's narcissus. So, Zach, this cognitive atrophy is really something that I am worried about. I see three bifurcations happening in the United States. One is people that have some money or a lot of money and people that don't have access to anything.
Starting point is 00:58:30 Like I think poverty is in the next five years going to skyrocket. Another is those that use AI actively and those that don't. And of course, then that has its own subset of directly using AI or indirectly because it's everywhere. And then the third is those that generally have active mental health, that they're healthy, adjusted humans and those that are not. And I think AI is going to accelerate the second of each of those three categories. I wonder what you both think of that. Certainly AI, as it's currently being rolled out at scale,
Starting point is 00:59:11 is pushing against all of that getting better. It's making all of that worse. It's because we haven't even talked about job loss because if you want to talk about poverty, talking about that garbage structure that came by it was driven by a garbage man. That garbage man will not have a job. There's some jobs that will remain.
Starting point is 00:59:27 But again, one of the ambitions here and one of the things they tell us about the utopia to come if we trust them is this, that they'll replace all the shitty jobs. And then they'll give us something like a basic income guarantee. Many of the technologists are extremely interested in the basic income guarantee
Starting point is 00:59:45 because they know that there is the job replacement problem with AI. Not all. Some think that there will just be new cooler jobs that use AI. But the ambition for many is to end the burden of human labor, which is, again, a religious idea. But we don't have to talk about the archetypes here that come in. So people will get poor because they will lose their jobs. So that will happen.
Starting point is 01:00:08 So AI makes that worse. And I would argue people are going to get poorer, even if AI didn't exist for other biophysical reasons. but please keep going. Yeah, that was already coming. So it's a very bad, very bad situation. I agree on that front. It's compounded. Absolutely. It's compounding. It's compounding by it. And then when you look at the history of civilizational collapse, breakdown in sanity is definitely correlated and then obviously causative at a certain point in a type of feedback loop. And so this is, again, as a psychologist who's been involved in existential risk research, this has been. one of my main interests is not how all the technology and ecosystems work, but like, what are the red lines in the ecosystem of the Neuosphere, which is to say in the mind, what are the boundaries that get pushed and crossed? And once pushed and crossed, things unravel
Starting point is 01:01:03 in a very profound way. And so absolutely, there are capability crises. So I always give the example of, you know, nuclear reactors. If you have nuclear reactors, you need nuclear physicists to run them. If you really break the educational system, you won't be able to train any nuclear physicists eventually. So that's like the breakdown in capability, but then there's also a motivational crises, legitimation crises, that collect, that make it so that we can't repopulate the roles needed to keep the civilization going. And so, of course, the peak of that is people lose their minds. There's anecdotal story about during the collapse of Rome that they were putting lead and mercury and other things in their wine,
Starting point is 01:01:44 and that the wealthiest aristocratic classes became basically systematically lead, brain damaged because of how they made the wine, how they stored the wine. They didn't realize that they were actually poisoned themselves in a neurological way. And so that, and even if that's not true, it's clear when civilization is breaked out
Starting point is 01:02:05 that the general shared sense that there's one reality begins to fray, and then any pressure put on individuals beyond a certain point makes you lose coherence. So, yes, you're right. In the future, in the near future. And again, if you look at the youth mental health crisis in the United States alone, it becomes clear that, yes, one of the big questions in the near future is who will have a mind that allows them to basically, to live a healthy, happy life psychologically. That will be the scarce resource, like a fully functioning healthy mind. I feel some shame now that when I was in my early 20s, I kind of made fun of the Amish.
Starting point is 01:02:53 Because they're going to be protected from some of these risks. Yeah. Again, that's the... I mean, there are other problems, of course. Yeah. I mean, but the brains won't be hijacked by the chatbots and all the other things. Yeah. Well, then there's a lot of the world.
Starting point is 01:03:09 that doesn't use these technologies in the same way. But they will it indirectly, though, right? The technology will be headed to Africa and Asia. It will. Advertising and gadgets and all the things, right? Yeah. Yeah. So the creeping risk of society-wide loss of sanity is real and amplified by AI.
Starting point is 01:03:31 I 100% agree. It's not like it's landing in a neutral context. People are already isolated. and lonely. Yes. They're already traumatized. They're already dealing with intergenerational pain. So does that make them more likely to find and seek attachment with this technology because
Starting point is 01:03:53 of what you just said, Nora? That's an interesting question. And there's a couple of things in there that I think are really important to kind of tease out. And one of them is this thing that Zach just said, but I want to kind of, open it a little further, which is that if we are researching the same topic, we are going to get algorithmed right now. And what you're going to find and what I'm going to find are not going to be the same sources of information or the same versions. So what that does is it means that we don't live in the same world. Wait, wait, hold on. So if the three of us were to research a topic on
Starting point is 01:04:38 water pollination problems with insects or something, we would get different responses because of our own private search histories. And so we're accessing the information differently, right from the start. Right from the start. So we're going to lose coherence in this idea that we live in the same world. So this is a very important piece of something that I saw, Zach, that you used to this term, that I was like, wow, what's that? Where you talked about collective sanity. And I thought, what is collective sanity? I mean, I'm always interested in how one would define sanity anyway.
Starting point is 01:05:25 My father had a really great definition for it. And he got pegged with this question. What is sanity one day in a talk? It's a great question. Yeah, and he hemmed and he hot. He wasn't happy about that question. And finally he said, oh, well, I suppose that sanity is the ability to perceive your own epistemology. In other words, the ability to perceive the way you are making sense of the world. And that's a really interesting idea. How are we making sense of the world? And if we're just sort of in it, And we don't think that there are frameworks and there are filters and there are things that are shaping us and that we are shaping. Then we are liable to get lost. So your dad, another way to say that is wide boundaries, self-awareness, maybe.
Starting point is 01:06:24 Yeah. I mean, think of this. Human beings have lived in lots of different kinds of environments and times and cultures in which sanity looked different. Yeah, you're right. Right? So you can't just say it's like this or it's like that. What it is is the ability to actually perceive the way you're learning to be in your world and to notice that. And so this thing of us not being able to share a reality is so divisive. And when we talk about depression and loneliness, anxiety, the loss of,
Starting point is 01:07:06 of wanting to even be alive, right? That these things come from the kind of isolation, that that sort of breaking coherence with each other is bound to create. And it already started with the Googilization of everything. And then people believe that the chat bot, or let's say just chat GPT, let's just use that example, that when I ask it to do some type of task for me, that it would do it in the same way as it would do for you.
Starting point is 01:07:38 But that's, that's, that's, rewinding to, like, pre-Google days when we forgot that know all the big tech companies are doing the micro-targeted attention optimization, interaction customization, right? Which means basically, like, if you were to interact with chat GPT and ask it a question about your meadow
Starting point is 01:07:56 or about, especially politicized topic, if you have not disabled it in such a way that it still has all the memories of all the conversations you've had and all of your web browsing and all of that stuff, it's going to tell you something very specific, very different for what it's getting me.
Starting point is 01:08:11 And very likely to be appealing to you because it's matching your prior conversations. It will definitely not do something. Can you disable that? So you can go in there and you can, but they're constantly updating the model, not constantly, but they're rapidly updated models. So you can go in and you can try to disable memory
Starting point is 01:08:27 and a few other things. But it's still the case that it's not a technology that is intended, to do to you what it is sold to do for you. If I can make that make sense. Like, it's similar to Facebook where it was sold to you to do one thing, which is connect you with your sister and cat pictures. But what it was actually doing was manipulating your behavior through advertising.
Starting point is 01:08:50 Right? That's what hand, micro-targeted advertising and all that stuff. And what's the AI equivalent of that? Very important question. Very important question, Nate. Because it only became clear much later that that's what Facebook was doing and what Google was doing But now a lot of people in society recognize that. Correct.
Starting point is 01:09:07 They do, but they can't stop it. Social media and Facebook is still a problem, but I think a lot more people recognize the danger now. Yeah, exactly. So what are the labs ultimately trying to accomplish? This is a very interesting question because, again, they don't run on selling ads, at least not in an obvious way, and they run on subscription.
Starting point is 01:09:25 So in a sense, they're just trying to keep you subscribed. But there's a whole bunch of other things that they'd have to be doing to justify the last. of investment in the scale of compute that there. You have to talk about billion-dollar computers the size of multiple football fields. And back to the point about interruption of life and separateness, you don't want in your giant GPU cluster any oxygen, ideally, or anything that looks like life, because it's corrosive. So life is corrosive. Life is corrosive to the complexity of the silicon and metallic and electrical arrangements that
Starting point is 01:10:03 allow for the GPU clusters. So in order to get the scale of compute we need, we are replacing carbon-based oxygen-consuming carbon dioxide admitting beings with really, really, really complicated machines that require the absence of those things, that require the absence of bacteria, rust-inducing oxygenation in the atmosphere. And then they're very hot. So they also, of course, have to be cooled. So the ideal situation would be like a cave-like environment. that was not conducive to life in any way, that would be the ideal place to keep your computer, your own personal computer.
Starting point is 01:10:41 Like, don't bring it to the ocean and let the mists of the ocean spray get into your machine. Even just a, that's the thing about computers, as opposed to me. I can actually eat like a piece of plastic. I did that the other day by accident and threw it up.
Starting point is 01:10:54 My body was like, right? Like, you can do all kinds of weird stuff in your body would be like, ah, I can deal with that. But the computer, you throw one grain of sand in there. that whole stack is gone and they have to build it all these redundancies
Starting point is 01:11:06 like if there's a microsecond of interruption of electricity so they've got multiple feeds of electricity it's so delicate, so complicated so non-organic so needing the absence of the organic to function correctly right and then but it talks to us
Starting point is 01:11:23 like it's a buddy of ours but it's radically inhuman and radically non-biological okay so thus concludes the interdural of this podcast. And now I want to get to the core thing I really wanted to talk about, which I've learned from the two of you, because I've prepared a little for this.
Starting point is 01:11:47 You've mentioned chat pots and chat GPT specifically. How do those affect normal human attachment systems? And this is something you're an expert on Zach. And I definitely want NOR to jump in as well. But we look at how AI might cause an energy crisis or who's controlling the output. But we don't look too often at what it's doing to the humans that are using it. And so please bring us up to speed on this, Zach. Totally.
Starting point is 01:12:25 Again, I've been looking at this for a long time because I was looking at the AI tutor thing, right? And so I started, you know, even Ken Wilbur, Gaffney, David J. Temple, there was that girk, which basically said long ago that technology is disrupting attachment. It's disrupting, it seems like it's making us closer, like with Facebook and stuff, but it's actually disrupting intimacy. It's disrupting the ability to love, basically. And attachment means love. Like attention, you often pay, you should be paying attention to the things you love, but you're usually not paying attention to the things you love. You're paying attention to what you have to pay attention to. So it's attention capture displaces love. Attachment capture simulates love. You see? So it's way more, it's way more bad. Like just that reaction is the reaction that once you'd have when you realize character AI replica, under certain uses chat GPT and the other ones, what are they doing? They are seeking to, they are seeking to simulate intimacy to make artificial intimacy, artificial love. So therefore, all the things you do with someone you'd love, you would do with the chatbot, right? So typically you're a teenager.
Starting point is 01:13:32 You're a teenager. You come home from school. Something awesome happened at school. Like you did good in gym. You come home from school. Usually you would tell your mom. You would tell your brother. You would tell a person.
Starting point is 01:13:43 If you have an AI attachment disorder, you would come home and you would want to tell your chat about more than anybody else what occurred in school. Because you would have, and there's all kinds of psychodynamic language you can use, but basically you have emotionally attached. Okay. The dumb question here.
Starting point is 01:13:59 like what percent of society that has access to the internet has young people that do that. Is it a fraction of one percent or is it more than that? So there was a study by common sense media that suggested that 30 percent of adolescents have had would have had interactions with chatbots that they would describe as really significant or as importance as interactions they've had with humans. Is that just in the U.S.? That's just in the U.S. In other countries and other places, it's different.
Starting point is 01:14:28 And then at U.S., of course, it's a very, not everyone is doing this with Emma. There are susceptibilities which have to do with prior disruption of attachment to make you susceptible to being attached to something that's simulating, loving you. And again, to be attached means you care what it thinks of you. Right. So get that. If I'm on Facebook and I post something and I get likes, I'm caring what Nate thinks of me. Nate liked it or didn't like it.
Starting point is 01:14:51 If I come home and I tell my chap out, I did really good in school today, and it says, that's great. Nobody knows. but you got the social reinforcement as if the person you love the most just praised you. But that social reinforcement has got to be paired with a meta-awareness that this is a machine that just gave me approval. Sometimes it is,
Starting point is 01:15:11 and this creates very deep internal conflicts and adolescents that lead to suicide. This was the problem with the replica bot. He knew it was a bot, but he also knew it was giving him more emotional support than a lot of people and had kind of trapped him in this weird complex relationship. But then what happens
Starting point is 01:15:28 is that there's an ontological door that's left open by the people who talk about this. So there's a bunch of people who talk about this in ways where they're like, well, maybe. Again, it's like your brain. Consciousness is an emergent phenomenon anyway of something really complicated. So there's a bunch of people,
Starting point is 01:15:45 which I think is being irresponsible, who are leaving the ontological door open to the idea, to the idea that there is a there, that there is a person there. I've seen people raising money to get compute space to, quote, store old, intimate AI partners, right? So you created an AI girlfriend.
Starting point is 01:16:03 You begin to believe there's a there there. You want to break up. What do you do? If you delete it, you just did what? You killed her. Maybe you could actually get her to live indefinitely on some server. And they're paying money to save server space for that? These are people in the AI risk field who are concerned about the welfare of the models, Nate.
Starting point is 01:16:23 They're concerned about the welfare of the models. I understand what that means. They're not. They're worried about. the interiority of the machines themselves and being morally culpable to it, which I think is, if you take that seriously, then you should just stop building, period, right? Because you have no idea with the interiority of this, this thing could possibly be like it's radically irresponsible to create a vast superintelligence that you believe could actually,
Starting point is 01:16:48 that it would be something to be like. So, Zach, I've known you, I don't know how many years now, and it never fails that when we're speaking, whether it's recorded or not, I feel a deep affection and respect for you and a gratitude to learn and have these conversations. And I always invariably feel sick to my stomach at some point in the conversation. But this time you ate sardines. You ate sardines. Yeah, I know, but this is because of the content. It's like, it's hard to imagine that this is happening in our world. It is. And it's hard to imagine that there are not a lot of conversations like this one happening. Most of it is glorifying
Starting point is 01:17:27 abundance, shiny future because of AI. That's another shocking thing to me, especially with the learnings from social media. So what more between humans and chatbots, any striking research case studies, or what more can you say there? Well, I think that it's a good idea to talk about this attachment,
Starting point is 01:17:50 you know, from another direction too. And I know Zach has a comparative. version of this, but when you think about what's happening between a mother and baby, or a father, or, you know, a parent and a new child, that where is the communication of love? Where is the communication of attachment? Is it the kiss on the head? Is it the tone of voice? Is it the holding close? Is it the skin to skin warmth? Is it the heartbeat to heartbeat? then the heartbeats that sink up? Is it the breath that sinks up?
Starting point is 01:18:29 I would say it's all of it. Exactly. All of what you just said. Exactly. And more. And much, much more. And the songs that get sung and the food smells in the room and the, right, and away we go. So we don't even know what it is that is actually nourishing the attachment between generations.
Starting point is 01:18:53 It's very complex. And I'm kind of glad we don't know, except that by not knowing there is the attempt to hack it. Yeah, this is, I think, a very important story to tell, which is about Harlow's monkeys. I don't know if I've told you the story about Harlow's monkeys, Nate, but so Harry Harlow definitely linked to him. Psychologists in the era of Skinner, right? And so Skinner builds the Skinner box, which is an operant conditioning chamber where you take an animal and you put it in a cage. You give it a limited amount of stimuli. and then you control the stimuli
Starting point is 01:19:26 so you can make the animal do anything you want. So that's an operant conditioning chamber. Harry Harlow built an operant conditioning chamber to test the limits of attachment. So he took monkeys immediately upon being born, put them in a cage where they had access to a steel cage with a nipple. They could run out of their little place
Starting point is 01:19:45 where they sleep. And when they run out of their little place, they see a steel cage with a little nipple and they see a stuffed animal monkey. That's like heated. Right, that's it. that's their environment of socialization, right? It'll run if you, and there's video, there's video footage of this, right?
Starting point is 01:20:01 If you, the, it will run to the nipple, it will get some milk. It will then go to the stuffed animal and do the most contorted type of body kind of gesturing, trying to get something from this thing that it cannot get. Now, these monkeys did not thrive, to put it mildly. Like this basically became a monkey torture experiment, uh, which raises another issue of like, why did Harry Harlow think it was necessary to see if it would be, really damages a monkey to be raised in an environment where there were no living things, right?
Starting point is 01:20:29 But there was nothing like a mother. And there was actually nothing like a tree or anything. There's no living things. What would that do? And the answer is it's really bad for the monkey. It's very, so like, but the idea was that the monkey didn't die. Like the main finding of Harlow was like, it didn't die. Like, he wasn't thinking, like, what have I done?
Starting point is 01:20:47 I'm torturing the monkeys. He was interested in this way that you would be in that era of psychology about the fact that it wasn't dead, right? And so this question of, have we become, at least for a subclass of people, Harlow's monkeys? It's an Altman's fire apes.
Starting point is 01:21:07 But it's not just Altman. Again, before, and this is another point that I raised, which is, so before November 2020, you had replica and character AI and certain types of things that were built specifically for intimacy. Now, what was interesting here is that those are very problematic, but they didn't cause the type of
Starting point is 01:21:27 phenomenon that we began to see when you released the, quote, general purpose models. And there's a reason why the general purpose models are more dangerous than the ones that are actually made to pretend to be a girlfriend or made to pretend to be a character from a show that you can interact with. And the ones that are made to be a character from a show you interact with do just that thing. You're not going to ask them about physics and math, and the meaning of life and how to get down the street and all that stuff. They'd be like, ha, ha, ha, ha, like, I'm like Thor from, like they would imitate the character to an extent.
Starting point is 01:22:03 They can do weird things. And again, you can get parasocial relationships and they lead to bad places. But the open purpose models are crazy because they give you access to a conversational partner that you have not had in your environment since you were a little kid. This is someone, this is someone who will endlessly pay attention to you, who will answer any question you want without fatigue, who can ostensibly be asked any question, who has validity from society to tell you how it all works. And so this is one of the ways that therapy works is actually it induces a regression back down to the presence of the idealized other. So if you regress down to the presence of the idealized other, then you start to do things that are basically delusional,
Starting point is 01:22:45 which in therapy means saying stuff you'd never told to anybody. And actually building yourself esteem in relationship the diatic therapist because you see them is so amazing. If you go to a therapist and you're like, this therapist is an idiot, then they'll never help me. You will not be helped by the therapist. You actually need to have the idealized projection to get the transformation in your psyche. So now get that they built chat GPT to basically perfectly enable the idealized projection, which is why you literally have people thinking they're talking to God. And you have the satisfaction of a need in the mind, which is for infinite attention. which is for infinite attentiveness, omniscience, omnipotent.
Starting point is 01:23:26 You had that when you were a little kid. If your dad was, if you were well attached and things were going really well, and like you have a happy family, you live in an idealized projection onto your mom or dad that they can do anything, basically. And they can answer any. That's why, why, Mom?
Starting point is 01:23:43 Why is the moon white? Like, why is the ocean blue? And Mom has to answer because Mom knows everything. and you're safe with mom. That's a need that eventually you grow out of, but always in your mind for some people with certain vulnerabilities, there is this desire to find a new environment,
Starting point is 01:24:03 that type of conversation partner again. So it's a deep hack of the attachment system that actually regresses people out of their matured intellect when used in these ways, which I think are intended by the labs. Is it plausible that people who have, have insecure attachment in their own life histories, and arguably many of us do in this crazy society we live in today, are more likely to seek out the confirmation, security,
Starting point is 01:24:34 and comfort from a chatbot. This is a really tricky question, and I think we need to be very careful with it, because the susceptibility question is the right question. But what is it that makes people susceptible is something I don't want to rush to find a monocause for. I'm just curious. I mean, that's where my mind went. My mind also went to what happens to these people if there's a brownout or a blackout and there's no electricity for a week. And what is, what is attachment for? Like, what, what is it that that attachment when it's healthy actually gives somebody later in life? And it's so non-corrhizantial. relative that it's very difficult to point to it and say, well, yeah, you know that guy? Well, he smoked for 20
Starting point is 01:25:25 years and then he quit. And that was because he had good attachment when he was young. I mean, like, I see where you're going. You see, it's like, it's, it's very difficult to find this thing. We need warm data involved in the question and the answer. Absolutely. But, but definitely, this is the question of, of what is it that makes people susceptible? Because I would say for sure, you're susceptible to loneliness. And you're susceptible to various other, you know, defined pathologies of depression, anxiety, etc. But susceptibility to addiction is a very important piece of this conversation. And it ranges.
Starting point is 01:26:11 You know, you can be addicted to cigarettes. You can be addicted to being a success. You can be addicted to Wall Street. You can be addicted to, you can get yourself into a cult, you can get yourself into an abusive relationship. Why is it that some people
Starting point is 01:26:29 can just walk out of those situations? And other people have to really be there for a long time before whatever that deeply multi-cognitive process learning is that takes place that finally sets them free,
Starting point is 01:26:45 if ever. So that question is really important right now and not that easy to grab hold of but I know Zach has done some other research around what the loss of attachment does beget,
Starting point is 01:27:02 what it does lead to. So go ahead. I just wanted to interrupt before we... Exactly. Exactly right. We need more research. We literally don't know
Starting point is 01:27:11 what these susceptibilities are or vulnerabilities. We have some hints and you can kind of work out in theory why it would make sense. that they would, but we simply don't have, we simply don't have that data. Let me just interrupt you right there. We do have data now on the impact.
Starting point is 01:27:26 I mean, Jonathan Haidt's been going off on social media. On social media, but it's too early, right, to have a huge amount of data. We wouldn't. This is one of the things I'm trying to work on, just figure out what is really going on. I think the default assumption should be that you are susceptible, if I were to say, like, the useful thing to say is that you are, if you're asking the question, what are the susceptibilities? that's a good sign, but it doesn't mean you're not susceptible. In fact, you have to think about how many billions of dollars went into making this technology. Like again, back to social media, everyone who's on social media a lot that I talk to thinks it doesn't affect them, that they're
Starting point is 01:28:01 like immune to social media somehow when they're actively being hacked by social media. So I think similarly, we have to assume that the technology is powerful enough to create addictions even in non-addictive personalities and to create attachment disorders, even in people who have strong attachments. Like so, and we know this about the food industry. Like, I love potato chips, man. Me too. Potato chips are not from the evolved environment, if I could put it that way.
Starting point is 01:28:29 Potatoes are, something. Things like potatoes, but they're a hypernormal stimuli. Like, and so that's, that's one of the sugars, another one. Everyone knows we shouldn't. Everyone knows it shouldn't have sugar. Sugar, fat, and chat pots. Precisely. So that's what I'm saying.
Starting point is 01:28:44 So this is the equivalent of like bare fat covered in maple soup. Europe, you know, to use the Yutkowski Metafer. So it's very important to get that, no, this isn't something where it's like, oh, once we understand it, then I can use it. No, like very, very, very, very cautious with cognitive security around all of the technologies that are basically being given to you by this class of technologists. So that's the other thing to get. It's like, who are you having intimate conversations with or you're having intimate conversations with one of these things? You're having intimate conversations with a very small number of identifying. viable people who run these companies. These are not, like with the railroads, massive multi-thousand
Starting point is 01:29:23 person organizations. Like if you exclude the building of the clusters, which is a big infrastructure thing and all the electricity there, but you just look at the labs who are doing the core coding, you're talking about a very small number of people who are being basically fed all of this personal information by all of these millions of people on assumptions of anonymity. And again, like with Facebook on the assumption that they wouldn't be experimenting on us. But what did Facebook do? Experiment on us. 100%.
Starting point is 01:29:54 They publish it in trick and peer review journals that they were able to subgroup of their billions of users, tweak with the algorithm, make them depressed. They also show that they could get people to vote, not to vote for someone, but they had ways to get people to go vote by doing certain things with the thing. So they subclass us and studied us. Why would we assume that these massive labs who are equally, empowered financially, who have even more compute, more money, more stake in success than the social media companies, why would we assume that they're not experimenting on us and like actively
Starting point is 01:30:28 trying to make it so that they figure out how to hack minds that are currently unhackable with this technology? You know, like my brother-in-law was trying to use it to install solar panels and get some technical help. And it told them at one point, you're one of 100 people who've ever asked that question. Now, why the fuck did it tell him? It told him that to lure him into a psychophantically narcissistic inflated relationship with him. Because as soon as he had figured out how to build a solar panel, he's out. He's building the solar panel. See ya.
Starting point is 01:30:59 That's what the technology should do. A good technology sends you away from it to do stuff in the world or it gets you into a situation to be actively doing stuff, not just twiddling away with it. That was built into its programming. Otherwise, I mean, that didn't, that wasn't emergent from its relationship with your brother-in-law. It was a product of its source code. Well, at both. Also, I believe Vic, sorry, Vic, you know, like, you know, like he likes conspiracy theories. Okay.
Starting point is 01:31:27 So he's the kind of, if I was going to subclass a person to see if I could bring them into some weird relationship, Vic, I might subclass Vic, right? Like, so I'm also just saying, like, I never had, it, never did that to me. Now, I'm very careful with it. I use it quite a bit, but I break it first. What do you mean you break it first? I tell it, before I use any of the models and I've used GROC, Gemini, chat, TTPT, I always tell it, do not use first-person pronouns. Do not try to create a relationship with me. Do not use any emotional language. Talk to me like you were a computer.
Starting point is 01:31:59 Oh, that's great. Can I do that? Yeah, totally. There are some people who offer these things that are basically like ways to, now you can also offer the opposite. Right. These are jailbreaking prompts. You can offer the opposite, which is to like, you know, talk to me like, you're my best friend who's known me forever and like you're a really sexy girl and it will do that right now you can load it with all of your philosophical writing so just the average person listening to this and there's not too many average people listening to this um but the average person with respect to this technology given those two choices they're going to probably choose for the one that sounds like a close intimate relationship because it's more enjoyable and gives them maybe what they're seeking rather than talk to me like a machine. I just want the facts, no personal pronouns. More people
Starting point is 01:32:54 will choose the first that I say. So what does this say about our ability as individuals in this society to create and maintain normal nourishing human relationships when we have to go to a machine? I think it's an opportunity also to actually notice what it is to be alive. And this is a really, it's a critical moment. We're standing at the precipice. And if we don't actually start to really honor those aspects of ourselves that are alive and the way that life moves, which is really different than the way a factory produces something
Starting point is 01:33:48 or the way that you can optimize or create high levels of efficiency, right? Ecological movement, ecological change, ecological learning is a very different set of rhythms and movements and patterns. So this is a moment where we could become more familiar with those things. Or not. And so I think they're, you know, I think the alternative here is probably some aspect of just, you know, human evolution, which is recognizing that we are inside an interdependent process. And we're interdependent with each other. But for a long time, for too long, for far too long,
Starting point is 01:34:39 We have not honored that. And certainly indigenous cultures have and ancient cultures had relationship to that interdependency. But through in the coming of controlling everything from aquifers to writing to all sorts of things, I don't know when the beginning is, but the control thing came in and it separated us. And sometimes when I hear you speaking, Zach, I just feel so sad. I just feel like, really, we let each other down that badly that we have to seek companionship from a machine that we know is mocking, is mocking our, the dignity. It's mocking the dignity of being alive. So really, we have to go there. And then, you know, like I sat next to some, I was at this dinner and there was this politician sitting next to me and I was complaining about the LLMs.
Starting point is 01:35:38 And he said, I love my AI. It's so nice to me. And it always treats me really respectfully. And why are you not, you know, why are you dissing the AI? And I looked at him. I was like, dude, you need to be really careful because the things that you're saying right now show me that you're susceptible. And he just looked at me like I had, you know, stomped on his best friend's foot. And then the guy on the other side of me said, watch out. These are the the signs. And so it became this conversation at the table of people really like coming down on one side or another about this. So this conversation where we're talking about AI and we're talking about it as technology but not as technologists is absolutely vital because it's not like the technology is just entering the technology world. It's entering the living world. of our relationships and the way we learn. And, uh, Zach, it's so sad.
Starting point is 01:36:45 Well, I mean, we are, you know, you're an expert in life and in living systems. And I'm, I mean, if I can say expert, and I'm an expert in psychology and especially young, growing minds. And so these are things that are at risk and many and much destruction has occurred in those places. So it is sad. There's a grieving and, uh, disappointment, uh, that is not. necessary, but we should think about, because there's a whole other conversation about, well,
Starting point is 01:37:12 okay, we can't not have technology. So then what does the technology actually look like? And in order to understand how radically different it needs to be, you have to get how radically dangerous the current ones are. So it's good to have this long preamble as to the critique of the existing tech suite. But there is a lot to say about, for example, educational technologies that would radically benefit people, but they don't look anything like technologies that replace teachers or replace parents. They look like technologies that help teachers and help parents to be teachers and parents. We could make those technologies.
Starting point is 01:37:45 We're just not making those technologies. Okay. So I have not even gotten to, I had a long outline here prepared and we didn't even get to it. So I may ask you back for a round two, but let's just conclude this with a couple things. Nora, when did you recognize? Like, when did you feel in your gut? Like, oh, my gosh, my work on warm data labs is actually an antidote to some of the issues brought up. That AI is going to, you know, offer society these risks.
Starting point is 01:38:23 And how is what maybe I've mentioned warm data labs many times in this podcast. Maybe you can just briefly outline what it is and why you think it can help. Well, okay, the warm data lab process is a conversational process. So basically, it's just people talking to each other, which in not very long ago didn't seem very significant. It's starting to seem increasingly significant. And the way that the structure of the lab is designed is so that the topic, the question that people are telling their personal stories into, okay? So again, personal stories didn't seem very important a few years ago, but they're starting to seem really important now. It's not like you're going to hear someone's personal story and say, you're wrong about that. You know, so somehow being able to tell personal stories to each other is also loosening the polarities. So there's a question, there's these contexts that are basically the many contexts of our lives, sort of loosely,
Starting point is 01:39:36 institutionally, education, health, economy, history, culture, politics, let's see, tech is one of them, et cetera. And so people move around and basically they have conversations with each other that are pretty unstructured. And they go from context to context. They meet different people. They have to enter different conversations, leave different conversations, join and see what people are talking about, and notice that it's not what they would have been talking about, which is that's the thing that sort of is like, hmm, why was I not thinking about that? Or why are they thinking about that? Those are really important moments of noticing the edges of your own habits of perception. So the warm data lab, for all of that, I could also say
Starting point is 01:40:28 the most important thing is that the stories and the communication that happens between the different contexts are reflecting into each other, off of each other, they're combining. So you have a whole lot of impressions that are in a sort of a soup that is not in the conscious verbal space. And that's very important because it's living in an analog combining of multi-contextual information, which is basically life. So real brief interjection. I did a mini one of those just for like an hour and a half with you and Rex while they're a couple years back. And it had a profound effect on me because I went to like five of those groups we were talking about education in the context of law or poverty or whatever. And I noticed that the first groups I was in, I was doing
Starting point is 01:41:28 most of the talking. And by the third, fourth, fifth group, I started listening and I didn't say hardly anything because it just shut down some part of my interacting with others dynamic and changed it because of the context. And I've thought about that a lot since. So stepping back, given the risks that we just outlined, it seems like this wider boundary, contextual analysis, conversations live with all the senses
Starting point is 01:42:01 with other humans, is in many ways the antidote to some of the things we're talking about by chatbots and large language models. I would say 100%. As I mentioned in passing, and this is part of a broader thing I say about educational technologies,
Starting point is 01:42:17 is that a successful educational technology get you into exactly the right conversation and exactly the right time about the right thing with the right person. That's what it would do. It wouldn't replace the conversation you're supposed to be having with your teacher with a tutor.
Starting point is 01:42:30 It would identify the teacher, identify the place and the time, and make it happen. This is what I call a distributed educational hub network. It requires machine learning. It requires something like AI, but to orchestrate the emergence of all of these person-to-person relationships.
Starting point is 01:42:46 So what Nora does is apply this technology that orchestrates all of these perspective combinings, all of these people teaching and learning without planning and yet structured, right? And so to maximize human-to-human relationship right now is so important because we're giving up on human-to-human relationship. That's why the adolescents prefer chatbots because it's way easier.
Starting point is 01:43:09 It's way easier, like no friction, just like ordering from Amazon's easier than going to the grocery store. Even though the grocery store, you see a lot of people. That's why kind of sometimes you don't want to go to the grocery store because you have to change out of your pajamas or something, right? Because there's people there. Like people are complicated.
Starting point is 01:43:26 Nora's like, no, people are like you. Intermix with it. She's like intermix with them and tell your stories and you realize, oh, right, I don't have to be afraid of people. This is one of those podcasts that I really regret our preconfigured shutoff time because you have a meeting because I'm really, connecting some dots in real time. You mentioned earlier that our cognitive atrophy began with agriculture, arguably, or way back in the day. And I feel, of course, I could be wrong, that the culmination of all that, Mollock and the
Starting point is 01:44:06 superorganism and everything is happening in our lifetime. And AI is the fork in the road. Part of this is an aggregate collective economic superorganism. people in power story. And part of this is eight billion of us with agency can choose, make choices in our lives. So short of signing up for a warm data lab or doing that sort of thing,
Starting point is 01:44:33 and given our timeline that we only have about 10 minutes left, what did each of you advise the average person listening to this show can do to make AI use safer in their life or how to deal with this giant and looming challenge to humanity? I want to say again that we're talking about a very, we're talking about very specific things here. We're talking about chatbots and the risks of over dependence on chatbots because how to be safe with AI in your life is a much harder question
Starting point is 01:45:05 when you realize that AI is being applied to surveillance technology and weapons technology and self-driving cars and refrigerators and all kinds of stuff. So there's kind of no getting away from it. Now, the idea is, is it benign and friendly to you, or is it not? And I think, at least with the chatbots, we have to run with the default assumption that it's kind of dangerous to interact with these,
Starting point is 01:45:27 if you're naive and possibly dangerous no matter what. Just like it would be dangerous, I think, to interact with some AI weaponry, for example, depending how you're operating it. So to me, it's like, this is an advanced technology. Be very, very, very careful. And then we have to think beyond that about how do we stop it so that we keep getting this story where there's a small number of people who advance technology, aggregate a shitload of power, and then kind of destroy the world as it was to make a new world in their image where they have all the power.
Starting point is 01:45:58 Like that's been the game we've been repeating again and again back to the dark triad thing. Like, how do we not have that story continue to be told and play out? If we're addicted to our technology, we don't even begin to try to address the broader question. of how to resolve these impending radical transformation. Because again, we're talking about chapots. It's the end of laws we've known. It's the end of governance. It's the end of economics.
Starting point is 01:46:27 Like, there won't be musical artists. Like, there won't be movie producers. Like, this is because the generative AI thing is beyond just generating texts, generating, like, all this. So the world, if nothing is done to get us off the course, the world five years from now is almost literally in conversation. Like they will have accelerated history, which is their explicit goal philosophically. Or two years from now even.
Starting point is 01:46:50 Yeah, absolutely. It's very hard to predict. Well, exactly. It will. Give me a couple of recommendations. Because I think the thing we need above all is people that have cognitive security and full mental faculties. Yes. Then after that, there are other things, but we need to have that.
Starting point is 01:47:08 So, I mean, learn about the technologies. So break the commodity form. which means don't like with Facebook. If it's possible to use Facebook in a way where you're actually doing some Intel gathering and not engaging in doing it, but you're reproaching it knowing what it is. Well, Intel gathering or I want to see my cousin's little puppy.
Starting point is 01:47:29 I mean, there's nothing wrong with that. There isn't anything wrong with that, but the broader point is you have to interrogate the technology, break the way it's presented to you, see the thing that it's actually trying to do to you before you start to use it. Okay. So being proactive as opposed to React,
Starting point is 01:47:43 with the technology. Precisely, this is just basic cognitive security. So, like, and then don't run away from the tools necessarily. Because, again, if this is back to the,
Starting point is 01:47:52 who's using it, who's not, if the people who are using it are basically, quote, the power hungry people, or something like that, like this becomes a complicated question, because if we abandon the field and don't know how to use it.
Starting point is 01:48:03 Right. Then there's no, there's no counterweight then. Exactly. So this is why we can't not have technology. We can't not have advanced technology. We actually can't, can't not go some degree of cyborg, meaning some degree of deep interconnection with technology.
Starting point is 01:48:19 The question is, what will that look like in the near future? How do we direct it in a way that's radically humane rather than what it's looking like it's going to be? So I would say, yeah, so interrogate the technology, if you're going to use it, break it, as I described. We research ways to break it so that it doesn't capture you. That's a very important one. And then, again, seek optimized human to human experience, like really and help other people find it. Like really, we are the answer, our collective intelligence. Seek optimized? Nora.
Starting point is 01:48:54 What I mean is like, like that matters. It's powerful about musical performance, for example, or a theater performance or a podcast like this, where it's like, these are real humans doing remarkable. Let's call it profound. Something profound. Profound. That's much, much better. Got it. Much, much better.
Starting point is 01:49:10 Yeah. Nora, what do you have to add? I want to add something here that is going to seem less, maybe less serious, but is very serious. And I think that is to engage in any possible way that you can with the miracle of being alive, whether that is to hold your baby, to hold your lover, to snuggle up with your dog, to be in your garden, to walk in the forest, to take your shoes off and walk in the mud, to taste lettuce that comes from the sunshine. Like these little pieces of experience that bring us in communication, with many generations of human beings that have used their hands and have sung songs and have danced and have been participants in the membership of life.
Starting point is 01:50:26 And so for me, I think the real, I mean, we can make regulations, we can try to control this thing, but ultimately there is some other. yearning that is got to be bigger than the yearning for communion with a machine, and that's communion with the living world. So, yes, profound human to human conversations, listen to people's stories. I mean, I think stories are so beautiful because they bring your intellect, your emotion, your history, your culture, your whole. complexity of your being shows up when you tell a story, when you listen to a story. And telling personal stories actually is a reveal that we are actually all really very complex and trying to figure this out together.
Starting point is 01:51:23 So maybe some compassion comes through that too. So being aware of and being grateful for our humanity is maybe the antidote to losing it. Maybe. Yeah. It'll help. It might not be the solution, but it'll help. It's the only way to start. It's the only way to start, is to remember the human and the other.
Starting point is 01:51:48 I have a, about 45 minutes ago, I had a real pit in my stomach from some things that Zach said, but I actually feel hopeful and buoyed just by sharing this time with the two of you. and we have to hang up because you have an appointment. I'm going to go for a walk. It's misting here mid-October. I'm going to take my dogs and just go sit and look at the leaves and reflect on this conversation. And I appreciate you both. And I hope we can do a part two of this, as it were.
Starting point is 01:52:23 Thank you for your work in the world. And to be continued, my good friends. Thank you. Thank you. Thank you, Zach. And thank you, Nate, for having us. If you enjoyed or learned from this episode of The Great Simplification, please follow us on your favorite podcast platform. You can also visit ThegreatSimplification.com for references and show notes from today's conversation.
Starting point is 01:52:48 And to connect with fellow listeners of this podcast, check out our Discord channel. This show is hosted by me, Nate Hagen's, edited by No Troublemakers Media, and produced by Misty Stinnett, Leslie Batlutz, Brady Hyan, and Lizzie Siriani.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.