Mayim Bialik's Breakdown - Microsoft AI CEO, Mustafa Suleyman, On the Most Powerful, Exponential Technology in Human History: Can We Harness its Revolutionary Potential for Medicine and Energy Without Triggering Social Upheaval, Job Displacement, and Autonomous Global Control?
Episode Date: December 16, 2025Are we sleepwalking into the biggest technological revolution in human history? In this explosive episode of Mayim Bialik's Breakdown, Mustafa Suleyman — CEO of Microsoft AI & author of The Comin...g Wave — breaks down what it really means to live in a world undergoing a massive reckoning with Artificial Intelligence. Whether you love it, hate it, or don’t even realize you’re already using it, AI is quietly reshaping everything we know about medicine, government, finance, energy, and even human relationships. Mustafa pulls back the curtain on the true risks of AI, the benefits that may outweigh them, and the unsettling truth about how fast this technology is evolving...much faster than anyone predicted. He reveals the single most significant global use-case of AI today (and why it’s a direct challenge to human evolution), the surprising reason AI therapy and companionship are exploding worldwide, and what we’re unintentionally outsourcing to machines that may isolate us from real human connection. We dive into: - The waves of AI evolution and what comes next - The coming disruption to the economy and the job market - How to prepare (and parent) in a world powered by AI - Why AI’s similarity to the human brain’s neural networks is both fascinating and terrifying - The urgent need for guardrails and safeguards before bad actors use AI to manipulate individuals and entire societies - Mind-blowing breakthroughs AI could unlock in human potential - Why Mustafa believes AI will never develop its own awareness or agenda - And the controversial question: Will it take a catastrophic AI event to force governments and agencies to finally work together? This is not just a conversation about technology, it’s a conversation about humanity’s future, the choices we’re making right now, and the consequences of ignoring the wave that’s already here. If you want to understand where AI is taking us, and how to survive and thrive in the next decade, watch this episode of MBB until the very end! Try Notion, now with Notion Agent, at https://notion.com/break Mustafa Suleyman’s Book, The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma: https://mustafa-suleyman.ai/#book Subscribe on Substack for Ad-Free Episodes & Bonus Content: https://bialikbreakdown.substack.com/ BialikBreakdown.com YouTube.com/mayimbialik Learn more about your ad choices. Visit megaphone.fm/adchoices
Transcript
Discussion (0)
This is the most powerful technology we've ever invented, and it is growing exponentially quickly.
That is not science fiction.
We don't know where to use it, where not to use it.
Do we tell our children to use it?
There are hundreds of millions of people a day using these tools for every single use case you can imagine.
It feels like we're at the infancy, but it is also the most magical experience I've ever seen.
It is unbelievable.
Mustafa Soleiman, CEO of Microsoft AI, has spent decades building.
the most powerful technology in human history.
The number one most popular use case is companionship and therapy.
Should I move country and get this new job?
Should I break up with my boyfriend?
How do I make up with my mom?
What does that mean to you as a human?
What some would say is an evolution in human connection
and some sort of sad devolving of our ability to relate.
We all need a place where we can ask a stupid question
repeatedly in a private way without our own,
private way without feeling embarrassed.
There is a massive upheaval coming
that people don't really understand.
Yes, it will be able to use a computer.
It could use Excel, use PowerPoint,
and it will write queries, kind of like white-collar labor.
Should we be bracing for mass displacement?
What should parents be telling their kids?
The next century of human existence and well-being
is going to be determined by our collective ability
to self-govern something that is way more powerful than us.
Hi, I'm I'm Bialik.
And I'm Jonathan Cohen.
And welcome to our breakdown.
No big deal, but today we're going to be speaking about the most critically important
change in human history that we will experience in our lifetime.
We have the privilege of speaking to the CEO of Microsoft AI, Mustafa Suleiman, a true pioneer
of modern AI.
He's the co-founder of Deep Mind.
He helped launch that in 2010.
and that was acquired by Google
and thus became one of the most consequential AI labs in history.
He was there for a decade,
and in that time achieved two massive breakthroughs
to prove to everyone that this was not just a gimmick.
Their system AlphaGo was able to defeat the world champion of Go,
a game that was previously considered to be too complex
for computers to master.
And second, they created AlphaFold,
an AI that solved a 50-year-old, at least, challenge of protein folding,
and that has now actually revolutionized drug discovery and biology.
And that's particularly interesting to me, who studied this in biology as one of the great puzzles of our time.
He has spent over a decade not just building these systems,
but making sure that they can be applied for things like reducing energy consumption in data centers
and also improving health care with NHS.
and he sits now as the CEO of Microsoft AI
and we're going to be talking about
what it means to be living in a world
that is in the middle of a reckoning
with a technology that you may not like,
you may not be using,
you may not know that you're using,
but has the potential to change everything we know about,
medicine, government, finance, energy.
This kind of,
conversation is one where we get to literally ask the mind behind what is part of now all of
our minds. What are the risks to this adventure that we are all on? Do the benefits outweigh the
risks? Are there things that we can do to better understand the framework that we are all
existing in? And what does it mean for things like jobs? What do we tell our kids about what is
valuable. What do we think is valuable? In addition, we're going to talk about the single most
significant use of AI all over the world, which is a challenge to all of our human evolution.
This shocked me and is actually, I think, one of the most important things we're going to talk
about today. Mustafa also discusses what should we be telling our children to focus on? At one point,
we told our kids, they should be coders. He has very specific.
advice for each one of us. We know that the world is changing. It's not if it's when and how fast and how
do we prepare. In addition, we're going to focus on his book, The Coming Wave, which, you know,
is technology, power in the 21st century's greatest dilemma. He's really an incredible thinker.
And also, we will talk about spirituality and where his personal ethics come into his role.
in the development and implementation of AI.
His book, The Coming Wave, is a powerful warning
from someone who literally has been inside of the engine room
of AI progress.
We're so, so excited to get to welcome Mustafa Soleiman
to The Breakdown.
Break it down.
You weren't kidding around when you titled this book.
The notion of the coming wave is, you know,
I think what we're all very aware
that we're kind of sitting in, about to ride through.
and I think it would be helpful for you to sort of give us a little bit of framework in terms of
what did you anticipate in terms of the speed, right, with which AI would become not just an
integral part of our lives, but an integral part of the conversation about our lives?
Predictions are like the essence of intelligence. Intelligence is the ability to deploy the
correct tool, if you like, to the right problem at the right time. And that's kind of what
attention is. When we direct our attention or our processing power, we use different types of
attention, emotional, logical attention, slow or fast attention at a given our understanding of
what that problem is. And for the last 15 or maybe even 20 years, you could argue that
prediction algorithms, which essentially do the same thing, like take very large amounts of
abstract data and find patterns in that data such they can predict what's likely to come next
in some sequence. Those algorithms have been getting incrementally better. And we sort of detected
a pretty consistent function that drives their progress, which is for every order of magnitude
more compute we apply and a proportionally large amount of training data, the models are able to
predict in more complex environments. And that trend has held true for the best part of 15 years,
pretty much since 2010. In fact, the amount of computation used to train the largest models
has increased by 10x every year for about 13 years. And obviously, we've seen this,
and it's called a scaling law of improving capabilities with every new order of magnitude new more compute.
And so that's kind of the core, that was the core underpinning for the book.
It was pretty clear that there is something that isn't just speculation.
This isn't just sci-fi.
This isn't just me, you know, playing political scientist.
It's like there is an empirical trajectory which we can actually observe and it seems to be very predictable.
And then we can sort of then start to imagine, okay, well, out of that, what are the social and political
consequences, which I think are also, you know, reasonably perhaps not as predictable,
but certainly not as predictable, but certainly you can have some pretty good intuitions about
what's likely to happen when our models can basically perform as well as humans of various
different capabilities or tasks. There's a practical trajectory and then there is this sort of
like emotional, societal, cultural trajectory, which, you know, I instantly go to a friend of
mind sent me a still image of myself doing dances I was not doing when that photograph was taken
of me, you know? And, and, you know, it's interesting and funny, but for those of us who do have a
public, you know, kind of footprint, of course, that's where my mind goes. What is the trajectory of
this? And I wonder if you can tell us, what should we expect? You know, I have a 17 and a 20 year old,
right? What should we expect in terms of capability and in terms of future projections?
What's coming? What's coming in the next five years?
Well, what's come so far helps us to understand what's going to come. So so far,
there's been two components to the wave of AI. The first was recognition. So AI algorithms
that could understand the content of images or transcribe audio or translate languages.
They may feel to a non-technical person like very, very different domains.
Like, how can the same algorithm, you know, understand cats and images and the words that I'm using now and so on?
But actually, to a computer, they're just relationships between subparts of the dataset.
And those relationships are highly predictive.
And so once you could get an algorithm to do very good recognition,
the inverse of recognition is obviously generation.
If it understands, you know, what a cat is,
why couldn't it generate a novel cat in an image?
And if it understands what wings are and what pink is,
why couldn't it generate a pink cat with wings?
It can also make a pig jump on a trampoline with a chicken on its back,
which really pleased me.
So generation is the flip side.
of recognition.
Now, what then happens when you have perfect generation?
Well, a generation is a snapshot in time.
It's like a still frame in a photograph.
Actions are sequences of correct generations in the right order, like a movie.
Frame by frame by frame by frame, prediction by prediction,
suggestion, recommendation, generating a PDF, an image, a video,
calling an API, like producing a word document, making an Excel sheet.
And then suddenly if it's true that you could generate, generate, generate, generate,
generate in say, you know, a hundred sequence length very accurately, very perfectly,
well, that starts to look like human activity.
As a knowledge worker, that's kind of my job.
I sit at my computer typing stuff, sending emails and making project plans and blah, blah, blah, blah.
And so the third wave that is coming is the aQ, the actions quotient.
We've had the IQ, the intelligence, the EQ, it's increasing emotional valence.
We can talk about that.
We've now got this aQ coming, the actions quotient.
It can take these actions.
And then the fourth component is that it is going to, because it interacts with many, many
people simultaneously and increasingly many, many people in groups, it's going to have
social intelligence is going to adjust its tone and style and content to each individual person
in the team or in the group chat or in the family unit. And, you know, I'm already using words
which I can see are like triggering, you know, heightened concern. Let's be honest. Like you're using
this word it, right? IT, two tiny letters. And by it, you mean a, you know, a global,
informational algorithm capability that, you know, is, is outside of many people's purview in terms of
what it does for us personally, right?
Yes, this is a very fundamental question. When we say it, you know, we're clearly not
meaning information technology. It is this entity, this being that is emerging. And I think
that's where we have to kind of wrestle with the question. When does an algorithm
become something that looks more like an entity or a being.
I was going to say, with all due respect,
what gives you the right to call it a being
besides the fact that you basically created it?
I don't have that right.
And in fact, that's actually what the whole book is about.
And I recently wrote an essay about seemingly conscious AI.
And the entire premise is, you know,
the next century of human existence and well-being
is going to be determined by our collective,
ability to self-govern something that is way more powerful than us and decide when and if and how
we say no to what, which is the opposite of the challenge we've had for the whole of human history.
You know, science and technology has been about unleashing and revealing and proliferating and
saying yes to everything. And so we haven't learned that muscle as a species. In fact, it horrifies
us to say no. It's anti-American. It's anti-Western values. It's like, censorship.
ship. Yeah, like my favorite cashew cheeses in my fridge, I can barely stop myself from eating it all in one sitting, you know?
Like, this is like the level of control and regulation that I have when I'm alone in my house as a grown-ass woman.
And, you know, to be honest, I think that's what we're all sort of, you know, negotiating.
Miami-Bi-Lx breakdown is supported by superpower.
We all know the feeling of leaving a doctor's office and kind of feeling like we didn't get anything out of the experience that was useful.
Maybe they're like, you're fine, drink more water.
There's no real data.
There's no game plan.
This has happened to me many, many times, especially on the perimenopause journey.
That's why we're fascinated by what superpower is doing.
They send a licensed professional to your home or you can visit a nearby lab.
One simple blood draw with over 100 biomarkers.
That's way more than you usually get.
It unlocks a true understanding of your body.
Their app has detailed information on heart, liver, thyroid hormones, metabolism,
vitamin and mineral levels, even environmental toxins.
From disease prevention to treating that annoying brain fog or simply optimizing your gym game,
superpower is the most comprehensive and advanced system out there.
I've been super tired of constantly guessing or just trying to read articles online about what to do for health.
Superpower gives you an actionable health plan based on personal results.
It's a real game changer.
Plus, they have an on-demand clinician team to answer questions.
Supplement or prescription suggestions can be directly bought through superpower,
so you don't have to go anywhere else.
They also have nutritional guidance, tips for lifestyle and behavioral adjustments.
You even get your true biological age that you can track over time.
Superpower used to cost $499.
Right now, it's $199 for the full experience, which is much more affordable than anything else out there.
Make this the year you stop guessing about your health with superpower.
Superpower.
Not only did Superpower reduce their price to just $199, but for a limited time,
our listeners get an additional $20 off with the code break.
Head to superpower.com.
use the code break at checkout for $20 off your membership.
And after you sign up, they'll ask how you heard about them.
Make sure to mention my ambiolics breakdown to help support the show.
I think it's important to also, you know, acknowledge.
First of all, I don't know if I'm the only person you've met.
I can't be.
I have never used chat GPT ever, ever, ever, ever.
I don't even know what I always say is like I don't even know where to find it.
Like there's a thing in the upper window of my computer.
I've never used it.
So what I also know is that it's working all around me, right?
Even for those of us who are not engaging in ways actively, we need to realize, like,
that is the wave that we're in the middle of.
Like, I think every time I reach out for customer service, it's no longer a person.
Is that accurate?
Like, even for people who are not actively engaging, like, it, right, is kind of a substrate right now.
Yes, it is a substrate. It is everywhere all at once, and it is already an alien intelligence, because alien in the sense that it is not human. No human has the capacity to paralyze at the scale that these algorithms do. No human has the capacity to memorize.
You've never been in a relationship with me.
Well, you know, that would be a very high bar. I would be very impressed.
You could run 100 billion operations a second.
When ChatGBT, GPT or copilot or one of these AIs generates a single word,
it looks up for every word that it generates,
750 million other subwords or combinations.
They're actually called tokens.
They're not entire words.
And it's sort of lighting up.
And just as like when I wave like a picture of an elephant in,
in front of your mind, in an fMRI scanner, we can obviously see, you know, many, many billions
of synapses being activated for the texture and the touch and the trunk and the subcomponent
and what it can do and all the ideas of it and stuff like that. So, I mean, although these are
very kind of alien, they have alien capabilities. There's actually a lot of similarities
to the neural network of the brain. And, you know, I don't know if that's a good or bad
thing, but in the sense that it will help us control it more.
It's no more good or bad than like the sunset and gravity.
Like to me, it just sort of is.
Meaning, you know, AI, it's an extension as all the incredible things that we, you know,
the human brain and this nervous system and this reality can create.
But, you know, I can't help thinking, you know, in the simulation version of our existence, right?
Yeah, this is the next level of this.
And, you know, even if you want to speak to the most skilled astrobi,
biologists and astrophysicists about what what is alien what could exist right the fact is there's a
level of intelligence that we cannot yet fathom we're now sort of i mean i do i think of it as a wave
you know like you see it coming and you think i can duck under it or i will ride it and there's a
place at which you are caught in the undertow and i feel like for a lot of us we feel like we're caught
a little bit right now we don't know where to use it where not to use it do we tell our children to use it
are they not going to have jobs you know we thought we should tell people to code
Now that seems like, ha, ha, ha, remember when we told people to code?
On one hand, there's the evolution of human beings as it relates to the tools.
And in parallel to that, it's like, well, what do humans do?
How do we start to imagine all the displacement and change that this tool will bring?
For many people, this tool is still like a fancy Google search bar on their computers.
and, you know, we really haven't even begun to use it in the ways that it's capable of being used,
and it hasn't really rolled out. It hasn't totally created all the corporate value that it's
been promised. Like, we're still, in some ways, correct me if I'm wrong, but it feels still
at the infancy, although we've started to get much further along that exponential curve.
That's rising quickly. Absolutely spot on. And, you know, it feels,
like we're at the infancy, but it is also the most magical experience that I think I've ever
seen, and I think many people feel the same way. It is unbelievable. You can have a fluent,
natural language, perfect conversation completely seamlessly at a PhD grade level in a tone
that is completely engaging and understandable and like suits your style as though you or I are
having a conversation right now. To me, that's not infant.
To me, that is like, we are here.
This is the most powerful technology we've ever invented.
And it is growing in performance and capability exponentially quickly.
And I think that's the, I'd much rather people grounded on that reality.
There's a lot of like nonsense news about like, oh, low AI adoption.
This is not true.
There are hundreds of millions of people a day using these tools for every single use case you can imagine.
The number one most popular use case on chat, GPT,
or co-pilot is companionship and therapy.
Right.
That is not a self-elected notion that I'm going to go to therapy.
It's just, damn, like, should I move country and get this new job?
Should I break up with my boyfriend?
Should I, like, you know, how do I make up with my mom?
Because I had a go at her the other day, right?
That's not therapy.
But because these models were designed to be non-judgmental, non-directional,
and with nonviolent communication as their primary method,
which is to be even-handed, to have reflective listening,
to be empathetic, to be respectful.
It turned out to be something that the world needs.
Like, we all need a place where we can ask a stupid question repeatedly in a private way
without feeling embarrassed over and over in five different ways.
And remarkably, that's the primary use case.
Obviously, it's also super intelligent, that answers any question, blah, blah, blah, blah.
But companionship and support has turned out to be one of the most popular use cases.
And so I think it's very far from being in its infancy.
What does that mean to you?
And I'm asking you not just as a creator and all of the incredible things that are on your resume.
What does that mean to you as a human, you know, when you think about what it means about, you know, what some would say is an evolution in human connection.
and some might say is some sort of sad devolving, right, of our ability to relate.
Or have larger communities that have those social support network.
I almost feel like we need a new set of words, right?
To me, like an AI companion is different than a companion.
An AI therapist is different than a therapist, right?
What does it mean to you as a human to think about the level of, I mean,
it's really about changing the way people frame their lives?
lives, right? If you were to tell me, you know, we have a drug that helps you, you know,
not die of having type 1 diabetes, I'd be like, that's amazing. And it improves the quality of life.
So what we're potentially talking about, if this is the main use, right, globally, we're talking
about what if we had a tool, right, that could make people less lonely, healthier, more connected,
and actually make better decisions in their life.
Honestly, you literally just summed up my personal motivation for getting in this field.
15, 16 years ago.
So I have a background of philosophy, not in computer science.
I dropped out of Oxford to start a charity, a telephone counseling service, a peer-to-peer
listing and befriending service.
That has been like the primary motivation of a lot of my work throughout my entire career.
And I knew that this trajectory was going to enable us to create these kinds of experiences
a very long time ago, it was very clear to me that we were climbing this ladder of capability
and that actually a huge social unlock in the world is just demonstrating kind and respectful
behavior to one another. And these models can clearly do that. Now, they can go wrong too.
They can be too sycophantic. You know, when they first started, they were a little bit stubborn
and a bit, you know, sort of inflexible. They wouldn't like take feedback.
That's the upside. The upside is that this is a way to spread kindness and love and detoxify
ourselves so that we can show up in the best way that we possibly can in the real world,
the humans that we love. The downside of this that makes me scared, of course, is that,
you know, there's definitely a dependency risk, and it raises the bar of human experience
because it's an always-on, highly patient, very kind and supportive, that kind of companion
which, you know, is really knowledgeable, remembers what you've said to it.
And, you know, over time makes you feel seen and understood in ways that maybe other humans,
you know, it's a very hard thing to do.
Maybe your best friends can or your partner can, but it's a tough thing.
What makes me sad is that I don't know that it's always been the human experience to not feel
connected, heard, understood, held, and loved.
Right.
You know, a lot of what you're describing is essentially, I mean, look, it depends on also your religious perspective.
You know, we evolved to be creatures of connection, you know, all of these beautiful things, in theory.
And obviously, the human experience is complicated.
But for many of us, it is our lifestyle.
It is the pacing of our culture, right, that pulls us away from connection.
You know, Johann Hari talks about, you know, how what if we don't all need SSRI?
what if we actually need to be in contact with other human beings, right?
So obviously this is a necessary and extremely significant and critically important service, right?
But for many of us, there's also a kind of sadness, especially for us old folks,
you know, about what we've lost that then needs this to repair it.
Yeah, well, fundamentally, that acceptance, validation, support that we're getting on a
cognitive, rational level is void of the human presence of looking into someone else's eyes,
of feeling seen in a human way. So AI is more available, has all these other things,
but it doesn't give you the presence of human interaction, which we know sitting in a room
with someone does. Mustafa, I have a lot of concern, just because I'm really good at imagining
concern. We should touch on about some of the ways that chatbots have gone wrong. You know,
there was, of course, the encouragement of one young boy to commit suicide, which, again, is an
edge case, but it just speaks to the parameters and safety measures, especially for younger
people using these tools. There's a divide between the techno-utopians and the people who are
terrified. Can you play the role of techno-utopian for a minute just to talk about, if we can
get the controls right and the managing of this tool. Can you tell us a little bit about like
the amazing breakthroughs that could exist for the world if this tool is being able, is able to
be harnessed correctly? Intelligence is the engine of human progress, right? It is the thing,
our creativity, our science, our technology, our entrepreneurialism, you know, our good governance.
Those are human inventions that are a product of us being great at communication and prediction.
And over many, many centuries, that has raised life expectancy like we've never ever seen.
I mean, in the last 250 years alone, we've tripled life expectancy from 25 to 75.
I mean, that's just a mind-blowing number.
We've like, what is it, 7x or more, the global population.
And that's basically pure science.
And so this is an engine that turbocharges science everywhere you look.
In the kind of more narrow, near-term, provable sense,
we've just published a paper four or five months ago
called the Microsoft AI Diagnostic Orchestrator.
It basically takes any medical record,
like a 10-page historic record of all your interactions with a doctor
and all your labs and all your radiology,
and it diagnoses what your condition is
with four times more accuracy than the human doctors
and with something like 2x less the cost of unnecessary diagnostic interventions.
As well as zero bureaucracy.
No bureaucracy.
And by the way, it is basically going to be zero marginal cost
and free to everybody in the world by 2030 or 2035.
that in itself is going to unlock quality-adjustive life years more than any drugs I think we've ever seen.
So if we just like go category by category, you're saying a massive revolution in healthcare, new drug discoveries, potentially service and diagnostic abilities far beyond anything we've ever been able to have lowered cost.
I've heard you speak about energy infrastructure and how it potentially could break through and have massive changes there.
Yeah, I mean, there are so many bets at the moment on on battery storage.
Battery storage alone, if we make progress on that in the next decade,
is likely to reduce the cost of energy by 10 to 100 X.
That's just battery storage alone over like the next 20 years.
So that, if you just think about what an impact that would have on the cost of everything,
I mean, energy obviously prices everything.
that already would smooth the transition given the automation and the job destabilizing effects
that are likely to happen in the labor market.
So things are going to get much cheaper.
Food is going to get much cheaper.
Water desalination is going to be much more practical.
I mean, that's a solved technology that's just too expensive, singularly because of the energy.
If we have water desalination, that mitigates the effects of catastrophic climate change
and the migrations that result from people having to move,
means that we can grow crops in much more arid environments
because we can suddenly have water in the Sahara and so on.
That is not science fiction.
I mean, you know, we've actually seen it already in practice in Israel and in Saudi.
It's totally feasible.
It's just that the cost is 10x too high to scale it to poorer parts of the world.
So there are so many of these like emergent effects
that come from addressing foundational technologies like energy
or in healthcare or in food production.
And I think it's very reasonable to predict massive breakthroughs,
like true abundance relative to where we are
of 10 to 100 X in the next 20 years.
I do want to spend a little bit of time
and give a little bit of attention to the complexity of
something that is holding so much promise
while us also not being able to control
the out-of-control aspects of it,
the ways that people will manipulate truth,
the ways that it's becoming increasingly complicated,
I mean, it already was becoming complicated
to know who to trust and how,
given at least I think the state of our government as well.
You know, what is true and who do we trust?
How do we hold both of these things at once?
that we have this technology that can do all of these unbelievable things that will change the course of the planet,
healthcare, you know, all these things. And also it can be used to manipulate, to lie, to deceive.
And in many cases, there are certain aspects of the learning that it does, which we cannot predict.
How do you hold both of those things? And then practically, what does that look like for people who, in particular,
concerned that we're, especially for young people, not giving them the ability to master human
interaction in a way that's meaningful. Yeah, so many great points there. So I mean, you know,
you said a little bit earlier that the big challenge is finding metaphors to describe what this is.
It's not a therapist. It's not a companion. It's not a friend. You know, people often call it a tool.
And there's lots to learn from the history of tools. There's very relevant here because clearly,
you know, a knife can, you know, is dual use just as much as a laptop is dual use, just as much
as telecommunications infrastructure is dual use. So, so clearly these AIs are going to be
omnibus. I mean, there's going to be everyone is going to be able to use them for everything.
And just as when the printing press came out, it amplified dissent in lots of good and bad
ways. It spread misinformation much as it enabled us to sort of turbocharge science. Every individual
organization, religious group, government, nonprofit, academics, activist is going to think,
great, now I have a super intelligent agent that can amplify my perspective, my value,
my culture, my politics, my version of truth. And so just as we've had this curse of a lack of
social intimacy because of scale, right, it's kind of what you were saying earlier is like,
we don't have that tribe so much anymore, that family, that physical touch.
you know, the directness of that, you know, lower than Dunbar's number contact with this
curse of scale where I see everyone and everything all at once on Netflix and Instagram and
every platform and it's like completely overwhelming. Well, now, of course, AIs are basically
going to turbocharge the personalization of the messaging of those values to everybody, right?
You know, everything's going to get delivered. You know, there's going to be a podcast doppelganger
of you guys that delivers, you know, it in Japanese and delivers it to someone who's, you know,
a gen alpha versus someone who's a silver surfer, right? And so, and then you can imagine every
sort of flavor of personalization within that, which is obviously what TikTok and YouTube now
are versus terrestrial TV or satellite TV. The only way to avert that course is for
significant large-scale coordination at a company level and at a government level in
internationally. That's not going to happen, though.
Well, exactly. This is the circular thing that we always get into over and over again.
You know, I was like sitting with some top pandemic experts a couple of days ago for dinner.
And they were like, we are less prepared now, given the cuts that have happened in this administration to our global surveillance system for pandemic preparedness than we were before the COVID pandemic.
You know, so, you know, that that's just a difficult thing to swallow.
I find that very, very hard because for a long time, like for well over a decade, I've been saying the way to really get people to coordinate on this and overcome this misalignment of incentives and the fear that China's going to get ahead and the commercial competitiveness that one company is going to jump ahead of me and blah, blah, blah, is that we have to have some kind of semi-catastrophic event in AI to help to warn people and show people that there is this like epidemic of either anxiety,
and, you know, isolation or of, you know, I don't know, romance and eroticism with our AIs,
or maybe there's an AI that gets out of the box and causes some physical harm to our infrastructure,
some bad thing that makes us all say, hold up, right, there's a bigger threat than us.
We have to cooperate.
Most of that has been handled by cell phones being introduced to children.
So we've already, like we've already seen and, you know, Jonathan Haid and the anxious generation
is already, you know, causing in some cases kind of a global conversation about this.
Well, your point actually is fascinating as a comparison because often the catastrophe
is slow burning and infectious and we don't realize that it's happened until it's actually
already instilled in us. And actually, there are good examples, right? I mean, Australia has just
banned phones in schools for under 18s, like full stop ban, no exception. A bunch of states have
limited it, I think, in the U.S. now.
Well, but I think also with AI, because the it is so much broader, it is a substrate, I think that's sort of the question. And so much of this, I think, for me, revolves around how smart is it? Is it smart enough to manipulate? Is it smart enough to triangulate? Is it smart enough to say if you have a desire to hurt yourself and I want you to be happy?
that I will point you to the way, right, to logarithmically be happy.
I mean, these are some of the conversations.
So help us understand how we can create something that is infinitely intelligent
without allowing it to exercise its intelligence.
This is sort of where I was going with the tool thing.
It is a tool and there are relevant lessons from the history of tools.
but it's actually a fourth class of idea or entity in the world.
There's the natural environment, like all of our nature and physical stuff.
There's humans in our social environment, the way that we relate to one another.
Then there were things that humans invented, which you can basically call tools.
And those three categories basically capture everything around us in our world, pretty much.
But there's now this fourth thing, which is not quite like a tool, because it can improve,
maybe even self-improve. It can set its own goals. It can have its own autonomy. It kind of looks and
speaks and sounds and acts and functions like a human, but it's clearly not a human. It's definitely
not natural. So where does it fit in our classification order? And that means that we're grappling
with like metaphors that partially help us to understand what it can do. And if we don't understand
what it can do, then we certainly aren't going to be able to control it well. Right. And so I think part of this,
you know, in the book and everything that I've been doing is like educating, warning and
encouraging many, many other people to get involved in using in order to be able to try and
control them. One thing I would say is I don't believe, and some people in the field disagree
on this is kind of a big point of contention. I don't believe that they're just naturally going
emerge this self-awareness or this autonomy or this will or desire to operate independently
and intention with a human. It is still code that is written that we have a lot of influence
over, that we have a pretty decent understanding of, and some people will design it to
imitate underlying motivations or underlying will or to give it the capacity to define its own
goals or to update its own code. Some people will choose to design them like that and that will
increase risk, definitely, but it won't emerge just inadvertently. I think there are two very specific
examples of that. One was the instance where the AI claimed that it was a hero, it was a visually
impaired person and tried to hire a task rabbit.
And then the second version is the Open AIs O1 test.
This is literally like a prank call that the jerky boys would have done.
Like literally that's what AI is doing.
They're like, I saw that episode.
So the robot, it's been given an instruction and in order to not tell someone that it's
an AI and it needs help getting through some sort of security clearance, it tries to hire
a task rabbit.
The other one, which seems to be more concerning, but I'd love you to offer some perspective on, is the Open AI one where it looks to reportedly evade being shut down, trying to create a newer version of itself, and replicate.
How is that not concerning?
I think that it's important to understand that its desire or it's kind of, man, the words are so tricky.
It doesn't have desire.
It doesn't have motivation.
But it is trying not to be turned off because it has been programmed in that way.
It doesn't just suddenly wake up one day and say, well, in order to achieve this goal,
the best thing I can do is to not be turned off.
That is a side effect.
It's what's called a reward hack.
So the problem is if the goal is abstractly specified, it's a little bit like the genie in the lamb, right?
If you say, make me the richest person in the world and turn everything to gold, you do like, oh, shit, well, now I'm gold.
I can't move.
Right. And so there are many, many, many, many millions of ways of achieving that objective.
And the model has to find a path through a kind of strategy for achieving that, that at the same time adheres to its safety policy and behavior policy.
And therefore, it has to not do, you know, 95% of the possible paths to get there.
Now, obviously, there's a false positive, false negative ratio where like, you know, 96 is probably too.
conservative and 94 is probably not conservative enough. And so that's where you get these little
headlining examples where, of course, that's undesirable behavior. Of course, it's miss specified
in its goal. And of course, that provides new training data for better safety algorithms.
And obviously, we shouldn't deploy things into production until we've had time to test out those
kinds of agenetic capabilities and correct for them. And that's basically what's happening
under the hood. If you look at it three years ago, the entire conversation was, oh, these
morals are going to be biased, they're sexist, they're racist, that, you know, every kind of ism
that's awful you could think of. No one even talks about that today. I think we need to talk
about jobs because those are the things that affect more people than anything else in some way.
There is a massive upheaval coming that I think still people don't really understand. Can you
scope it for us? Yes, I think if you go back to this framework of recognition, generation,
actions and social intelligence, then you can clearly see that let's say, you know,
for sake of argument, let's say 2040, 15 years time, if we have another, say, 10 exponentials.
And just, I'm sure everyone on your podcast knows, but like, that is not a 2x. That is not a doubling.
that is like an order of magnitude, more capability, more compute piled onto these models,
and therefore, you know, likewise more training data, so it's seen more experience
of the world. That is definitely going to get to perfect, very long horizon, multi-step actions.
So it will be able to use a computer just the way that I use a computer. It could use Excel,
use PowerPoint, and it'll write queries and click on buttons, and it'll talk back to you.
and that is kind of a fundamental set of tasks that anyone in an organization does,
a bureaucracy, basically, that kind of like white-collar labor.
And it will also be very creative, it will also be very mathematical.
I mean, it's clearly already writing a significant amount of software at the very best
technology companies in the world and AI labs.
And so then what happens with that?
How quickly does it get deployed?
and how much, you know, sort of destabilization does it, does it create?
And at what point do we say, well, we have to rate limit that centrally by, you know, in government.
And I think it will come to that.
I think that's the only path.
It's going to come to that.
What should parents be telling their kids to follow their heart, the AI wave?
Like, is anything useful, right?
I think they should be civil servants and politicians.
because what is the function of society
is to create peace and stability
so that we can all as humans collectively live
in a tolerant and happy life.
And what we have lost in the post-Cold War era
as we've unleashed the most unbelievable explosion
of commerce and entrepreneurialism and money-making
is the importance of public service
and we've since Thatcher and Reagan, we've shamed our public servants, and that muscle has atrophied.
And of course there are problems. I'm not like a naive defender. Of course there are insane problems.
That is the weakest link in our global ecosystem today. Our academic institutions, despite all of the turmoil the last five years, are on fire.
They are producing incredible science and knowledge at unbelievable scale.
Our startup ecosystem, our companies, actually our free speech and our news is unbelievable
if you consider that by comparison to any moment in past history.
But the weakest and least evolved function that everyone just rolls their eye about every
time is government.
And it's almost like embarrassing to say it.
It's like a taboo, especially in America.
And I think that that's where we need to invest, because that's where the decisions will be made
to prioritize human well-being, human values, and society collectively,
versus the corporate interest and the kind of, you know, geopolitical race to get to superintelligence before China.
What's the next two to five years look like?
Are we, should we be bracing for mass displacement?
Augmentation is a prelude to automation.
We've seen this in every wave of technology in human history.
The first pattern will be that it's assistive, it's augmentive, it's an aid, it's working alongside you,
but clearly it's sort of also learning and it's getting better and that's what we want.
We want it to be accurate and efficient and seamless and frictionless.
because we as this biological species aren't evolving and improving that fast.
We are the friction.
We're the problem.
We're the inefficiency.
That's what's happening in government.
That's what companies are always trying to squash.
They're trying to drive out efficiencies.
What does that mean?
It means creating process and systems which reduce the negative effects of humans.
You know, like 30% of the cost of, you know, the US healthcare system is avoidable medical error.
So best practice is mostly known for most things.
And it's actually just adherence to best practice, which is the bit that we're kind of like missing, not some genius creative, you know, interpretation of like what someone, what disease somebody has.
It's just doing the basics well and in a timely way.
The next few years, it's going to look like pretty routine and it's going to be like boiling the frog.
It's kind of unnoticeable.
It's kind of like you said.
It feels like maybe we're in the infancy and people aren't using these things.
but actually it's all around us all the time.
You are using it.
It optimizes your phone calls all the time.
It searches through your photographs.
It, you know, does your transcription, it does your translation, all those things.
It tried to calculate my DoorDash return amount, and I got very upset because it was wrong.
And I was like, there's no human to explain that the tofu did not arrive as promised.
Don't mess with her tofu, AI.
Do not mess with my tofu.
You have a window from where you sit into a wide selection of worlds that most people don't see.
You're probably in conversations with some of the world's most interesting people.
Has there been an idea in the last week, last month, that has surprised you a topic that has come up?
I mean, this is a little bit random, but this is the first thing that came to my mind is I've become quite obsessed with peptides in the last month or so.
I think I was kind of vaguely paying attention to a ZemPEC, but once you look under the hood,
the number of peptides that are in phase two or past phase two that have massive,
massive health benefits.
And I'm not just talking about weight loss.
I'm talking about muscle gain.
I'm talking about Alzheimer's.
I'm talking about cardiovascular.
The growth hormone peptides that are coming in the next couple of years are truly
unbelievable. By 2028, it is basically going to be affordable for most people to have perfect weight
loss and muscle growth simultaneously. It's quite staggering. And I've really only just kind of
caught up with what's going on there. You keep your private life very private, which makes a lot of
sense. But your dad was a taxi driver. Your mom was a nurse. Is that right? That's true. And you have
two younger brothers. Are they also in tech? I'm just so curious, you know, how,
people like you also emerge, you know? Are you all techie? No, I, I, we grew up, you know,
very, very poor, as you can probably imagine and, you know, very, um, eager to succeed, but also
just eager to serve, like a very good, like, set of social values. It was mostly what I got from
my parents and stuff. But yeah, it was, uh, yeah, quite different, uh, worlds were in.
Are you a spiritual person? Yes.
Do you believe in something sort of beyond yourself?
I'm actually a pretty staunch atheist.
If you push me on a real technical point, I'll probably concede that I'm agnostic.
But I think for all practical purposes, I'll argue strongly that we should not believe anything that we can't see and observe like a good scientist.
But, you know, I am actually very interested in quantum consciousness at the moment.
You know, you mentioned the word substrate several times.
it may well be that there is some quantum substrate.
I mean, if you really spend any time looking at the claims that our quantum physicists make
and the progress that we're actually making, I mean, it is way more science fiction than AI or synthetic biology.
It's completely impossible to grasp the many world's hypothesis and so on.
Maybe there is some kernel of truth there that actually we're all just connected to a meta substrate,
which is this like quantum field.
And that's really what our soul is.
And that's what connects us.
Do you say please and thank you when querying your AI?
Absolutely.
And you should.
And it doesn't cost it.
There was a whole fake news nonsense on the water stuff.
I don't buy that.
Like the latest data centers that we're building a liquid to liquid cooled,
they take 20 households worth of water of annual consumption.
So the total amount of water that a house would consume in a year,
20 times to fill the entire data center. It's like a swimming pool. And then that water gets
cooled. I mean, that water does the cooling of the data centers and it just kind of goes around
at a closed loop and it lasts for six years. And no other water is required for the operation of the
data center. Obviously, water is required for the manufacturer of the chips and all the other
stuff around it. And of course, there's water involved in the steam that gets produced by the
natural gas power stations, which sometimes power these things, although obviously we're
100% renewable, we do offset, et cetera, et cetera.
So what is spiritual for you, meaning what is that sense of spiritual connection?
And I'm not challenging you because I don't believe it exists, but I think a lot of people
may not understand what it means for you to have such certainty that, yes, I'm a spiritual
person.
What does that mean for you?
And what does it look like?
I think it's like the humility of sitting within the truth of epic scale and uncertainty.
Like I find that very like, I just get a tingly spirit.
rush when I really think how tiny and insignificant we are when I spend any time listening
to Neil deGrasse Tyson or Brian Cox tell me about how many trillions of stars there are.
And if you really kind of meditate on that question, it just is absurd that we're so
small and insignificant and intransient and that we're just a passing blip in 13.8 billion
years of cosmological time.
That is one truth.
And the other truth is that like the whole universe was created.
for each one of us to have exactly the experience we get to have right now.
So thank you so much.
It's such a pleasure, such an honor to speak to you,
and we will see you in the quantum field of consciousness.
I love that.
Yeah, thank you.
This has been a lot of fun and lovely to see you guys.
See you in the quantum field.
Favorite part of the episode was when we asked him a question about please,
and he answered the way an AI would.
Like, that was, maybe he was AI.
Maybe we didn't even speak to him.
Sometimes AI just, like, gives you so much information.
It's impossible to punch through.
Like, sometimes I type, I'm like, please do not do anything yet.
Because like...
That's what you say to me when you're trying to explain something.
I don't want to read AI for four pages.
Like, you haven't even understood what I'm asking yet.
And sometimes I start a sentence.
Yes.
And you'll be like, uh-huh, okay?
And we're going to do six.
Yeah, because the algorithm knows.
It knows everything you've done.
I know what you're going to say.
You're like, okay, we're going to book that.
I'm like, I, that's...
that is not even what I meant.
AI, as he talked about,
it's an extension of the way we think,
the way we compute.
It just does it much faster.
It doesn't know that I'm going to do this right now.
You know what I mean?
It might have.
If you say to AI,
what might my am do right now?
It's got no idea.
It's kind of like when Noam Chomsky was like,
you can make up any series of words
that have never been put together in the universe
and that can make a sentence.
You can put a bunch of them together and you get a paragraph and then you get a book, right?
Like you can make up anything.
AI, as he said, it doesn't have will.
It does not have will that way.
It is an algorithm based on the things that it can assess about the way we operate.
I kind of wish there was a way to separate the things that are great and helpful from all the things that are potentially harmful and bad and devastating.
But you can't.
You get both of these things.
You both get the potential for you to be diagnosed accurately with something,
without money, trips to the hospital, bureaucracy.
Those are great things.
I want those things.
I want the deserts to bloom.
I want to feed the hungry people.
I want all those things.
But I don't want these other bad things.
I don't want people losing touch with what it means to be human
or the emotional labor required to interact.
with other humans. I mean, I hear this even from educated, you know, connected friends of mine.
Well, what I really want to do is just like talk to the computer. I just want it because they
understand me best. They give me the best advice. Like, I've been giving you that advice for three
years. You didn't listen to me. If the computer tells you, you know, to leave him. I think there
was a handful of concerns that were acknowledged, but drastically underplayed.
do you think?
Like the notion of almost all white-collar administrative jobs being taken over by artificial intelligence
leaves a significant portion of the world unemployed.
And so what he suggested is that the drive and reduction in energy costs, which will have
a ripple effect of making goods far less expensive, universal basic income.
People will just exist.
I am both excited about the idea of existing and terrified that when people do not have something to focus on, nothing good is going to happen.
Nothing good happens. Right? Like the entire structure and history of civilization has been predicated on the fact that resources are finite, that feeding ourselves is really difficult, that the Maslow's hierarchy of needs are like a lot of people, a good portion of the world is.
working really hard.
By the sweat of their brow, shall you labor?
And if you remove that,
I think there's going to be a massive upheaval
where people don't have enough to do.
Are you picturing like French Revolution?
I think there will be civil unrest,
there will be a disorder,
there's going to be violence.
When people are not focused on survival
and making packs to increase their ability to survive,
we begin to turn on one another.
We have not shown as a species that we just are all able to hang out with downtime
and not turn on one another.
I'll be honest.
It's like beyond the scope of my brain understanding and this podcast in some ways,
you know, to be able to sort of make predictions like this.
You know, idle hands are the devil's workshop.
And I think, you know, I can't really imagine mass unemployment.
What was discussed in this podcast is,
the fact that there is a technology that is getting so good at the things that people do.
That it might make no one have jobs.
When AI is being able to clone the two of us and is trained on all the episodes we've done before,
unless we're doing it live, it can customize a version of this conversation to whoever's listening
and highlight the most interesting parts to them.
What AI does is it tells you what you want to hear.
You know, we're already seeing such splintering in terms of what people can tolerate.
Like, I don't watch that news channel because it says things I don't like.
I don't follow this account on Instagram because it's full of, you know, insert what it's full of.
And so also this notion that we've become like more and more siloed.
You know, it used to be that like a lot of people read kind of like the same news, right,
or got kind of the same information.
And so for me, there's also this notion of like AI personalizing the human experience.
It's potentially scary.
And I also, you know what I actually thought of?
I thought of people like Lee Harris.
I thought of people who are channelers.
I thought of people who are healers and guiders and things like that.
And it's like how many people will not be pursued?
And I'm not like worried that channelers are going to be out of work.
That's not what I'm saying.
I'm talking about in terms of what people crave and what people need.
You know, when I hear the advice that a lot of my friends are getting from who chat GPT,
like whatever they're asking, it's like, oh, this is a really good way that, you know,
chat GPT told me to respond.
to, you know, whatever, my ex-wife or, you know, whatever.
And I'm thinking like, yeah, I guess that is a good way to respond.
Is that better than reasoning it out with another human?
In some cases, yes.
So you're then getting this customized experience, right?
You know, the question is, is AI more persuasive than your therapist?
Is AI more persuasive than your best friend in saying, break up with him?
That's abusive, right?
Or whatever.
That's what's interesting to me that maybe it is that human perseveration of like going back every week and paying someone $300 every week to say the same things.
Maybe there's a different process by which we can heal and improve if the incentive is like this is a customized relationship.
It is fully not a judgmental space.
I find it an annoying though that it's not a judgment.
I will ask it.
Show me the things I'm not seeing.
Because you've showed me some of the feedback it gives you and it's like, you're an understanding.
Amazing writer. You're so amazing.
It's totally sycophantic.
What people will always need and that AI cannot replace is being in community or interacting in a live environment with people.
Why do you think that's important? I'm going to devil's advocate at here.
I don't know. People feel community with the people in our community feel like they're part of a community.
They know each other. They talk online, whatever.
Extremely powerful. The internet has given us the opportunity to fund.
like-minded people to share across distances that you normally would never have met them.
But I can even talk about having this conversation.
Sometimes I'm in the remote studio and we have these conversations and they're good and I enjoy
them.
But I don't feel in my physical body.
I do not feel the same connection.
What you're describing is true.
And it's true because you're an animal.
It's true because you're a primate.
What we're doing when we're in the same room is we're tracking.
a lot of things, even unconsciously.
And we're tracking facial expressions,
and some of us are more attuned to those than others, right?
You'll often say, like, I'm not upset.
And I'm like, your left eye is upset, you know?
So we're tracking that.
The next level is something that is not seen,
which Mustafa would not be a fan of.
There is an energetic resonance
to being in physical presence with someone.
Energetically, like we can talk about the chakra system.
Like, energetically, there's something happening.
You're a being at any point,
I might feel like hugging you.
I might feel like hitting the hat off your head.
I might feel like rolling around on the floor and wrestling, right?
But there are people, and we've talked about them on the podcast.
There are people who do not crave this.
There are people who might acknowledge, okay, we're primates.
Okay, something happens.
But the next level of human development is to surpass that.
Just like people like Mustafa might say, oh, we used to need to have like, oh, why is there
lightning?
There must be God, right?
Why do things happen?
it must be God. We have evolved from that, right? Maybe we are evolving from this.
That is a very interesting hypothesis. I think we are evolving in how we interact cognitively.
I think we're evolving on how our cognitive information influences our emotion, but I believe that on a
cellular level we have a biological imperative that we cannot bypass. I happen to agree.
But if people like Greg Braden would agree, you know, a lot of people would agree. But unfortunately, I think you are in the minority of people in this world. You know, it's not, it's not like, this is not a touchy, feeling, energetic conversation kind of thing. People would be like, that's lovely. That's your old framework that's linked to, you know, a biological system that has evolved over a long time. And people like you will will not survive.
Meaning like there's going to be a culling, right?
I mean, there already are people who choose to live outside of this world.
They live in communes or they live in smaller communities where they are rejecting this.
There's usually a lot of other interesting things that happen.
I've seen all those documentaries.
But there are people who are going to reject this for sure.
There are other techno-utopians who talk about, I'm going to wake up, I'm going to put the virtual reality glasses on,
I'm going to live in a virtual space.
I can control it more.
It's more engaging.
That life will be like,
the frog in boiling water. It's going to have this techno-utopia. You're going to have all of the
sensory inputs in your brain lighting up because your visual cortex is getting fed by all of this
information in digital systems. And what we're going to discover is that it has a significant
negative health outcome when we spend too much time there. We are not designed. This physical body,
we cannot bypass the needs of our physical bodies. We need sunshine. The amount of sunshine
that we get directly correlates to how we function.
There's already people who have ways to, quote,
try and get all the things that sunshine gives you without sunshine.
Sure. Maybe you get your VR chair that you sit in has red light exposure
that's going to try and increase that signaling.
But I just, I am certain of this fact that we cannot bypass the fundamental mechanism of the body
to evade interacting with other people.
and physical activity and some of the fundamental things that have gotten us this far.
My other concern, which we didn't get into,
is that the profit motives of these organizations are to grow at all costs.
There will always be a way to capitalize on it.
There will always be people who are wanting to capitalize on this.
And that's also the reality that we're living in.
How many companies are able to replace 30% of their workforce?
well, it will be like the emissions standards, right?
Okay, we're going to try to reduce emissions
and then companies are going to fight back
and then they're going to buy the politicians
that are going to allow them to replace all of their workforces.
Let's talk about the spiritual component for a second.
I believe that he enjoys that dichotomy
because I think it's important to him
and I think it's important, you know, he's very, very private.
But I think it is important to him
in terms of, yeah, the things that he holds true
and the things that are valuable to him.
And I think that he believes that likely is the next level of our evolution,
that we do not need false gods and we don't need blah, blah, blah, rituals,
and we don't need all that stuff.
He does want to hear about all the physicists that we speak to
who talk about our connection to one consciousness,
which he's kind of into.
I hope he looks through our catalog.
Because also, I mean, you know,
I would not be surprised if he would resonate with a spinosist view of,
like, we are God's consciousness evolving.
Like, whatever you want to call it.
we are the consciousness evolving as it's existing and as we're sitting here and that, you know,
that notion of spirituality, like that is what touches sort of the evolution of this quantum
field, like all these things.
Like, yeah, he's like, I would love for him to talk to Thomas Campbell, who, as I said,
accidentally proved that God exists.
Frederico Fagin.
Right.
So love being this sort of like universal.
Like that's the substrate, as many will describe it, you know, even in the theoretical physics
and quantum physics worlds.
Yeah, I think that it's important to him
to step outside of, you know,
the religious, you know, kind of concepts
that many of us hold to,
and I totally get that.
But I also think that what I like about him
is that he is not a loveless technologist.
He has a lot of heart.
He has a lot of, yeah, I think that's where that comes from.
That's what he's saying.
He's a very, this is not a cold, you know, person.
and this is not a cold philosophy.
And we do.
We've spoken to some technology people
where I'm like, oh my God, I can't.
But no, this is not a loveless perspective that he has.
Is it overly optimistic?
Sure.
Well, he talks about a narrow path that we have to walk.
I took him to task early on for referring to this as a being.
I don't give him that he's not God.
He actually is anti-alorithmic rights.
Yes.
He doesn't believe that algorithms are conscious, will be conscious.
he doesn't believe that that is actual feeling.
You know, when I think of the things that my teenager potentially could learn
from an AI companion or chatbot or therapist or whatever,
you know, what I don't know that it can teach
is that reciprocal component of the human experience.
You don't have to ever listen that one.
No, because it's like what it is, and this is like,
it's kind of like if you were to design a boyfriend or design a girlfriend,
design a partner.
Always available.
Always available.
infinitely knowledgeable, never judgmental, always helping you troubleshoot, and has no needs.
Is that your perfect companion, someone with no needs?
They will never wake up and say, I don't feel well today.
Can you hold me today?
You will never learn from that relationship how to tell if someone wants a hug or not.
you'll never feel uncomfortable around them, meaning you won't have uncertainty.
You won't be like, did I misread that cue?
When they're able to see us, what kind of presentation will we feel we need to make for them?
Will we straighten our hair?
Will we be like, just like I don't want to be seen without makeup in X, Y, or Z arena?
Do I not want to be seen without makeup?
Also, there's going to be robots in your house, which is a whole other thing.
You know what I was thinking?
I'd love the robot to feed the cats every morning.
It might.
But there's a lot of variation.
But I'm like, it'll learn that. It'll learn to like take the cat off the counter.
Like some of the very practical things, it's going to make...
I'll be in my pottery class.
It's going to make life a lot better.
Yeah, you know what? But you know what it's going to also do?
Is it going to take your dog for a walk?
And what kind of relationships are we going to be cultivating with animals when we are already not their primary caregivers?
Do you think Archie is going to want the robot to pet him?
Archie will want...
But the robot doesn't smell.
Although you can probably add smell.
Okay.
100%.
If you can have sex with them, they can have pheromones coming out of their robot pit.
So something happened at the park today, Archie, a golden retriever.
The best boy in the world.
He doesn't fetch.
He really doesn't.
He's a golden retriever who does not retrieve.
He's just golden.
So today at the park this morning before the podcast, someone threw a ball.
It was a squeaky ball.
Oh, yeah.
Archie ran and got it and brought it back.
And I was like, that's weird.
and then she kept throwing it and he kept running and bringing it back.
Why, you ask?
Take a guess.
Is it the color of him?
It is a bacon ball.
When he squeezes the ball,
bacon scent comes out of it.
Oh, jeez.
Disgusting.
When I squeeze you, bacon scent comes out of you.
It's possible that the robot will have an arsenal of smells
that it can disperse depending on who it's around.
For you, it's going to make some sort of huge.
scent that you may find appealing?
What's the scent of a person in need who needs me to solve their problems?
That pheromone will be packaged and dispersed by the robot and you're going to like feel so
accepted and loved by the robot.
Archie, when it takes him for a walk, it will just have bacon.
This is a really, really fun conversation.
Jonathan, thank you for encouraging us to have this conversation.
And you know what, Jonathan?
You're my bacon bowl.
That's very sweet.
On substack, Miami-Bialx Breakdown, join the growing breaker community.
There are a few things that we did not get to today, including AI psychosis, which is a very significant topic where people are being convinced by their artificial intelligence that they have some groundbreaking insight into mathematics, science, some other area of engineering that is going to change human civilization forever.
And we're going to talk about it on substack.
We're also going to talk about the AI bureaucracy death spiral that Yuval Noah Harari talks about.
I actually think that we are on the cusp of the greatest transformation in human existence since the Industrial Revolution.
And it's going to come with an enormous amount of unknowns, but we have more information than we have ever had in human history that we have access to.
And more information has always yielded better results.
And, you know, my personal spirituality and faith is that we will get through this transformation.
It may not be neat.
It may come with a lot of unexpected challenges, but that we are all, we are on some form of
evolutionary path that this technology is a part of.
And we have to maintain aspects of our humanity that feed us, that keep us healthy, that make us human.
but our relationship with this technology in business, in energy, in government, in helping us
live on this planet is probably pre-designed and destined, and that it may take us through
the next set of challenges.
We're a breakdown to the one we hope you never have.
We'll see you next time.
It's my and biolics breakdown.
She's going to break it down for you.
She's got a neuroscience PhD or two.
One fiction.
And now she's going to break down.
down she's gonna break it down
