On with Kara Swisher - Demis Hassabis, Google DeepMind and the Battle Over AI Safety
Episode Date: May 28, 2026Kara speaks with journalist and author Sebastian Mallaby about his new book, "The Infinity Machine," and its central figure: Demis Hassabis, the CEO and co-founder of Google's AI research lab, DeepMin...d, and a Nobel Prize winner in chemistry. Sebastian argues that Hassabis is one of the original scientist-entrepreneurs of modern AI. And although he's extremely competitive and research-driven, Sebastian says Hassabis is also one of the few big names in AI development who genuinely cares about public safety. However, despite his best intentions, Hassabis doesn’t have the power to change the race dynamic driving AI’s rapid, and potentially unsafe, development. Kara and Sebastian break down DeepMind's relationship with Google, the push toward artificial general intelligence, and whether the government can regulate the technology before something goes wrong. Questions? Comments? Email us at on@voxmedia.com or find us on YouTube, Instagram, TikTok, Threads, and Bluesky @onwithkaraswisher. Learn more about your ad choices. Visit podcastchoices.com/adchoices
Transcript
Discussion (0)
Kara, I was trying to do this sort of optimistic, you know, ending riff.
I understand, Sebastian.
You just burst my balloon.
You know, intelligence has its limitations, but stupidity and greed are infinite.
So that's my feeling. I'm sorry.
Hi, everyone, from New York Magazine in the Vox Media Podcast Network.
This is on with Kara Swisher, and I'm Kara Swisher.
My guest today is journalist and author Sebastian Malaby.
He's a longtime chronicle of power and innovation, especially in the world of finance and
economics. For his latest book, The Infinity Machine, he turns his attention to tech. His central figure
is Demis Hesabas, the CEO and co-founder of Google's AI R&D Lab, Deep Mind, and a Nobel Prize
winner in Chemistry. Hasabas has dedicated his life to using AI to unlock the mysteries of physics
and biology. A former child chess prodigy, he's rabidly competitive and insatiably curious. But Malibis
says Demis is also one of the very few big names in AI development who
genuinely cares about public safety. His struggle to balance his ambition, his personal goals,
and the realities of the corporate AI race is, according to Malibi, one of the most defining
stories of the era. I think it's really important to look at characters like Demis
because he was a very early person in AI, at least the modern version of AI because it's been
around forever. He's also based in London and kept his company there and away from Silicon Valley,
so he has different goals here. At the same time, he's incredibly ambitious and a bit of
Krusty, according to lots of people, very typical of a science researcher type. But he has less
and less power over what's happening because of the vast amounts of money pouring into the space.
People tend to forego safety for profits if, in fact, they make profits anytime soon. He is different
from other AI developers. Oh, there's a lot of people who are sort of in his area, but he's certainly
one of the leading minds of this age and someone you should know well. All right, let's get to my
interview with Sebastian Malaby. We have two expert questions today.
from an Azdak CEO, Adina Friedman,
and Kent Walker,
president of global affairs at Google and Alphabet.
This interview was recorded live in front of a virtual audience.
It's part of the Dean's Summer Book series
at American University's Kogod School of Business.
So stick around.
Support for this show comes from The Guardian
and their new show, Stateside,
where journalists Kai Wright and Carter Sherman
use the entire independent reporting resources
of the Guardian to slow down
the news and wrestle with the questions we all have about what is actually happening in the world.
Join Kai and Carter three times a week as they utilize all the reporting resources the Guardian
has across news, international coverage, climate, culture, wellness, and more. And the Guardians
not owned by a billionaire, they fearlessly report the facts without interference. Go to theguardian.com
slash stateside to learn more and listen wherever you get your podcast or watch on YouTube. That's
theguardian.com slash state.
side. What's up, y'all? I'm Skyler Diggins, seven-time WMBA All-Star, Olympic gold medalist, and mom.
And I'm Cassidy Hubbard, host and reporter for nearly 20 years covering the biggest names and
stories in sports and mom. And this is Am Mom, a community for athletes, game changers,
and moms of all kinds. Dropping May 14th. Tap in with us. Sebastian Malaby, thanks for coming on
on. Great to be with you, Carr. So for people who don't know who demonstrate,
is. It isn't a household name the way other major AO figures have become like OpenAI's Sam Altman,
Anthropics, Dario Amodi, or, of course, XAI's Elon Musk. Even though he's accomplished as much or more
in AI, I'll just say I broke the story when they bought his company at Google a long time ago. And I
met him just briefly during that. He was mad at me because I broke the story. But nonetheless,
let's put him into context, because I did understand the importance of him in AI.
And he definitely, he's not in the shadows, but he's certainly not as well known, and he doesn't put himself out there. So how is he like them and what sets him apart?
So the first thing that marks him out is that he was the first, right? So the first scientist entrepreneur sets up deep mind in 2010 when AI can't even recognize a cat photo. Nothing worked. Deep AI winter. And then the others came afterwards, and they came afterwards as straight derivatives, right? So, you know, Open AI set up five years later. And Elon,
and Sam are explicitly trying to do the anti-Demis, anti-Google deep-mind company.
They are.
And then you go forward to Anthropic, and, you know, Dario, as a PhD scientist,
wanting to sort of, you know, do it with more of a social conscious and make it safer or like you sort of what he says,
I think also admire Demis and has, you know, people at Anthropics say sometimes he's the one who is the closest to a model that Dario had in his head.
So first point is he's the original Demis.
He's the only one with the Nobel Prize.
He's different in that because he started early, his approach to AI was not merely to scale an existing technology path, but actually to invent the technology path.
And so they brought together agenetic systems from reinforcement learning, mixed that up with deep learning, learning from data, and kind of invented the field.
And I think there's some DNA left over today.
from that experience, where if it was to be the case that AI in the next three years went down
a novel path, something more than just scaling the transformer architecture, it would be more
likely to come from Google DeepMind and Demis de Sassabis than from the rivals.
So talk a little bit. Also, by the way, AI has been around for a very long time. He started in
England. That was one of the things. Demas started the company there. And of course, Alan Turing.
Hello. Nice to meet you. But a lot of stuff went on very early in English.
actually, which is interesting. But how is he like the others for better or worse? How do you,
if they look at him as a mortal or someone that they look up to or are trying to copy in some ways,
talk about the attributes and maybe some of the negatives about that? He is different, I think,
in that his motivation is this intensely, intensely scientific curiosity to the point where he
expresses it to me in spiritual language. And there was this moment, you know, fairly early on in my
more than 30 hours of conversations with him, where we were sitting in a park in London,
and at the next table there were people having regular chats about their friend who went to
hospital or whatever it was. And I was opposite this sort of messianic, possessed person
who was banging the table and saying, you know, when I'm reading a scientific paper and it's
two o'clock in the morning, reality is screaming at me, demanding to be discovered, demanding
to be understood. And if I can understand it and get close to the fabric of reality and nature,
that I will understand the intelligent meaning that might have created this and I'd be closer to God, or at least his understanding of God.
So that is something which is very distinct, right?
Some of them are getting spiritual.
Peter Thiel talks about the Antichrist, which is anyone who's against AI.
You know, when you said that, when he's doing that, that actually would trouble me because these people do tend to think of themselves as gods manipulating machines in some fashion.
And so a lot of it is indeed spiritual, and at the same time, they're not gods, they're people, correct?
Correct.
And I mean, this gets to this question of, you know, is the motivation simply the sweetness?
This is the quotation from Robert Oppenheimer, the Manhattan Project.
The quote was, you know, repeated.
And at the time, Jeff Hinton didn't know that he was being overheard by a journalist from the New Yorker, but he was.
And what he said was, you know, he repeated Robinheimer's line, I'm not creating AI.
for any particular good reason.
I'm doing it because when you see a technology that's sweet,
you just do it and you figure out the consequences afterwards.
And as a scientist, I can't resist.
And I think Demis has quite a lot of that.
Right.
Except Oppenheimer, War is a little more thoughtful, wouldn't you say?
I mean, I have become death or that kind of thing.
I don't know.
I mean, Demis uses some pretty funky philosophic references, too.
He talks about Spinoza, he talks about Immanuel Kant.
He can riff on anything.
Yes, comparatively, he's quite, like, deep. So is Dario Amo in many ways. I mean, Darryo can quote from plays, which none of these others can do.
Elon's mostly sci-fi crap and Sam, not nothing at all, although he's not stupid by any means.
But Demis comes from a working class immigrant family. As a kid, he was a chess prodigy, not a surprise, who was consumed by the idea of AI.
Around 17, he said he decided to dedicate his life to this. Talk about what drove that singular focus to be the
the persons who solves artificial general intelligence and explain what that means because
that's defined differently by different people. I want to hear how you see his definition of it.
And this is called AGI. And again, you write that its definition remains fuzzy. So talk about
his definition. Sure. So just on the kind of early motivation, it really was extraordinary. I mean,
to at 17, and we're talking kind of 1993. You know, AI was talked about since Alan Turing in the
1940s, but it went through these rises and falls, as you know. And this was definitely winter
at that time. And, you know, the kind of AI that was happening was academics fiddling around
with toy experiments. It had no relevance to the real world at that time. So to believe not only that
you were going to devote your career to AI, but to super powerful AI, artificial general intelligence,
which, as you say, is defined by different people. But we could say it's the ability for a AI system
to be smarter than humans at any screen-based task.
I think that's probably a sort of average-type definition.
It's not the most extreme or not the most modest.
So, you know, this is what he wanted to do when you were 17,
which is pretty amazing.
Right, and that's how he defines it, any screen-based task of figuring out.
Well, actually, you know, the funny thing about Demas is that
he so loves the process of discovery and of research and the quest,
and he's got one Nobel Prize, but he definitely would like another one,
that he loves to go for a definition of AGI these days,
which puts it out further into the future
so that the joy of the journey can be extended.
And so what he says is
if you could train a computer or an AI system
on everything that was known in 1911,
and then you waited to see if by itself
it would discover general relativity,
and then it did, that that would be AGI.
That's this new definition.
Ah, probably not.
Maximist.
Probably it couldn't.
Yeah, I guess.
Wow, that would be something. Sorry, I doubt that would happen, actually. I'm going with Einstein on this one. He co-founded Deep Mind in 2010. Obviously, the name Deep Mind is exactly what he's going for. Four years later, as I said, Google bought it for $650 million. He was able to extract big concessions in the sale. I remember writing about it. It would remain in London, the offices, and there would be restrictions around the use of their technology. Talk about being in London, because most people working on this stuff were in, whether it was
Faye Faye Lee or Hinton. He was at Google. Faye Faye Lee was at Google for a little bit, and then
elsewhere, some of the early people were deep in Silicon Valley. So why stay in London
during this sort of social media, smartphone boom at the time? When I wrote about it,
and it was like, what's that? I'm like, no, no, this is a big friggin deal for Google to buy.
I understood what he was doing there, but talk a little bit about why he sold it.
It obviously need the money to grow it, I think, because as it's turned out, this
needs a lot of money. Talk about remaining in London and why. Yeah. So, you know, Demis's official
explanation for why he stayed in London was that there was a lot of scientific talent in London and in
Europe. And, you know, if you were trying to recruit great scientists, you had a competitive
advantage of hoovering up that, you know, geography. And, you know, if you were in Silicon Valley,
it would be super competitive to get the best people and it would be, you know, better to be in London.
When you actually look at who he recruited, the first PhDs who came, they were sort of from all over the place.
They came from Canada, from people who'd studied under Jeff Hinton in Toronto.
They came from Switzerland where there was a good PhD program in AI.
There was Cori Akavuktu Klu who studied in New York under Yan Nikkun.
So this notion that it was...
For people who don't know, Jeff Hinton is considered one of the early godfathers of modern AI, also Faye Faye A. Lee is.
and Jan LeCoon later ran until recently Meta's AI efforts.
Right, right.
And he was also an academic kind of pioneer.
And the point is that what Demis claimed as being the reason for staying in London
was not how it turned out, because he was recruiting from all over the world, including from the U.S.
And so I actually think the reason why he stayed in Britain is simple patriotism.
He just likes Britain.
You know, he's a classic melting pot product of immigrant parents in London, very attached to London,
and he simply thinks that the values in Silicon Valley suck.
And he would rather stay in Britain.
Yeah, I heard him say that.
So the mentality around the company was very different, so it was happening, and especially at that moment,
when things sort of started to go off the rails.
I would say 2010, 2011 is when Silicon Valley started to lose its ever love and mind.
So, you know, beyond the move fast and break things, nonsense.
It really did. It became something much different. And that didn't exist in London, obviously. And the safety demands were the biggest concession for Google. DeepMind demanded a ban on military uses. Think about Dario Modi at this point. Demas and his team also insisted on forming an outside safety review board to dilute Google's influence over the technology, smart. Why did Google ultimately agree to those terms given it was obvious how important AI was to the company's future, especially to their core business search, which this was.
would decimate, essentially, in its current.
Yeah, yeah.
I mean, the point person in the negotiation with Demis in that transaction was actually Larry Page.
And that was important because Larry, you know, his father had worked academically on deep learning.
And that impressed Demis.
And Demis felt that if he sold the company to Google specifically, he would be in the hands of somebody who loved science.
Larry, you know, he once said to me, you know, you could imagine Larry as a professor at a top college like Stanford.
And from Demiess, that's the ultimate comment of respect.
So whereas Mark Zuckerberg tried to buy Demis and Deep Mind,
and Demis sort of laughed him off,
and Elon tried to buy Deep Mind, and Demis refused.
He was happy and comfortable with Google,
because of that scientific culture.
As they would be, because these were two PhD candidates themselves,
and Google was started in a much more scientifically-focused way.
And then came the conditions, as you say, around safety,
around the AI, a sort of safety of a sideboard. And I did speak to the sort of chief lawyer who was on the
M&A team at Google, who remembered sort of basically being, you know, terrified by the idea of, you know,
diluting Google's right to do what the heck it wanted with this asset for which it was playing,
you know, several hundred million dollars. At the time was huge. That was an enormous shock to people
at the moment. Correct. Today it's nothing. It's like,
some credit card.
But this lawyer said to me,
we have a fiduciary duty as a public corporation
to own assets from which we derive value.
And if we're told, well, you can't derive value
because you have to have this outside bunch of safety overseers
who are going to tell us when you can or cannot deploy.
Forget it.
I mean, are we even allowed to sign that kind of deal?
And the way he described it is that the reason
that Google caved and gave deep mind what it wanted
is that whereas with many,
startups that Google buys. The notion is they've got some good tech and we'll get rid of
the fanned if we don't like him. To the contrary with deep mind is they wanted Dempest.
Like he personally was the reason they were so keen on paying up. And by extension, they were
willing to give him what he wanted on safety. We'll be back in a minute. Support for this show
comes from Bowling Branch. If there's even one thing off about your bed, it'll show up in
your sleep. Maybe your sheets slip around too much or your pillows not quite right.
These issues only get worse over time as materials wear down which can wear you down alongside of them.
With Bowling Branch, you can upgrade your bed and find everything you need to get better sleep.
They make everything from cotton sheets to pillows to blankets and comforters.
All are designed to be breathable, incredibly soft, and get better over time.
Most people start with signature sheets and it's not uncommon to buy two sets of sheets so you can rotate them.
With Bowling Branch, the moment you get into bed, you notice the difference.
I have tried out the betting.
It is fantastic.
I have a waffle blanket that I love so much,
especially in the summer,
where it's cool and warm at the same time.
So get 20% off your first order,
plus free shipping during the Memorial Day sale
at bowl and branch.com slash kara with code Kara.
That's bowl and branch, B-O-L-L-A-N-D,
branch, B-R-N-C-H dot com slash Kara, K-A-R-A.
Code K-A-R-A-R-A to get 20% off,
BowenBranch.Bronch.com slash Kara.
Code K-C-R-E-E-E-E-E-E.
Exclusions apply.
Buy Now Pay Later is everywhere.
And honestly, we need to talk about it.
60% of Coachella goers put their tickets on Buy Now Pay Later this year.
You can even pay off your DoorDash order in installments now, like your sushi.
So this week on Net Worth and Chill, I'm breaking down exactly how these companies are making money off of you,
why missing one payment can flip your interest rate from zero to nearly 36% overnight,
and the uncomfortable truth about what it really means when you need to split a $200 purchase into $4.4.
payments. Plus, I'm answering your questions, including what to do if you're already in over your
head. Listen wherever you get your podcasts or watch on YouTube.com slash your rich BFF.
Support for this show comes from The Guardian. Trying to locate news sources that reliably separate
fact from fiction can seem like looking for a needle in a haystack these days. Social media feeds,
cable news, and subscription-based news outlets might be able to give you one version of the news,
but not in the way that you need. You want news fast, but slow.
enough to actually absorb the information.
State side with Kai Wright and Carter Sherman is here to do just that.
The podcast tries to slow down the news and wrestle with the questions regarding the
world at large at your own pace.
Three times a week, hosts Kai Wright and Carter Sherman bring their expertise together
to showcase different and engaging perspectives regarding the world today.
They will use their collective knowledge to discuss the news, international affairs,
climate, culture, sports, lifestyle, fashion, and wellness.
Plus the Guardian wants to emphasize they're not billionaire owned, meaning they're free to report the whole picture without interference.
Go to the Guardian.com slash stateside to learn more and listen wherever you get your podcast or watch on YouTube starting May 13th.
Now, he had hoped there'd be one collective effort to develop AI because there wasn't a lot of AI development.
As you said, it was a winter of AI at the time.
And he had hoped there'd be sort of a Manhattan project with Google and Deep Mine at the center.
And, you know, one of the early interviews I did with Sam and Musk when they were starting Open AI was their worry that deep mind in Google would dominate, not just them, but possibly Mark, who they had thought little of at the time in that regard.
And so he was shattered after the first ethics and safety group meeting in 2015. Musk hosted it and then teamed up with Sam to start OpenAI when they were getting along.
And it was a rival.
And it was started.
He was testifying honestly for a second when he talked about the original reasons.
I happened to write that story when that happened when Open Mind was created.
So talk a little bit about the fallout of the meeting and how it changed his approach to AI development and the way he ran DeepMind.
Yeah, I mean, so what happened, as you say, is that there was this safety oversight meeting,
which was supposed to maybe for DeepMind to get useful feedback.
And it turned out the people at the meeting were not giving useful feedback.
They were kind of learning how deep mind was doing stuff and then collecting information.
So in that meeting there was both Elon but also Reid Hoffman, who was one of the funders of OpenAI.
And so the reaction was from Google, forget the idea of safety oversight boards.
We've tried that once and it was terrible.
So we're not going to do that again.
And Demis's reaction was, well, we can't get it.
up on the idea of a safety oversight board. It's essential for this technology. And so we're going
to have a fight about it. And so now this is, you know, 2016 is when this really gets going.
And there's this thing called Project Mario, as they called it internally at Deep Mind, where for three
years they retained, you know, armies of lawyers and investment bank strategists and people like that.
And there were term sheets running to 50 pages that flew back and forth between the, you know,
negotiators in Mountain View and the negotiators in London. And I was shown some of these things.
He tried to spin it out. He tried to spin it out. Yeah. I mean, he thought of spinning out because
that would be the threat that would force Google to agree to the safety oversight board.
And, you know, Reid Hoffman promised a billion dollars to finance a spinout. They went to see
Joe Tsai, the co-founder of Alibaba in Hong Kong to try and get some money out of him. It was a real thing.
And, you know, what happened after three years is that Demis caved.
He was so exhausted by this three years of negotiation and, you know,
he'd get another long term sheet from the lawyers and he would hold his head in the hands and say,
I don't want this.
They were never going to let him do it.
I don't want this part of my brain to expand is what Demis wound up saying about legal documents.
And so the upshot was, you know, he didn't get what he wanted.
Google was never going to do it.
I kind of developed a weird respect for Sundar in learning about this process because he was very canny.
He knew he didn't want Demis to spin out.
He didn't say it quite directly, but he hid behind his chief counsel and other people who played bad cop on his behalf.
And at the end of the day, he got what he wanted, which was to keep Demis inside the tent, not spun out, so that he would be the secret weapon.
Right, because he did understand what was happening in Silicon Valley with the competitors, right?
right, Google had to be at the forefront of us.
And Sundar, who's a very lovely affect, is really good at playing ropa dope, I've always found, you know, in niceness.
But let's talk about this idea of what Demas wanted to do here.
He says he was naive to believe in a singleton scenario where AI developed collectively, but he also saw himself at the center of the effort.
Now, you could say that's egotistical, and it does take a certain amount of narcissism that you should be in charge of all AI development.
I have problems with, I am more with the collective,
but at the same time it always devolves into either one person
or just a few people developing this thing.
But talk about this idea,
because they were never going to do it once they understood
the financials here, the amount of money and the amount of power they would.
Was that naive of him or egotomaniacal?
He says he was naive.
Yeah, I think it was naive of Demis to believe that AI would be developed
by one single lab on behalf of all.
humanity. I mean, humans are just disputatious and tribal and jealous, and they don't do that.
Greedy, mostly.
That too, probably. But, you know, I...
I like that you said probably there.
No, I said probably because what strikes me, Cara, about this whole field is that the normal
cynical explanation that people are doing it for the money is weirdly less true.
Because AI is such a weird technology. It attracts people who are basically doing it for power, for
ego for...
Power is, yes. It's Promethean.
You're right. It's not about money.
So, you know, in hindsight, why did he not see this
at the time? And I don't think he was doing it
for the money. He is a true believer of all
these people. And of course, there's the glory. He wants a Nobel Prize. That's
pretty great. And he has curiosity. But
should he have been less naive
or explain the naivete
because it seems obvious
to see that they were not going to
do this? Yeah, I mean, I think there's
you know, there's some, you know, mitigating circumstances that you can cite that make it a bit
less crazy to have believed in this single thing. That would be simply that when he was beginning,
you really could fit all the AI believers in one conference hall. And so there was a sense of a single
community at that point. And then, you know, he starts deep mind and it's going really, really well,
and he does, you know, this Atari model, which is just an astonishing agent that can learn by itself.
how to pay, you know, dozens of different video games.
And that impresses everybody.
And then he gets, you know, the Google checkbook behind him.
And it feels like he's the only game in town.
And if there's a second game in town, it would actually be Google Brain in Mountain View.
And so that is the same company.
And, you know, Open AI just wasn't a thing then and didn't really become a thing, you know, until, let's say, 2019.
Until recently.
Yeah.
Yeah. So I think it wasn't totally crazy at the time to think, well, I can't see anybody else on the horizon who's doing this, so it's going to be me. But it's still crazy, still naive, still, you know, immature to think that when you're confronted with a godlike technology, there won't be lots of acolytes trying to do it, and there'll be sectarian splits, and you can continue their metaphor.
Right. Now, we've heard Altman, Musk, and even Mark Zucker would claim they care about AI safety. I believe none of them, only to watch them prioritize growth and their own egos of time after time. Is he different? Is he remain different? There's almost no incentive for tech companies like Google to make AI safety their top priority. For example, Google is eager to supply AI to the Pentagon after agreeing not to do so when it bought DeepMind. So while he understands, Demis understands the risks of developing AGI,
does he have any more power to contain them in the face of the pressure,
both national security, financial, just to win,
to be the dominant technology of the next era, etc.?
Yeah, I think Demos has gone a long journey, right,
since founding Deep Mine 16 years ago.
You know, at the beginning, he thought there might be a Singleton scenario.
Then when that started to break down because Open AI, you know,
launched a competitor, he still hoped to get oversight for his technology,
as we discussed with Project Mario negotiating.
And then when that didn't work, he said,
well, at least I'll make AI good for humanity
by doing it for science.
And that's when he did the protein folding system.
And then, you know, along the way,
although interestingly, he didn't ever tell me this.
I only know it from other sources.
He was the one who said to Rishi Sunak, the British Prime Minister,
you know, let's have a global safety discussion
at Bletchley Park in 2023, and that happened.
And so I think.
I think he had a reasonable track.
Explain that why Bletchley Park.
That's where...
Well, that was where during the Second World War,
the German code was broken with...
By touring, with sort of the early kind of precursors of AI.
It was very symbolic.
Exactly.
So I think, you know, up to 2023 and that summit,
he had a pretty good track record, Demas,
in, you know, walking the walk as well as talking the talk on safety.
I think, though, that once he got into the race full-on,
to do chatbots in competition with, you know, Open AI and then Anthropic, he's done less and less, at least visibly.
And it strikes me, for example, that by his own logic, open source models are dangerous, and yet Google releases them.
He wanted to deprive the military of AI, and yet Google now supplies them.
And his sort of rationalization for this is simply that there's a race on.
Chinese labs are part of the race.
If he were to step back, if he were to quit,
it would make zero difference to outcomes for humanity
because there'd be six other labs doing it anyway.
Sure, but he wouldn't be part of it, in some ways, right?
Yes, look, and I think that's a super interesting debate about it.
Do we care about the gesture or do we care about the outcome?
Right. I mean, I think his power had waned is in that regard
because people caught up, even if they're not as brilliant as he is.
Now, he reminds me a little of Nikola Tesla ultimately,
You know, the greatest mind in Edison just ran right over him.
In 2024, he shared the Nobel Prize in chemistry for his work using AIT
to predict structures of proteins, as you noted.
Amazing thing.
It will lead to the creation of new drugs and vaccines to fight diseases.
It's an amazing thing.
And an astonishing use of AI in service of humanity.
I think one of the best examples and not marketing that the rest of them foist upon me on a daily basis.
And it could be where AI makes people's lives better.
talk about this because and what it can mean for medicine.
I know a lot about this.
I've done a lot of report on this,
but it really was a moment.
And it is taken off, whether it's MRNA,
all kinds of stuff, drug discovery,
you know, the quickening of drug discovery and ideas.
Talk a little bit about this.
Yeah, well, I know your CNN show gets into this, right?
And so you probably could talk about it more than I can.
But I mean, certainly in the creation of AlphaFold, this system,
I mean, that in itself is an amazing thing.
story where Demis at Cambridge as an undergraduate had been told by a biologist friend,
oh, there's this conjecture in structural biology by a Nobel laureate from the 1970s called Christian
Nguyenfinson, that if you stretched out an amino acid chain and you looked at the DNA sequence on
the chain, the sequence tells you how that chain will fold itself up like a self-executing
origami model into an intricate, beautiful shape, which is a protein. And we have proteins in our
bodies, and there are proteins in plants that are the basic building blocks of nature. And you can tell
this intricate structure just by looking at the code. And so it became a sort of grand challenge
in biology, who can create the computational system that will just look at the code and then guess
the shape. And from the 1990s, there were teams in different universities competing to do this. And
DeepMind decides after winning Go, defeating the Go champion in 2016, well, that was a...
That's a game.
The game of Go.
Yeah, exactly.
That was just a game.
But then, having solved that problem, which involved this massive combinatorial complexity,
because Go has all these different permutations.
They do.
But boring in comparison.
So why don't we move on...
Checkers.
And leap all the way to predicting the combinatorial complexity of these possible shapes.
You know, one strand of amino acid.
could fold itself up in billions upon billions of different shapes.
So in that sense, it was similar to go.
And having solved go, they felt that their computer science skills
had reached a point where maybe protein folding was crackable.
And so they set out to do this in 2016.
By 2018, they'd beaten all the universities.
They had the best model.
But it wasn't good enough that a pharmaceutical research team
could simply use the prediction from computation
to create a drug.
So then the question was,
should we push on
and try to really make it that accurate?
And the view of the leader of the team
within DeepMind was, forget it, boss.
We can't do this.
This is impossible.
Don't send us down a blind alley.
We should just declare victory
where the best team in the world
and then we should move on.
And Demis was like, no,
I want you to actually solve the problem,
not just be the best.
And so they had a bit of a fight about this.
And Demis said to me,
well, I was being unreasonable
but I wanted to be reasonable in my unreasonableness.
So I listened into the team's discussions for a while.
And when I heard they had lots of ideas
that were just flowing naturally,
which they hadn't yet tested in the lab
or in the computational lab,
I figured, well, there's more stuff they could try.
And so then he pushed them.
He switched out the team leader,
put a new person in charge,
and then in 2020 they succeeded,
and they did predict the shapes of proteins.
And then the kind of,
the badass move was to open source it,
just like, you know, for free, any scientists in the world can effectively do a Google search
and get the shape of the protein that they want to work on.
We'll be back in a minute.
For basically two decades, the experience of using the internet hasn't changed,
which is to say when you want to do something, you go to Google, you type some words,
you hit enter, and then you click on some links.
But now Google, in particular, is really eager to change that.
This week on The Vergecast, we're talking about all of the news from IO,
Google's big developer conference, including the ways in which it is going to change search
completely and forever. All that, plus what a Google book actually is on the Vergecast,
wherever you get podcasts.
Support for the show comes from NetSuite. Every business is looking to see how AI can work for them.
But while the possibilities are endless, the risks are as well, and you can't sit it out
because your competitors are already making their move. But with NetSuite by Oracle,
you can put AI to work today.
NetSuite is a top-rated AI cloud ERP trusted by over 43,000 businesses.
It's a unified suite that brings your financials, inventory, commerce, HR, and CRM into a single source of truth.
That connected data is what makes your AI smarter.
It knows how to intelligently automate routine tasks, how to deliver actionable insights,
and can even help you cut costs and make fast AI-powered decisions with confidence, giving you total flexibility.
From software and IT services to healthcare equipment manufacturing,
manufacturing financial services and many other great American industries,
NetSuite delivers a customized solution for your business.
If your revenues are at least in the seven figures, get our free business guide.
Demystifying AI at netsuite.com slash on.
The guide is free to you at netsuite.com slash on.
NetSuite.com slash on.
One of the things that's interesting, the parallel you make in the book and it's
frequently made about the development AI is to Jay Robert Oppenheimer,
is who we discussed earlier in the creation of the atomic bomb.
It's one that Demas and others in the field welcome,
but Oppenheimer is also, not just because I saw the Christmas,
Nolan movie, I read a lot about Oppenheimer.
He saw the bomb as an evil thing.
It kicked off the nuclear arms race.
He became a scientific exile during the Red Scare.
How does he feel, Demas feel about this?
Because right now, as you note correctly,
there's a huge backlash to not just data centers in the U.S.,
but AI in general, the polling with the public is, you know,
only Trump has worse polls at this point.
But AI is pretty disliked.
So talk a little bit about that.
Yeah, I mean, I think he feels slightly that that's why you have to talk up the optimistic side of the AI story.
I think he's a little frustrated with Dario, frankly, for going on TV and saying within five years, 50% of entry-level jobs will be gone.
Right.
And to propose to kind of say that kind of thing without proposing the policy.
remedy, you know, Demis sort of points slightly a finger at Darryor on that. But I think, you know,
I'm not sure I agree with him, frankly. I think, you know, Daria has a good case to say, hey, we've got to
call it like we see it. And that will wake people up and politically maybe there'll be a stronger
policy response if we do that. So I'm not sure Demis has any particular solution to this, you know,
popular fury. Does he see himself as an Oppenheimer? I mean, Oppenheimer went through a pretty
rough period before we liked him again, right? Or when he got finally fed it at the end of his life.
But there was an exile happening. There was exile happening. You know, I think Demis embraces the
kind of scientific glory, the leading of the Manhattan Project, the heroic story of, you know,
going off into the wilderness and focusing on nothing but the scientific mission. I mean,
there's something about Demis, which is almost somebody called him a warrior monk. And off he goes,
in his mind's eye to the desert in isolation. And that just is a super appealing self-image for him.
Yeah, nothing narcissistic about that, but go ahead. That's the Oppenheimer bit that he wants to
identify with. He doesn't identify or doesn't talk about, you know, the idea that he would be
ostracized and, you know, there would be kind of a political... Yeah, Dario's taking the flag for that at this
point, right? Yeah, yeah. And I think there's an interesting debate about whether, you know,
If you look at Daria's principal stance on the Pentagon using AI for weapons, it was good
in terms of raising public awareness of the issue.
It didn't change the outcome.
So if you're Demis and you look at that, you could say to yourself, well, it didn't change
the outcome, so what was the point of that?
I'm much smarter.
I'm going to go do this behind closed doors.
I will talk to politicians as I did with Rishi Sunak and suggest things.
They can take the credit.
You know, what's the point of going public if you don't change how the world works?
Absolutely, except he didn't change how the world works either, but that's another issue.
So we're in the middle of an explosion of growth around AI, and you write the estimates of achieving human-level AGI, again, much disputed by 2030 now up here, slightly conservative.
Talk about how Demis looks at this, because I get a different answer, different people, and I don't think they even, I think they're just guessing.
I feel like at this point, they're just making it up.
But talk a little bit about you get very different numbers from different.
people. You do get different numbers. I mean, if you talk to people at Anthropic, they're really saying
2028. And what they say is that by 2028, there'll be recursive self-improvement, meaning that the models
will be coding the next model. And once they've done coding the next model, the new model will
recode the next one after that. And so you'll get this vertical acceleration in the capacity of the
systems. At that point, you're done. So they go from dolphins to humans. That point you're done,
the race is over. And they say 2028.
in written material, I think actually privately, they even think it could be next year. So they are
super near term in their prediction. Demis would, you know, love to kind of nudge his prediction
beyond 2030, 20301, 32. And as I was saying, that's partly because his definition is, you know,
can it be Einstein, which is obviously the most expansive definition. Then there are people in between
who say, well, it's about when most economically valuable human tasks that you could do in front of a
screen could be taken over by AI. And then people might put a 2030 kind of number on that.
So I think that's the range. Right, right. And you just, of course, are seeing a lot of the layoffs
from meta and many others. So every episode we get a question from an outside expert. We have two
for you. Here's the first one. Hi there. I'm Medina Friedman, the chair and CEO of NASDAQ.
Based on all of the time that you spent with Demis, what do you see as the role of enterprise
adoption in realizing the potential of AI? And if you do see it as
being significant, what are the key obstacles that enterprises need to overcome in order to be
able to achieve its potential within the enterprise? So I just referred to the layoffs. So go ahead.
Yeah. So I think the revealing thing here is that the answer to the question of what does Demis
have to say about enterprise adoption is zero, nothing. And that shows us the separation between
the builders of the models and the real world users who are going to actually put it, you know,
change the way corporations function
on that stuff. Although many of the builders
are talking about it, Anthropic would
be the one who seems to be making the most headway
in that area. Yeah, I mean, I think
Anthropic is very good at
sort of going for enterprise
tools, so coding first,
cybersecurity to second, and
then having forward-deployed engineers
this is the kind of Palantier
model who helped corporations
to adopt this stuff, so I agree with you.
But certainly in a big company like Google,
the people who are doing the
Palantir stuff are in some other division of Google.
And Demis is really just focused on building the product.
And to the extent that you have this separation, and you're right, Cara, that it's not
as clear in a smaller company like Anthropic, but I think the separation maybe does
tell us something about what could go wrong here, right?
That, you know, one set of people are just focused on building something and they're not
really thinking about how it's going to be used.
Yeah.
And then another is actually actively thinking.
And we're starting to see more companies, for example, justify layoffs by pointing to AI.
Sometimes that's not the case, but they still are using it as an excuse.
Cisco laid off 4,000 people earlier this month while announcing record revenue earnings.
Mata laid off 8,000.
In Goldman Sachs estimates AI a limit around 16,000 net jobs a month over the last year.
Now, some of these, as I said, companies are using as a convenient scapegoat for too much hiring they did during COVID,
which I think most people, especially the tech companies did.
talk about mass joblessness, and is that something that Demis thinks about, and if so,
what's standing in the way of that? And he said that he thinks the companies who are placing
developers with AI, quote, show a lack of imagination and a lack of understanding. Is he being, again,
naive about corporate incentives around tech? And some people are moving too fast forward,
and it's not going to work, obviously. But talk a little bit about this.
Yeah, I think there's sort of two extremes which are wrong. You know, one extreme is to say there's
nothing to see here. There's not going to be any big jump in unemployment. We've been here with
previous kinds of technologies and the labor market always adjusts. And, you know, we had the internet
and actually unemployment was very low throughout that period. And I think that's naive because,
you know, AI is not just another technology. It's more powerful. It's more general. It's directly
competing, you know, with human cognition. And it can be scaled if you have enough data centers,
you know, up the wazoo
so that you replace, you know, tons of people.
So I think we can't just draw comfort
and be complacent
just because of the technology history.
On the other hand,
it's also way too simple to say
now that this system
can do all this stuff, you know,
humans are done. Because,
you know, new jobs will emerge
to some extent. I mean, you know,
it's partly that there are tasks
that humans are better at
dealing with humans sometimes. So if you think,
about the sales team, enterprise sales team in a big company, where the job is basically to go
schmooze the humans who are your customers and forge a bond with them, I think humans have an edge
at that. So I think there are a lot of tasks where humans will remain superior. And to the extent
that the economy grows because of AI, there'll be more of those tasks. So I think we should be
aware of both extremes. I mean, one number I like... It's unclear. I like to cite this
this statistic, which is that no technology has ever driven economic growth per capita at the
frontier more than two and a half percent a year. So people who tell you that AI is going to
like double the size of the economy in 15 years are smoking something. It's just not that's
abundance. You're not an abundance person, neither am I. The argument, I'm so tired of that.
The argument around rushing to develop, obviously, AG, I think, has largely centered on beating China,
But in many interviews with these people, it's, I call it the Xi or me argument, like, we got to do it, or China will. And I get it. But in a recent op-ed, and I really appreciated it that you wrote in the New York Times, you call for the U.S. to negotiate a safety pack with China because we cannot beat them. And not just falling behind, but there's certain things, as with nuclear energy, as with everything else. If we're falling behind, what incentive does China have in signing a safety pack? I think there's huge incentives for them to do so. And it's not just to keep them from
being ahead of us, it's that there are commonalities here as with, as I said, nuclear energy or
nuclear weapons or cloning. There's a lot of stuff that is global. And oddly enough, I ran into
Tony Blinken last night and he said, I had urged him when he first got his job to do a global
pact around safety and with China especially. And he's like, well, I didn't get that done. I'm like,
no, you didn't. And then I walked away. I was rather intent on getting them to stop, you know, to pay
attention to this. But talk a little bit about this, this sort of Xi or me and what happens with
China, because you are correct, they are doing astonishing work here. And we had been ahead,
obviously, the U.S. or democracies. And now, I'll put all democracies because Demas is in London.
But talk a little bit about this race and also the need for a safety pack, which I think is critical.
Yeah, yeah. So, you know, China does everything fast. So my book came out in China before it came out in
the U.S. And I went to China in March.
for the launch. And I spent eight days basically going around talking to AI leaders, both in academic
labs and in industrial, you know, tech companies. And what struck me was how often they brought
out the topic of safety. And this was interesting because that is not what you hear from people who
put the chip export controls in place in 2022 in the Biden time. So those people, you know, several of whom
and my friends, and I've talked to them a lot about this, you know, they said to themselves,
you know, credit to them, the scaling laws are real, AI is going to be super powerful.
And they said this before chatypte came out. So we're going to do something. We're going to
prevent the bad guys from getting this AI. But that definition of bad guy was China.
And in my view, there's a more important set of bad guys who are criminals who want to do cyber
attacks, terrorists, individuals, rogue states.
you know, random bad people.
Rogues, just rogues, individual rogues.
Exactly. And they missed out that whole category.
And by making China the enemy and the rival and saying,
you cannot get AI and we're going to deny you the chips and say you won't have
invidia, no invidia, no dice, you'll be left behind.
You know, the mistake was to make China into the enemy
and lose maybe a chance to talk to them about,
what about non-proliferation of this stuff?
Maybe we should just say, you're a technology superpower, we are a technology superpower.
The way we're going to avoid some catastrophic war between us is the same way we did it in the Cold War with the Soviets, which was parity, mutually assured destruction.
Parity is actually good for balance and stability.
Whereas when you're talking about random rogues using this stuff for bad ends, the Cold War lesson is that's where you need the IAEA to keep track of the material and the non-proliferation.
Treaty. And my friends, you know, say, who were in the Biden administration, say, well, you know, yeah, but you can't talk to the Chinese because they don't care about safety. I went there and they did talk to me about safety. They say, you can't trust the Chinese. And I go, you think it was easy to trust Khrushchev. You know, I mean, this was the Soviet leader who banged his shoe on the table at the UN and put missiles in Cuba. Not an easy guy to talk to. But in that period is when we created the nonproliferation regime for.
That's right. And they have their interests of their economy being destroyed by a rogue something is just as high as ours.
Totally.
It's just really kind of. I was always like, hmm, not so sure I want either of you.
You know, I'd like a global safety group that includes companies, includes legislators, includes China, includes the U.S.
So that we have, it's a very similar to nuclear. Exactly. We trust a cruise. That's a great way to put it.
I thought that piece was terrific.
Thank you.
Now, we have a second expert question for you.
This is from Kent Walker,
president of Global Affairs at Google
and Alphabet and the bad cop, apparently.
Let's listen.
Hey, Kara.
Hey, Sebastian.
In reading the book,
I was struck by how well Sebastian
you captured Demis' vision
of using AI as a way of solving intelligence
to then solve everything else.
It was a scientific tool
to help us address some of our biggest problems.
The challenge is that polling in the U.S.
suggests that America is one of the least optimistic
countries about AI, much less optimistic than China's. Maybe we've had too many debates between
AI accelerationists and AI Dumer's, but how would you suggest we go at the challenge of creating
a grounded optimism, recognizing the challenges, but also encouraging people to put these tools to work,
to benefit themselves in their everyday lives and to benefit our society. Thanks. That is a great
question. One, Google, you should stop being so aggressive, but go ahead. Yeah. So, I mean, we refer to this a bit
before, but I think that medical breakthroughs that delivered AI-generated or AI-assisted drug
discoveries that really save people's lives, that would be a great thing to change public opinion
on whether AI is good or not. I also think that we ought to put in place preemptively before we
totally need it. Things like wage insurance, retraining schemes, active labor market schemes to help
people get other jobs. Do that early. Don't wait around until it's obviously.
essential, because at that point, public opinion will be so mad at you that, you know,
it won't make any difference. There'll be riots. There'll be work riots, just as they were
before in other. I think a useful statistic here is that in the 12 years from 1999 to 2011,
the total number of job losses as a result of China renting the WTO was 2 million in the US.
2 million is nothing.
2 million is like the amount of labor market churn you get in an average month in the United States.
And yet, you know, the backlash against China, the perception of the China shock, the fury about globalization politically was absolutely massive.
So imagine if you got an AI shock that was way, way bigger than China, the reaction will be, you know, as you say, it will be people in the streets.
I mean, with the Industrial Revolution, what happened was you got revolution politically, you got
Marxism, you got a whole lot of turmoil, and that was a revolution which, you know, took place
probably one-tenth of the speed of the AI revolution, and may arguably have been smaller.
Absolutely.
I think they don't even understand the anger, the rage that is building, and it's manifesting itself.
I think a lot of the AI anger is a manifestation of affordability and nervousness about
the future. And now it has become that. It has become that. I don't know what you think,
but I think there's some merit to this idea of Trump accounts, where you would put shares
in AI companies or other stakes. You distribute that democratically to all young Americans.
Sounds good. No, he doesn't seem interested in doing, he does them, but he does other things more.
The stuff that he does is populace. I'm not against, like the Trump accounts or the, I don't like
him calling them Trump accounts or Trump. I don't like him calling them Trump accounts or Trump.
Or X or whatever. He has to put his fucking on everything. But, you know, but that idea is correct. You know, UBS, some version of this or more. Like, where are the jobs and do some really serious government studies and where we work with companies? And, you know, this recent AI advisory board has nobody on it except for business people. There's no way they're going to come to any conclusion but their own. And they could use critics. They could use someone like you, someone like me, someone like an academic, someone like, you know, they're just,
refuse to have wide-ranging points of view here.
That is probably going to be the biggest problem, I think.
I think it's also relevant to Ken's question that, you know, the record in the last couple of years,
well, during the Trump period, is that all the energy on legislation has come from the states.
And the AI companies, the tech companies, have lobbied actively to stop that stuff from passing.
And they have a decent argument in that a patchwork of state-level stuff would be way less effective than a
federal thing. But then that's why you need federal intervention, right? Which they are also trying
to stop, which is why they're sitting in the front row of the Trump ignogers. Yeah, I don't quite do. I think
that's a bit tough. I know you like to be tough. But I think that in the Ben Buchanan period,
when Ben Buchanan was the czar in the White House, what he said on the record publicly is that
whenever he talked to the labs, they were willing to support what he was trying to do in terms of
setting it up an AI safety institute, in terms of their...
then requiring labs to share their models with the Safety Institute before they were released.
You know, clearly that regulation should have gone further.
But he says that actually the labs were encouraging him to go down that path of regulating.
And I think I don't have any reason to disbelieve that.
So, you know, I think...
I disbelieve that.
But look, with the Trump administration just as starting to announce now, the same thing, the exact
that they rejected, correct? Now, they do that with a lot of stuff, but their most recent noises
have been exactly what that Biden executive order said. Yeah, I agree. So Trump...
Which is crazy. The Trump people have done... They're like, this is our new idea. And I'm like,
well, that was two years ago, three years ago, Fletchley Park.
100%. Completely agree with that. But that's a description of the Trump administration's U-turn.
I think the position of the AI Labs, which is what we were talking about earlier, I think they actually
have been open to sensible federal action. They just hated the state action. Well, they're getting
the state action because initially they lobbied against any kind of tech regulation, right? And so they
find them, they should be supporting it. They shouldn't have kneecap Amy Klobuchar, for example,
or they've been kneecapping politicians for a long time. And I think people don't trust them. I think
that's where it is. And then when you have any manner of them swanning around looking like
Daddy Warbox everywhere across the world, it's not great. It's not going to, you know, when Elon
hasn't held. Jeff Bezos certainly hasn't. And neither is Marr. I mean, I think the imagery,
you don't have Demis is there. Or, you know, Dario is a hero. And like, he's fine, but, like,
that's it. Like, that's the problem. There's no heroes. There's a lot of people who look like
they're in it for the money. So what is your explanation? I'd love to get your view on this. So why is
that Demis is not particularly famous in the U.S.? I mean, I've been. He doesn't want to be.
Yeah. He doesn't want to be. Yeah. He could be. He could be. He could be. He could.
could be all over the place. He could be Dario emoting everything because he deserves that spot.
I think he's a true wonk probably. And so he's, the science is everything. But, you know,
history is littered with people who sciences weren't as savvy. Nikola Tesla wasn't as savvy as Edison.
Edison was a PR person. He did all many of nefarious tricks against Tesla. Like, you know, I don't think
he's that much of a victim the way Tesla certainly was if you read a lot about what happened there.
but I think he likes to be pure.
He likes to have that image of himself as pure.
That's my, I don't know him very well,
but that's what I can see.
But he certainly deserves it.
He certainly deserves the attention.
You know, Jeffrey Hinton likes to take up space, that's for sure.
But you could see him out there more.
But no, here he is with your book.
So obviously he's talking to you.
So last question.
Today's AI race is exactly the scenario he had hoped to avoid.
But in an excerpt in the Atlantic,
you wrote that Demas has, quote,
come to see salvation paradoxly in his own career advancement and securing personal influence,
we have concentrated so much power in the hands of just a few people. After years of talking to
many of them for the book, what do you make of his conclusion and what does it mean for the rest of
us or worried about concentrated power? I know I am of anyone, even if they were the angels.
I don't feel like they should have this many small amount of individuals to have this must power
over something so important. Of course, it's happened in history, but
it's never ended up well, and this is quantumly more powerful than any, like, railroads, trains,
the telegraph, stuff like that. Are you worried, and should the rest of us be worried about
this concentration of power, even if it's in the hands of people that are better than others,
but a lot of them aren't. Yeah, yeah, yeah. Yeah, look, I think in a way the story of Demis Sibis
is, you know, of a decent person, a good person who wants to be good, but can't actually have a good
impact because he's inside this race dynamic, inside a big corporation, and whatever he may
personally think about safety, there are these larger forces that are driving him on. And if he were
to quit tomorrow and take a professorship in theoretical physics of Princeton, it wouldn't change
the race. It wouldn't make the world better. It wouldn't do anything very constructive. I'm not sure
I want him to do that because, you know, it would just be a gesture and it preferred to focus on the
outcomes. So what this points to is that we do need government intervention. You know, the only way to
counter the power of this handful of individuals who are kind of collectively very powerful, but
individually impotent in terms of the big social questions, you know, you need government to
take a serious intervention. And, you know, why not? We have drugs in the United States,
which are approved by a regulator. And if they're dangerous, they're not allowed to,
be released, right? Why wouldn't an AI model be released without being tested by the government
first? Why would we allow, you know, open weight models that can be ripped off by anybody,
abused by anybody, used for a cyber attack, and you wouldn't be able to kill it with a kill switch?
It's crazy, right? So I think what we need is far more active government action, precisely because
AI needs to be governed. Right. So where does that leave the rest of us if AI goes the way that social media
did and the government fails to act. I mean, obviously different governments are doing different
things, but there's no coordinated global effort at all. But, and in this country, forget it
so far. And of course, we did nothing to slow down the relentless and often poisonous
and toxic pace of social media. So where does, what has to happen? What do you see happening?
What does Demas see happening? I think, I think he's got to the point where he's trying a little bit to, you know,
politicking behind the scenes and suggest that, you know, more action is needed and it has to be
collective and the government needs to lead that. But whether he's putting real energy into it,
I can't tell you for sure. And so I think he's just, you know, that history we talked about
before of Project Mario and trying to get safety oversight, it's almost like he's burnt out on
trying to solve the governance problem. And so he's just heads down on the technical problems,
which is a regrettable place to end up.
But all I can say is that, you know, I mean,
that's the most optimistic thing that's happened in the last few months
was when Anthropic released mythos
and the Trump administration freaked out.
And they called in the heads of the banks and said,
you guys are going to have hacks that empty your bank accounts
unless you can harden your cyber defenses
because this stuff is for real.
And they basically did a 180.
And now, you know what, Anthropic had this list of 40
kind of responsible tech companies,
that we're going to get the model first
before anybody else got it,
and then they were going to roll it out to others.
Those subsequent waves have been frozen
because the whole decision-making
around the release of the models
has been requisitioned by the Trump administration,
and they're sitting on it,
and they're saying nobody's allowed to have this.
And so they've gone from being laissez-faire
to maximally interventionist.
It shows you how freaked out they are,
and maybe that's a hopeful sign
for action on regulation in the future.
Unless they're trying to do it to make more money.
Who knows?
Yes, possible.
How can we take all those bank accounts and get them for ourselves?
Kara, I was trying to do this sort of optimistic, you know, ending riff.
I understand, Sebastian.
You just burst my balloon.
Oh, I don't know.
You know, intelligence has its limitations, but stupidity and greed are infinite.
So that's my feeling.
I'm sorry.
But I think the moral of the story is that tech just needs to be scary enough to force the government to act.
That's really not the way.
That's not the government I want, but fine, I'll take it in some ways.
Anyway, this is a marvelous book.
I really appreciate it.
And thank you so much for your time.
Of course.
Thank you.
I really enjoyed it.
Today's show was produced by Christian Castro Wessel, Michelle Alloy,
Catherine Millsop, Megan Bernie, and Caitlin Lynch.
Nishot Gerwa is Fox Media's executive producer of podcasts.
Special thanks to Bradley Sylvester, Madeline LaPlante Duby,
and Julia Sharp Levine.
And thanks again to American Unique.
University's Kogod School of Business for hosting this event.
Our engineers are Fernando Aruta and Rick Juan, and our theme music is by TRACADCADEMICS.
If you're already following the show, you win a Nobel Prize.
If not, you're just in it for the money.
Go wherever you listen to podcast, search for On with Carousisher, and hit follow.
Thanks for listening to On with Caras Swisher from Podium Media, New York Magazine,
the Vox Media Podcast Network, and us.
We'll be back on Monday with more.
