Bankless - LIMITLESS: U.S. vs China's Race to Superintelligence | Jeremie & Edouard Harris
Episode Date: June 18, 2025In this episode, Jeremie and Edouard Harris, co-founders of Gladstone AI and national security advisors, join us to break down the real score in the U.S.–China AI race. We unpack what it actually m...eans to “win” in AI: from cutting-edge model development and compute infrastructure to data center vulnerabilities, state-sponsored espionage, and the rise of robotic warfare. The Harris brothers explain why energy is the hidden battleground, how supply chains have become strategic liabilities, and why export controls alone won’t save us. This is not just a geopolitical showdown - it’s a race for superintelligence, and the clock is ticking. ------ 💫 LIMITLESS | SUBSCRIBE & FOLLOW https://limitless.bankless.com/ https://x.com/LimitlessFT ------ BANKLESS SPONSOR TOOLS: 🪙FRAX | SELF SUFFICIENT DeFi https://bankless.cc/Frax 🦄UNISWAP | SWAP ON UNICHAIN https://bankless.cc/unichain 🛞MANTLE | MODULAR LAYER 2 NETWORK https://bankless.cc/Mantle 🌐CELO | BUILD TOGETHER AND PROSPER https://bankless.cc/Celo 🟠 BINANCE | THE WORLDS #1 CRYPTO EXCHANGE https://bankless.cc/binance ------ TIMESTAMPS 0:00 Intro 1:05 AI race: who's ahead? 4:41 Framing AI as an arms race 12:58 Gov't awareness of AI conflict 20:38 AI reports feel like sci-fi 24:44 China vs US: model race 29:11 Shift to inference-time compute 31:19 China’s software vs US hardware 34:28 Open vs closed source politics 38:56 China’s energy dominance 43:32 America’s electric grid lag 47:55 Supply chain vulnerabilities 56:30 US chipmaking onshoring 1:01:08 U.S. lead in chips 1:04:00 DUV vs EUV bottlenecks 1:08:26 Manufacturing gap in robotics 1:11:53 Fear vs optimism in culture 1:17:26 Coordination vs dynamism 1:22:10 Bot-driven opinion warfare 1:25:58 China pushing degrowth narratives? 1:29:05 National security recommendations 1:33:36 Co-op or conflict endgame? 1:37:27 Closing ------ RESOURCES Jeremie Harris https://x.com/jeremiecharris Edouard Harris https://x.com/harris_edouard America’s Superintelligence Project https://superintelligence.gladstone.ai/ ------ Not financial or tax advice. See our investment disclosures here: https://www.bankless.com/disclosures
Transcript
Discussion (0)
Hey everyone, Brian here. You guys are in for a treat today. The episode you're about to hear was pulled from our new Limitless podcast, where I occasionally guest hosts, as I did today, along with David and our new co-host, Josh. We've talked before about the geopolitical race between the U.S. and China for the world's reserve currency status. But there's another race taking place, one that's moving faster, with more urgency, may even be more important. And that's the AI race. The question for today, who's
going to win the AI wars? Is it the U.S.? Or China? This is an incredible episode, two guests
who are experts on this topic. Now, moving forward, episodes like this will be on the Limitless
podcast feed, so you won't see them here. If you haven't already, stop what you're doing,
go subscribe to Limitless on Spotify, Apple, YouTube, wherever you listen. There's a link in the show
notes if you want to do that. Limitless explores a frontier of AI, just as Bankless has explored
the frontier of crypto. We believe these are the two frontiers for wealth generation,
and freedom for this decade.
You've got to level up on both.
Enjoy this episode.
Are we winning or losing the AI race to China right now?
Oh, wow.
Okay.
That'll just take 30 seconds.
Well, it depends.
It depends.
But it depends in interesting ways.
So there are different dimensions of the AI race.
One way you can split it up is supply chain-wise, right?
You look at the whole AI supply chain.
What goes into training a leading AI model where there's talent?
That's one big input.
In that respect, there's a bit of fog of war around who exactly is where, especially on the Chinese side.
But judging by the kinds of engineering advances that go into making your Deepseek R1, your Quinn 3, there are very, very legit people in the Chinese labs right now, Deepseek and Alibaba actually being among the clear leaders in China.
But then separately, there's a question around the hardware that's used, right?
you have the talent to train these models to architect them, but then the actual physical
hardware that you need to do that training or the inference, that's a complicated story.
So the hardware itself, the most advanced chips obviously are export controlled.
China can't get a hold of the Blackwell series of chips right now.
They're stuck on the age 20, all kinds of stuff like that.
But they have all the power that they need.
And so when it comes to power, that's just not a bottleneck for them.
They have all the energy they want.
We don't know how to build nuclear plants in less than 10 years.
China's added an entire America worth of power to their grid and
last decade. So it's just this very, very different set of constraints. And then that gets reflected
even in the way that they build their data centers and their chips and the way that they scale
them up for training run. So overall, I would say it depends on the dimension you look at.
I'm maybe I would put my money on America being first to build truly like AGI level
capabilities or ASI right now. But China would just steal that shit like immediately under
nominal circumstances. So it doesn't matter.
Yeah, so that's the thing about winning.
Under current conditions, winning is kind of not really winning because we can be the first to develop the technology.
But from everything that we've seen and heard and all the folks that we've spoken to who are tracking this space closely, it just gets, I mean, they're already all up in our systems at the moment.
And so there is a massive security push that's necessary for winning to be meaningful.
And that's before you even get to the question of, well, you build an AGI or you build a super intelligence.
how do you control it? And does that, like, what is, you know, what does your catastrophic victory
scenario look like? Right, right, right. I mean, superintelligence aside, because there could be,
like, a third actor in this, the U.S. and China, and then the superintelligence with its own
ambitions, of course. But I'm sticking to the kind of the U.S. and China, we want to get to the
scoreboard and break these out in each of their different categories and dimensions because there's
the labs, you know, the software side of things, there's the hardware, there's the energy, there's
even kind of the culture of the U.S. versus China. And I think there's scoreboards associated with
each of those. But before we get into this in a more granular way, maybe we could set the context
for some of our audience and listeners today. Why is there an AI arms race in the first place?
And is there really an arms race? Because an arms race kind of implies that we're on the cusp of
some sort of maybe like super weapon or super capability. And that's not obvious, I think, to a lot of
people listening. Is there really an arms race? Well, certainly there's an economic race. I think that's
reasonably obvious to everyone, even within the United States. The labs themselves have said this.
We are in a race. You know, we wish everyone else wasn't racing so hard. But obviously, when you're
in that, when you're in that space. That's something, by the way, that Sam Altman once said to us
directly. Like, we were like, hey, so, you know, it seems like you guys don't have the security, you
the safety stuff in place for where things might be going.
And so, like, you know, what's your take?
And he's like, I wish Google wouldn't race it so hard.
I wish I had no credit.
Nice.
Yeah.
Which is true, by the way.
That is not wrong.
Yeah, he's not wrong to wish that.
We'd all be, you know, maybe marginally in a better position if Google wasn't racing
quite so hard.
But, of course, once you have three, four, five Frontier Labs all racing, each individual
one doesn't really matter all that much.
Yeah, so in terms of the question around, is it an arms race?
Well, it's definitely a race.
And so the question is the arms part, right?
So it's ultimately, one, is there a good chance that there is a weapon-like capability on the path or at the end of this race?
And two, is there, are the participants, especially at the national level operating as though that's the case?
And I think in the first instance, there's definitely, you know, there's reason to believe certainly there are concerning capabilities along the path. It's already started popping up. Anthropic has come out and said, we can't guarantee that the systems that we have out deployed today can't help a novice design and deploy a known biological weapon, right? A known biologically. That's already a weaponizable capability. And it's not, you know, it's not that this is something.
special of anthropic, but they, to their credit, have come out and said this explicitly.
And you just imagine kind of extrapolate the cyber capabilities that are coming out, out a few
months or a few years. You know, you imagine like the best, the best hacker at the NSA or the best
zero-day finder as just like a cyber expert, multiply that by a million and run a million
copies of that dude in a big data center at a thousand times human speed. Is that a weapon of mass
destruction, well, it's not super clear that it is, but it's not clear that it isn't.
Yeah, I mean, it's like, you know, we've seen not Petia, we've seen Wanna Cry,
we've seen like just some of the very basic cyber weapons, which by the way, I mean,
often pull from that big leak of like from the NSA's toolkit of kind of a couple of their
cyber weapons, they get mixed with things.
I think the idea of AI systems autonomously discovering zero days is totally on the table.
Like, and the minute that you admit that possibility, you have to think about what does it, what does it look like to live in a world where there are catastrophic cyber attacks like that could be launched like, you know, every other day.
I mean, it may sound extreme, but the attack surface for our critical infrastructure, everything from power grids to, you know, water purification systems, all that stuff, you know, is all out there.
You're dealing when you talk about AI with the technology that fundamentally is native to cyberspace in a way that you're.
humans aren't. They can move around much faster. Through APIs, you can control swarms of bots that
seamlessly SSH into and out of things in ways that humans just can't. And so there's this, people are
often hoping that, well, maybe the cyber defense angle is going to, is going to win through. You know,
this whole thing about maybe the defense will get more help than the offense side. Unfortunately,
the defense side just has to cover so much, right? Like, it's just the space of attack, the attack surface
is so huge. So just from the cyber piece alone, I think,
that's just a huge potential kind of weaponizable application domain. But then you've got things
like biological weapon design. Ed alluded to it. You know, Anthropic just announced that they're
moving up to what they call ASL3 security measures. So these are the measures associated with
not nation state actors, but organized crime and terrorist groups that now go, okay, well, AI is
advanced to the point where this stuff actually meaningfully gives us a capability lift along,
in this case, the biological weapons axis. We think it'll make it easier for us to
to, for example, synthesize sarin, right?
So maybe, you know, you're not going to see like whatever, that Ome Schreakin or whatever,
the sort of Japanese, right, to the failed cult bioweapon attack that failed to deploy
sarin partly because of lack of time, but also partly because it's kind of a genuinely
difficult biological problem.
And maybe with tools like this, those sorts of attacks would be devastating and affected.
If we live in that world, all of a sudden, you know, now you've got bio weapons plus
cyber attacks, by the way, the two kind of most common, commonly cited vectors, there's others
like robotics and stuff that especially China's going to be very, very interested in because of what
their supply chains look like. But fundamentally, you're talking about intelligence, right?
Intelligence is useful for all of the things. And that includes the really bad shit. And that's
part of why under the umbrella of what AI can do, you have a lot of weapon of mass destruction-like
capabilities. If humans can do it, eventually automated intelligence ought to be able to as well.
In the wild west of Defi, stability and innovation are everything,
which is why you should check out Frax Finance.
The protocol revolutionizing stable coins, defy, and Rolex.
The core of Frax Finance is FraxUSD, which is backed by BlackRock's institutional biddle fund.
Frax designed FraxUSD for best in class yields across Defi,
T-bills, and carry trade returns all in one.
Just head to Frax.com, then stake it to earn some of the best yields in Defi.
Want even more?
Bridge your FraxUSD over to the Fraxtil layer two for the same yield plus Fractyl points
and explore fractal's diverse layer 2 ecosystem
with protocols like curve, convex, and more,
all rewarding early adopters.
Frax isn't just a protocol.
It's a digital nation,
powered by the FXS token
and governed by its global community.
Acquire FXS through FRAX.com
or your go-to decks,
stake it and help shape FRAX nation's future.
Ready to join the forefront of Defi,
visit FRAX.com now to start earning
with FRAXUSD and staked FRAXUSD.
And for bankless listeners,
you can use FRAX.com
slash R slash bankless
when bridging to fractal for exclusive fractal perks and boosted rewards.
Uniswap is your gateway to a more efficient defy experience.
With Uniswap swapping and bridging across 13 chains,
is simple, fast, and cost effective,
helping you move value wherever, whenever.
Thanks to deep liquidity on the Uniswap protocol,
you'll enjoy minimal price impact on every trade,
and now Uniswop v4 takes it even further.
Swappers benefit from gas savings on multi-hop swaps and ETH trading pairs,
while liquidity providers can create new pools at 99% lower costs.
The best part you don't have to do anything extra.
Each trade is automatically routed through Uniswap X, V2, V3, and V4, so you get the most
efficient swap without even thinking about it.
Whether you're swapping, on-ramping, off-ramping, or bridging Uniswop's web app and wallet
gives you the tools to unlock DeFi's full potential on Ethereum, base, arbitrum unit chain,
and more.
Use Uniswop's web app and wallet for a more efficient way to use Defi.
Sello, the blockchain engineered for everyday payments has officially returned home to
Ethereum as a blazing fast layer two.
Built on the OP stack and eigenDA,
SELO delivers one second blocks,
sub-sent fees, and fee abstraction
so users can pay gas in USDT, USDC,
USC, or any whitelisted ERC-20 token.
Add native bridging,
Ethereum-level security,
and ultra-green money,
and you have a network purpose-built
for global commerce.
In just five years,
Cello has processed 730 million transactions
for 12 million addresses.
It's launching with 100 partners
and fresh DFI firepower.
That makes Sello the on-chain FX hub
for borderless remittances and real-world spend.
For builders, distribution is baked in.
Programs like Presentee grants, retroactive public goods funding,
Sellocamp, and Proof-Ship,
will put your mini app on Farcaster and Opera MiniPay.
Tokonomics leveled up to the great cello happening cuts inflation from 2% to 1%
aligning the chain with its ambitious Vision 2030,
a trillion-dollar on-chain economy,
where regens, cypherpunks, and D-Gens create prosperity for all.
Follow at Sello on X and start building at cello.org today.
It does seem like an army of supergenuses in a data center is just like
it's obviously going to be weaponized and can be weaponized
in so many different ways.
But even if you take the weaponization, like, away,
and you just talk about the economic power
that it advantages one country over another,
and you could kind of go back through history
and all wars are kind of economic wars.
Why did the Allies win World War II?
I mean, you just look at the, like, production rates
of, like, tanks and weaponry and, you know,
airplanes and aircraft carriers,
and that's really what won the war.
And so ultimately, economic power is power.
and this is kind of a power game, I guess.
And so let me ask you this question.
Do the countries know that they're actually in this AI arms race?
So maybe we know it here.
We're talking about this in Silicon Valley.
But would the U.S. government actually say, yep, we're in an arms race with China for AI?
Would they admit that?
And would China admit this as well?
They have not yet directly admitted it, although.
So the defining feature of the U.S.
government is that it's gigantic.
Like that's the main defining thing about the United States government.
It's got, you know, even if you don't count the military, it's like three million people or some absurd amount, right?
So if you ask, does the government believe a thing?
Really, that's like, it's such a gigantic thing, right?
Like, it just doesn't have necessarily unless like the president comes out and says,
this is the policy of the United States on blah, blah, blah.
it's not even like it's such a big target, right?
So I think what we can say is that there are absolutely pockets of the government
that believe all the things that we believe.
Those pockets are growing.
Those pockets have read all of the AI, AGI, ASI manifestos that you and I and maybe the audience
has at least touched upon, situational awareness, AI 2027,
maybe the maim stuff, maybe our super intelligence, America's super intelligence product report.
And so in those spaces, there is AGI pilled as we are.
Has it taken the entire government by storm?
No.
When that switch flips, I think we're all going to know it.
Yeah, it's also the entire government, right?
So the Bureau, so BIS, right, the Department of Commerce, they basically handle all the export controls.
since like 20, I think 2018 was when the first round of export controls targeting GPU exports to China kicked in.
And like you would have been entitled to look back then at those export controls and go, wait, why are we doing this?
The reasons that are being cited are the weaponization of these basically pieces of gaming hardware?
Like what's going on?
And obviously they weren't quite that.
I mean, you know, the A100, the V100, these were still impressive pieces of the AI hardware in their own right.
But, you know, that was what a lot of people felt.
Now, the ratchet's been turned up on that significantly since then.
But the language explicitly has been and continues to be this is to prevent China from accessing military grade technology.
That's how they're viewing and choosing to view the export of GPUs of high-end A6 to China.
And certainly that's a revealed preference, a revealed preference to call it an arms race without calling it an arms race.
There's also, by the way, one reason you might not hear this talked about, there's a view in some.
quarters that by calling in an arms race, you exacerbate it. Now, I think this is actually
very, very overplayed. If you just look at what the main players are doing, right? So Beijing has
put in, like the Bank of China has invested the equivalent of a quarter billion dollars,
like a trillion yuan into AI infrastructure domestically. This was just after the Stargate
project was announced, which itself was being referred to as the Manhattan Project for AI,
that the U.S. government was launching, even though it's not a government thing, it's a private
thing.
So that's one dimension of it.
People are actually using this language, and it's hard to imagine either country doing that
much differently on the acceleration side.
There's stuff they would do differently on the security side if the government's institutionally
believe this is where we're heading.
And I don't think people are dialed into that yet.
The world looks really different.
The minute you say, let's stop just calling it a Manhattan project and see what it would
look like if we actually believe that was what we were doing. If that was actually what we were doing,
all of a sudden society just looks very different. So it feels like we're getting closer to that
moment. And Ed, you mentioned a switch that might be flipped at some point in time.
Give us an example of what kind of thing might flip the switch to like full out race on AI
and to turn this into something like, you know, the atomic, the nuclear kind of energy projects
of the of the 1940s.
Yeah, so I'm referring a little less directly to a switch that flips us into necessarily.
Now we're in full arms race mode, although potentially that.
And more just around a regime change around who understands and is seen to understand and
believe this stuff.
So what I mean is right now, it's actually been so fascinating to watch this evolution
in government.
previously let's say 18 months ago when you end of 2023 sim all was getting fired that that era right you talk to folks in government and you'd find a few individuals who were a GI built and who were like yeah so like i i see what's happening i believe this stuff but like i i don't feel like i can really come out with it directly because nobody else believes this and it's like you know it's career suicide or whatever as of end of
last year, now you had this stuff happening with entire offices. So you'd talk, like you'd get on a call at,
you know, there's an office in the Department of Energy we spoke to. And I'm not going to name it just
because. But we had to sit down and there's, you know, half a dozen folks on. And they're all like,
yep, we've read situational awareness. Yep, this is coming. Uh-huh. Yep. And it was no,
okay, there's just no barrier to jump over. They just all get it. Cool. And so now you have like
within office this consensus starting to form. And so what we see is kind of these expanding bubbles in
government that are kind of touching each other.
And so when you think about, this is literally like, it's all, it's exactly like this
analogy of how does water boil, right?
It's like these little pockets of like of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, of, eventually,
eventually they merge together into these big things and it starts to boil over.
And so we, we're kind of watching that.
The government's starting to boil a little bit on this issue and, and, and, and, I think, you know,
any number of triggering events could flip us over.
the line could be the president or vice president goes like hey this is fucking crazy and we we're
now like we now believe this like explicitly for real it could be there's some incident like
we're talking about these models that can do biological attacks well at a certain point you're
going to hit a capability level where the first mofo who wants to see the world burn can actually do
that so there's any number of possible trigger points and but but certainly we're watching as
you know, the pressure starts to build internally and tracking that closely.
Yeah, just like we're quite famously in the U.S. obviously governed by like a lot of,
it's a gerotocracy, right?
So there's a lot of baby boomers, a lot of older folks that are just kind of getting familiar.
And I, you know, when I read papers like your super intelligence report or AI 2027,
even for me and like Josh and I, we are frontier tech, right?
Like we've seen so much of this shit.
Like we are engrossed in it.
But even for me, it sounds and feels sci-fi.
It doesn't even sound believable.
So I'm picturing somebody who's kind of in their late 60s, and they pick up some of these reports and they start reading the literature.
And they're like, you're telling me by 2028, we're going to have what?
Like robots creating robots with an artificial general intelligence that we can't control.
Come on.
That's, I mean, that's sci-fi like stuff.
That's fantasy land.
That's not really.
Like, it's got to be really hard for these people to believe.
It is.
And in some ways, the most dangerous.
So age itself is definitely a factor.
There's no question.
But you do see people who are in their like 60s and 70s who just like get it.
And it's often the people who have been in charge of anticipating new technologies in the past.
So they've seen, right, like when the atomic bomb was invented, right?
Like, come on.
The day before it was all these like cute little like maybe you'd have like a dam buster, right?
Like you'd make a thousand pound bomb.
People go, ooh, but then like all of a sudden, Hiroshima goes up in smoke.
Zero to one.
Exactly, right?
So there are some people who have been, and by the way, this sort of thing, you have to
imagine this playing out in the intelligence community, in the national security community,
as new technologies that you and I have never even heard of pop up and then our countermeasures
are developed and contingency plans are invented on the fly over the last many decades.
And so there are people who've been flexing that kind of muscle over a long period.
period of time. But one thing that's on the AI side that's especially, I would say, almost
dangerous or that can close people's minds, there's nothing more dangerous than somebody with
like a master's in AI from 2005. Before the scaling era kind of thing. Yeah, exactly. Or in some cases,
yeah, before neural networks really were a thing. I mean, that's maybe to say the same thing.
But yeah, you'll often run into these people who because just about nobody had any AI background back then, they're viewed as the local gurus in the office when it comes to the AI thing.
And their identities are wrapped up in it.
And they've lived through like one, two, three maybe AI winters.
So they've seen the boom, bus cycles.
And they're just ready to tell you, you know, maybe they got excited just before the first AI winter.
And they had to refactor and they've seen it happen a bunch of times.
So they're sure to default pessimistic.
Ed and I often talk about this in the context of angel investing.
Like, we built early on an ed tech company, and we've never invested in ed tech since
because we can see all the problems with it.
When you're so close to an issue, you're just like, oh, this is such a shit market.
Your users aren't going to like this, blah, blah, blah, blah, blah.
The same sort of thing can happen when you're just a little too close to the technology
but not quite close enough that you're at the frontier labs.
You see all the reasons for pessimism because you've experienced them.
And anyway, that can come across in your outlook.
This is so funny because it's the same story, like you coming from cryptocurrency
is just like the people least likely to understand that Bitcoin could hit a trillion dollars
where the people who are like bankers and finance and economists,
it's never going to happen.
We've already done money.
Like we've fixed it.
It's like already works.
They were the naysayers who were sort of the experts in the room and, you know, got it wrong
largely.
Yeah.
Yeah.
If you're too invested in the way things are, you don't see what's coming sideways
for you. It's the, it's like, it is the first piece of the innovator's dilemma. You just don't see it,
don't believe it, you're comfortable. You've already won. And so why would you admit a picture
of the world where your victory is meaningless? Okay, so I want to take us back to the scoreboard,
because I'm really excited to see kind of how China ranks relative to the United States in a few
different categories. The first being AI models. I think Jeremy was you who said deep, or not deep seek,
it was the Anthropic team that said they can't promise that cloud can't be used as a bioweapon.
I know last week, 03, someone found a zero-day vulnerability in like a Linux kernel using that model.
So they're already so powerful and so applicable to apply damage to other people and other countries.
I wanted to ask you kind of who you think is winning.
We have these two entities.
We have the Chinese side, which is Deep Seek and Quinn and this whole basket of others.
And then we have the United States, which is Open AI and Google and we have Anthropic.
Who do you think is winning that race so far?
in open source, I think, I think they're ahead.
They're ahead and or neck to neck in open source.
Like our open source champion is meta.
And I mean, they've stumbled in the last few months.
So that's just one stumble basically sets you back.
That's how tight it is.
In terms of the closed source stuff, it's a little more complicated by the fact that, yeah,
they're just stealing our stuff all the time.
So we might.
And we probably are ahead in native development because we, we, we,
have more facilities. We just have more data center space, more clusters, higher quality
chips. There's a lot of kind of infrastructure that's been built out for for this race by
these private entities that know what they're doing, at least from the pure, you know,
data center scale side at that level. But, you know, is it a victory if your adversary just
like can yoink the metal out of your hands, like right after you finish the race? Like, I mean,
it's kind of meaningless. There is a.
dimension to this too, and this is with the inference time scaling laws that have come out, right?
That did change things in a very significant way. So if you imagine the history up until,
like up until just pre-01, right? So, you know, six months ago, what you have is essentially
everybody's scaling up training time compute. So let me make a better and better text auto-complete
system is roughly the order of the day. How am I going to do that? I'm going to make a bigger and
bigger cluster. Everybody had more or less kind of maxed the engineering capacity to make use of
whatever chips they had. So Open AI is using their chip fleet like to the max to do pre-training,
right? And so is Baidu and so is Tencent. So is everybody, right? So you're kind of getting this
apples to apples comparison on a fully saturated fleet basis of the U.S. and of China, right?
And now all of a sudden inference time compute comes around. And what happens? Well, you've got everybody
looking over their shoulder going like, okay, I need to find a way to use a million GPUs to do
inference time compute. It's a fundamentally different problem from a data flow standpoint,
from a networking standpoint. All like the bottlenecks that were the bottlenecks for pre-training
compute, all of a sudden aren't. New bottlenecks take their place. It's a new problem.
And so now you have to answer the question, if you're anthropic, if you're Google, if you're
Microsoft, if you're opening AI, how do I make use of a million GPUs for inference time compute?
And the answer is you don't. You actually start with 100 GPUs.
and then 1,000, and then 10,000, and you scale your way up.
But the thing is, China also has 100 GPUs.
They also have 1,000 GPUs.
They also have 10,000 GPUs.
They probably have 100,000.
So until you kind of cross those Oom thresholds and saturate your current pool of inference time compute,
you're not actually getting apples to apples.
And so for this reason, I think it's reasonable to expect China put together legitimate frontier models,
and I mean frontier models this year, until we find.
finally get to the point where we saturate our respective inference time compute piles, ours is bigger,
so we should expect to saturate higher. But this is kind of, I guess, a mental model to have
in your mind when you're thinking about who's ahead. There's going to be an illusion for a time in the
coming months, very likely that China is doing better than in some sense they are or could be.
And when that happens, believe you me, the global times will be there to remind us all that China
did it and to extrapolate from that, that export controls on chips.
are not working because they are desperate to convince us of that. And this gives us that opportunity
that will be false when they say it. It is important that we recognize the falsitude of that statement
and keep to our export control strategy. But that's all anyway, kind of some some future prediction
hand-waging. That's a really good point. For the people who are a little confused,
would you mind explaining the inference time compute? Because it is very important. And I think a lot of
people don't actually know what you're talking about when you say that. So if you could just outline it
for us, just so everyone understands why it's such a big deal. If you could just unfuck the last five minutes
of what you said. Yeah.
Let's explain, like, what is, what makes inference to compute? Why was it such a huge breakthrough?
Yeah. So, okay. So here's an intuition. I'm going to give you a test and you have a hundred hours to both study for and perform the test, right? It's up to you how you split up your time.
The old paradigm of pre-training compute was basically saying, I'm going to spend 99.99.99 hours studying for the test. And then I'll take three seconds to do the test. Well, no surprise.
like studying twice as much in that regime isn't actually going to improve your performance,
your bottlenecked on your ability to think on the test. And so now what the new inference time
compute paradigm is saying is, well, what if we take these models and instead of spending all
our computer training time, let's save some of that compute at inference time on the test itself.
And when you scale those two things together at the same time in a complementary way,
it seems as if the sky may be the limit. We don't yet know, but the scaling curves do
seem to just kind of keep going.
That's the basics of that paradigm.
So we've shifted to that.
Doing that thinking on the test just requires a different compute fleet configuration
data centers that look somehow different.
The chips are wired together differently.
The users experience this with like chat GPT-O3, right?
When they ask a question, it's like before it answers your question, it's kind of thinking
and you can read its thoughts, right?
That's inference time compute at work.
Yeah, exactly right.
So it's like giving you, you know, time to think.
before you answer, right? For certain questions, like, how are you doing today? You don't really need
time to think before you answer. For other questions, like, what's the square root of pie? You know,
if you give an answer right away, it's not going to be a very good answer, but the more you think
about it, the better the answer is. And so that's the idea behind inference time compute. Give the
AIs of that freedom to decide how much they need to think before the answer. I'm curious understand
how you would contrast the approach between U.S. and Chinese labs. They're all kind of using
the same technology, but they weren't always using the same technology. It seems that Deep Sea kind of
like dropped a bomb in the whole AI sector, and they were like, wait a second, we could actually
do this much more efficiently than the United States has been doing. So I think traditionally people
think the U.S. is throwing a lot of money at the problem. We're building this huge data centers.
We have all the GPUs, whereas China's kind of being a little more resourceful on the software
stack. And I'm curious how you see this dynamic playing out of Chinese kind of software efficiency
versus the United States hardware dominance. Well, so this is actually touching on Jare's point,
which is that in the transition to inference time compute,
we are at basically a hairpin turn where we have,
we have these giant fleets of training stuff,
and now we need to flip over to allocating a lot of it to inference stuff.
During that tight turn,
there is an opportunity for a deep seek
that may not have the gigantic fleets of training time
or general compute that the United States have
to basically appear to,
come out ahead or edge out ahead through efficiency
and through the fact that the game is not yet being played
at its maximum level until all those scaling checkpoints
have been hit.
And so, yeah, and the DeepSeek team did incredible
genuine engineering work in finding efficiencies
at the deepest level, like basically the bare metal of the chips.
Like here's like, here's how you, here's how you allocate
the compute across these, and they went in like manually built kernels and all this stuff.
So they absolutely got the maximum possible amount of juice from their gear that they, that they, that they could.
And of course, US companies took as much of that as they wanted and made their own setups more efficient.
But fundamentally, it's a question of like, where is your constraint?
Like, where's your dominant constraint?
And where is it most productive to allocate your your resource?
So for American companies, you are not really as constrained.
At least now we're kind of starting to hit power considerations on the mainland,
on the continental United States.
So that's starting to be a little bit of a limiting factor.
But, you know, still now it's still scalable.
And especially like in the last few months, yeah, you could just like keep ramming more
compute and like keep, keep piling up more stuff.
And the bigger pile, the better it got.
So that was just the way to do it.
We had all the best gear.
We had all the shiniest stuff.
keep doing what works. Whereas for them, because they were constrained on chips and had export controls and, you know, some of the Huawei gear, which is now starting to come online, was just not on the horizon yet. They were still like, well, we just have this standing pool of stuff. And that's our constraint. So the only thing we can do is how do we maximize utilization of that standing pool of stuff? And so that's where the two different approaches came from. It's just like, what are your limitations right now? And where does your end?
engineering effort best spent. It feels like you guys are saying for the AI models part that like the
US is maybe like marginally ahead, but that's not a durable advantage and they're ahead on the
closed source side. Well, let me just ask this this question though, because you know, we always talk
about the US open free society, right? You know, Silicon Valley and embracing Linux and open source.
Is it ironic to anyone else that now it seems like the leading open source AI models actually from
China? Like, why are they doing that? Is that is this just kind of like game theory? Because
the U.S. is leading in closed source, of course they'll pivot to open source. Because that feels like
values that America, quote, quote, should sort of have. Like, we open technology, you know, like democracy,
export it to the world, yet we're the closed source side. What's up with this? Well, so, okay,
there's open source and there's open source. Open source, when you live in a world of civil military
fusion, which is the official policy of the Chinese state. In other words, there is no such thing as a
private entity. All entities answer fundamentally to the state and the Chinese Communist Party,
meaning the Chinese military knocks on your door and says,
I want them servers or I want you to do this thing with them servers,
you do the thing with them servers and you don't ask questions about it.
In that world, open source takes on a distinctly different flavor.
So this was what I'm about to describe is I strongly suspect,
not at all the case with R1, with deep seek R1,
but easily could be the case with R2,
easily could be the case with V4 when it comes out,
any deep seek products from here on out that are open sourced.
When you are looking at an agentic model, you can bake into that agent all kinds of
proclivities and behaviors and tendencies that are advantageous to you.
You can bake in responses to certain stimuli that are out of distribution, like totally
unanticipable, if that's a word, by the end user, where, you know, if you get a certain
kind of query, then it causes you as if you're an agent sitting on somebody's CPU,
causes you to go and like, I don't know, log into their email and forward all the email traffic
to some like address in China. This is a kind of software that didn't exist before. It is intelligent
open source software. So if I can get it running on as many computers as possible and that software
is baked into it is a desire to fundamentally do the bidding of the Chinese Communist Party
or some apparatus, it's a really interesting tool. You may imagine wanting to get people used to
using this tool, in part by deploying totally benign versions of it for a really long time,
getting increasing levels of buy-in.
I'm not saying this is DeepSeek R-1 at all, by the way, for a number of reasons,
not least of which is that Deep Seek simply didn't draw the attention of the Chinese
Communist Party until well after R1 was released.
But this is like this is one thing, right?
It is a national strategic advantage.
The other is, to your point, Ryan, about like, recruitment.
Is this a recruitment play?
It is 100% of recruitment play.
That is the only reason, or, I mean, modulo, like, kind of relatively uninspiring things to do with, like, people building on top of their models.
That's pretty much what meta was doing, too.
It was a recruitment play, which is part of why they bothered gaming, like, the L.M arena.
Apart from meta, I mean, every other company that started out being like, oh, we're open sourcing, then went close source.
That's just like the way it goes.
Okay, silly.
And are you also saying that when we say open source, so traditionally open source, so traditionally open source,
source means. You can view the source code, right? That's great. But these are different systems. This is like open source intelligence, which is different. And so if a future deep seek model is doing like nefarious shit in the background and we have open source to the weights, we won't necessarily be able to tell it's doing this nefarious shit because that's like, I don't know, still obfuscated from us. It's the interpretability type of problem.
Until somebody figures out how to map the structure and the parameter values of a neural network to its behavior in a reliable, robust way, we're flying blind, right?
It's the same thing as, you know, classically, like, GPD4 was launched.
And then like 10 days, or sorry, I should say, I guess 10 months or 12 months later, people realized like, oh, it actually can be helpful in finding one day exploits.
Who knew?
And nobody knew.
Nobody knew for a year because, like, you just have to play with it and find out.
So it's sort of similar.
There's no way, as you say, to go from here's my model to these are the behaviors.
This is what's been baked into it.
Okay, so now that we're training these models, we need lots of GPUs and we need lots of energy.
And this is the next topic that I want to cover is the importance of energy because it feels
like everything kind of comes downstream of that.
And I read this disturbing stat the other week that every 18 months, China adds a United
States worth of power, at least over the next five years they're planning to do so.
And that means that China will be producing about one in every three of the world's electrons
which seems like a lot considering the power demands that these new clusters are going to use.
I know Stargate in Texas is trying to get to 1.2 gigawatts of power.
That is enough to power over a million homes.
So I want to ask you, like, are we actually getting our ass kicked in the energy war?
Or do we have a chance to compete with China when the power demands are so high for building these new clusters?
On the continental United States, I mean, so the, again, it comes down to like where is your constraint, right?
What is your constraint and where is it?
So for us in the continental United States, the constraint is power.
For China, as you said, they're building tons of power.
So their constraint is not power.
Instead, they're a constraint as chips.
And so if they're fundamentally constrained on chips.
And Huawei is, of course, building their own natively developed chips.
And they're doing a good job so that you can see actually that are leaning into their strengths.
So one of the things Huawei is doing is developing chip systems to
compete with Nvidia's Blackwells, not just at the chip level, but at the whole system level
with this idea that, hey, our chips can be crappier than Nvidia's. They don't need to be as
efficient. They don't need to give as many flops per kilowatt as Nvidia's chips because we just
have tons of power. We're not constrained on power. And so they can design against that constraint.
But still, fundamentally, they're going to be constrained on the number of functional dyes that
get pumped out of their foundries for GPUs.
So they literally, that's going to be their main dominant constraint.
For us, power is, yes, is the main constraint.
There are ways around that for us in various ways.
So one of the things we've seen in the last few weeks has been the United States doing deals
with Saudi Arabia and the UAE because those countries have abundant power sources.
And, you know, can you set up deals like that in such a way that the resulting for
facilities are secure and that all the national security relevant considerations are observed and all
that. Like the devil's very much in the details. But at a high level, hey, we need power.
If we're not too fussy about it, yeah, we can, we can, I mean, we can unfuck our regulations.
That would be great. It would be great to deregulate so that we can build power legally in the
United States. And to some extent, we're trying to do that too. But in a pinch, we have allies that have,
that have gigawatts. Yeah. I mean, you know, one third of all electrons come out of China. Well,
two thirds are elsewhere. So, you know, we can, we have friends elsewhere. Is that the way to do
is it? Is it to tap in our friends? I'm trying to figure out where we went wrong. How is how does China
have so much more abundance than we do? And how do we fix this? That is a long time coming,
frankly. It's it's the fact that the explicit policy of the United States for decades. And this is not,
this is not the fault of any one administration. It's just kind of the way that all economic policy,
not all, but a large amount of economic policy has been anchored has been pretty much explicitly.
The United States is going to be the consumer of last resort for the world, and China is going to be
the producer of all the world stuff, and we're just going to pay China our dollars. They're going to
give us their stuff, and they're going to invest our dollars in treasuries, and that's how the
wonderful cycle is going to work. And we're noticing,
now that there are a lot of problems with that strategy,
one of which is handing over your entire industrial base to a likely adversary.
That's a big problem.
You guys mentioned earlier that, yeah, how did World War II get won?
Well, it was like, who could light the most stuff on fire, right?
Who could build the most stuff and light it on fire?
That's how wars are won in the industrial age.
So that's a problem for us.
And, of course, world's most sophisticated chips are manufactured in Taiwan.
within kind of a high risk zone where China can influence that significantly.
I think there's maybe a distinction, at least I'm starting to learn between energy and
electricity specifically, right? So just like energy is kind of like, I guess it could be solar,
it could be natural gas, it could be oil, and the electrical grid specifically, which feels
very much like the AI stack. I was reading a post from the economist Noah Smith. He's been on
the podcast before. He was talking about America basically losing the, what he calls the electrical
age. And the basic, like, narrative is, you know, 19th century, the core, you know, unit of power
was steam, 20th century. It was combustion, right, basically, you know, planes, aircraft carriers,
oil, all of that. 21st century, the AI stack really depends on electricity specifically,
because that's how you get your drones. That's how you get your electric cars. That's how you get your
robots, that's how you get your data centers, that's how you get your super intelligence,
competitive advantage, and ultimately world dominance, like power. And so he talks about three
breakthroughs. I'm sure some listeners are vaguely familiar with, but for the electrical age,
like one is just rare earth metals, right, that are key for movement of the AI and physical space.
The other is chips we've been talking about, so silicon, and that's kind of the compute layer.
And the third is like lithium batteries, which is kind of.
of storage. And then he goes through and he shows the U.S. electricity use as a percentage of
consumption. And the U.S. actually, I'm going to show this on screen. And the U.S. is like behind,
I want to say, behind not only China, but also Europe on percent of electricity usage as a percent
of our power consumption. Let me just share this chart for you guys here. It's like right here, right?
Primary energy. Yeah. Yeah, yeah, yeah. Right. Right. Right.
Right. So, like, okay, so if we are losing on the, it's not just the energy, like, piece of the stack. It's also the electrical grid piece of that. And it seems like we're also maybe losing here. Have you guys studied this at all? Like, what do you think about this?
Yeah. This is actually, because so when you, when you go to building new data center, your, your questions are, well, the first question is, where can I find a spare gigawatt or two of, I'll say power? They mean electricity, right?
and that pulls in a whole bunch of questions around transmission lines and critically
generators and transformers and transformer substations.
So you look at your average transformer, where is it made?
The answer is not in America.
Where in particular is almost impossible to find a transformer that does not have Chinese made
components.
Now, the problem with that is that we know historically that China has used transformers as
backdoors.
We actually just had a recent, there's a recent story out about backdoor.
doors that were put into solar cells.
They're Chinese-made solar cells, sort of similar spirit, right?
Like, you, if you're China, you would be insane not to take some of these measures
knowing the importance of the electrical grid well before AI was a thing.
You know, there are all kinds of critical failures you can induce if you have access
to the right components in the system.
So not only do we have a capacity problem in the sense that there just aren't enough
transformers, these things are on like multi-year back order, right?
So, you know, transformer will set you back.
It depends on the context, but anywhere from like six to 24 months, right?
So, like, you could be waiting two years and an awful lot of builds are just bottlenecked
by their ability to get their hands-on transformers.
And the same is true for generators, right?
So, like, where you're going essentially from natural gas to electricity, that's all kind
of whether it's behind the meter or in front of the meter.
The grid right now is in a pretty sorry state.
And supply chain for the grid has all these beautiful.
access vectors that China in particular enjoys.
Yikes. Okay. So for folks keeping track at home, we talked about AI labs and models and maybe
the U.S. is kind of eeked. We're ahead in that area. Now for energy and electricity, it feels
very much like China's ahead, although maybe we can get our hands on some energy sources
and sort of catch up. Let's go to the next piece here, which is, you've alluded to it,
Ed, earlier, kind of compute in the compute stack with chips, GPUs and supply chains. I think
your super intelligence report calls supply chains America's Achilles heel. Okay. And some context here is
like, do you guys read that book that came out or are you familiar with kind of the book recently?
Patrick, I can't think of his last name. Patrick McGee, he was talking about Apple and China
and just going through the last 20 years of Apple and just documenting how basically Apple,
Apple methodically outsource its entire supply chain to China, how Apple is basically a Chinese company.
It has 150,000 engineers in the U.S., but 3 million of its workforce are actually in China,
the entire assembly process and the know-how, most importantly, the capability and competency
is just in China.
And there's no way to replicate it in America or like anywhere else in the globe, at least
without a decade of work effort here.
Okay, so supply chain, America's Achilles heel, like, what's the story here?
Yeah, so that Apple example is really good and kind of telling.
That's, yeah, I mean, that's kind of the Tim Cook legacy, unfortunately.
And while they're, you know, they're semi-scambling to shift that over to India,
at least to some extent, as you said, these are things that take decades to transition.
These are gigantic, unimaginably huge human systems.
And the way that that ended up happening is, I mean, Tim Cook was a supply chain guy.
He understood the cost of holding inventory.
Inventory famously is basically just like a dead weight on you if you're operating a business.
That's why you do just in time inventory when your stuff just comes in right as it's needed.
The problem is that means you're not keeping any buffer for a rainy day.
And so this is fundamentally like a purely narrowly economic view that goes like what are the dollars and cents, what's on the balance sheet that basically assumes as the underlying bedrock assumption, we have a global system that is rules based and stable that we're operating on top of.
That's where all of this comes from.
This you, you can't, you would not operate this way if your view was, hey, all kinds of crazy stuff could happen.
Like, pirates could hijack my, my ship.
Like, Houthis could, like, blow up my supply routes around whatever, right?
These are things that you only get to.
Like, you have these razor thin margins around everything only when you have this underlying
assumption that the world is stable and safe and will never change.
And this comes back to us outsourcing our supply chains to China.
The truth is holding inventory is expensive.
Manufacturing is a kind of shitty industry if you're in it.
I know a bunch of people who are in manufacturing.
And everyone is all the their mentors are like, well, what's your advice?
Get out of manufacturing.
Hardware is hard.
Hardware is hard.
It's just a shit like business.
and the and and if you're you know if you're one country taking one if you're like you know
Vietnam taking on you know some piece of the supply chain and if if Cambodia was doing some
other thing and if it was Mexico doing a third thing or whatever then that might be okay
because then you know as America you at least aren't too dependent on one provider and you can
kind of it's similar to being an integration point in a in a value chain like you know I'm
I'm let's say I'm you know windows I'm I'm with this one
big integrator and I have a zillion
apps that are serving me. So I actually have all the
power even though there's a lot of individual
apps that I need kind of collectively.
That might be a good structure. The problem
is when you literally
hand over to a single country,
the power to make all
of your physical stuff,
I mean, that gives that
country a heck of a lot of power
over you. And
that is potentially
enough power to challenge.
The very assumption that that system was
built on in the first place. There is a dimension of this that's a bit more of a good news dimension
on the supply chain side that has to do with chips. So, you know, TSMC obviously is that like,
so Taiwan Semiconductor Manufacturing Company, they make all the chips. So when you think about
semiconductors, you're thinking about a whole bunch of people in a giant factory that are tuning dials
and there's like 500 dials. And if you fuck up one of those dials, your whole thing is
useless, right? So 500 dials, go do it, send a bunch of PhDs to do it. You start by making,
very roughly, to abuse terminology slightly, you start by making chips down to a resolution of seven
nanometers, and you work on it diligently for years. You're like, oh my God, we got there. Okay.
Now you move on to the five nanometer resolution, the five nanometer process node,
then the three nanometer process node, then the two nanometer process node. And the entire business
of semiconductors is this like painful, arduous, excruciating stepwise, process node. And the entire business,
process of climbing down that ladder. And that ladder, by the way, started like at microns,
many microns, right? So we've been stepping down. That's what Moore's law is, right, stepping
down the resolution ladder. So, okay, the question is, where are we now today?
Taiwan Semiconductor manufacturing company, the only place in the world that is on track to do
two nanometer process. Now, typically, the two nanometer process, whatever the leading node is,
the most advanced one, that all goes to the iPhone. Historically, that's how that's worked.
So Apple comes in, they go to TSMc, they say, we're buying up all of your shit at the highest resolution.
The reason they do that is that iPhones are small, so they want it small, they want it fast,
that's the idea, right?
That leaves the next node up for AI chips.
That's usually how it works.
So you have Apple de facto subsidizing TSM's latest node development, which is a critical competitive advantage.
That's why TSM has the moat that they do.
Nobody else has a giant partner coming in and saying, hey, we'll spend like hundreds of billions of
or tens of billions of dollars every year to help you just develop that next process and
guarantee you a buyer.
But then the next note up is usually like Nvidia, AMD, and all those folks.
So the question is then like, okay, what can we fab onshore today?
Like, what can America do?
Well, TSMC has just opened up some massive fabs in Arizona, Fab 21, and there are others
coming up online, that are pushing now kind of positioning to be able to do ultimately the
3-9mm process, starting with the 5-9mm process, and they're already seeing surprise.
good yields. So this means, so the 5-90-meter process, and it's variant, the 4-Nameter process,
can be used to make H-100 GPUs, which as of like 20 minutes ago were the cutting-edge ones,
that's rolling over into the black wells. But the bottom line is we actually are doing what
many would have thought impossible just 12 months ago. These yields are serious. Like, this is a
serious process. The Taiwanese government used to have a law that prevented TSM from having their
leading node fabbed off island. And that's now been voided. That's no longer of the case.
So that's a really big change. The other pieces, you're starting to get, so TSM is well ahead
of its Chinese competitor SMIC, which, by the way, was founded by a guy who stole, or a bunch of people
who stole a bunch of IP from TSMC, famous lawsuits in the like early 2000s that are fascinating
about this. But anyway, so what's happening now, though, is as NVIDIA is muscling in on the
market, they're actually able to compete with Apple on the leading node, kind of displacing them,
which means we're going to kind of see an interesting node skip phenomenon happen, where suddenly,
you know, we used to fab at four nanometers. Now it's like, oh, we're skipping three, we're
going straight to two nanometer fabrication. So we'll see that big lift. Meanwhile, the Chinese
fab, so SMIC is sort of stuck at the same, they're already using their leading node for AI and have
been for a while. And so there's going to be this nice little bump and this domestic fab story that's
going to be happening. That's going to be very helpful for supply chain security. But there are other
things that are not as good, including, anyway, like the whole A-speed, yeah, BMC story, which
is maybe in the weeds, but it's actually like pretty pretty freaking concerning independently.
Yeah, well, these are at least encouraging signs that we are taking steps to bring stuff back
on shore. I know I saw Nvidia. The Blackwell chips are being made in Arizona now, I believe it is.
Somewhere on the United States. And I'm wondering, how long does it take for us?
to actually get that chip fabrication working here to that two nanometer scale.
Because I know even though they're assembling the GPUs here in Arizona, a lot of those
wafers are still being produced in Taiwan.
Is there a world in which we can weighing ourselves off of that reliance before we reach
this critical mass of AGI that happens in the next couple of years?
Like, is that actually, is there meaningful progress we can make before we hit this
breakout point?
Yeah, we're definitely making some meaningful progress already, as you've noted.
The challenge, of course, is.
how much of that chain, right?
So you're trying to bring
like all the nodes on shore at once.
So the fabbing is yes,
we're able to do that here increasingly.
I think also additionally we have,
because packaging, the next step,
so after you actually fabricate the dye,
the thing that does the logic
and actually process of the stuff,
you need to package it on with like,
with memory, right?
You need to package it on with other,
with input output.
You need to actually put it on a substructure.
so that it can it's not just like it's not just like a brain and the whips and whips and whirls
it has memory it can remember it can communicate with other things outside of itself and has all
these little sub components and so that packaging capability is also being onshore but there are
a lot of components right so the the the wafor piece i think is i think is one of the challenging
pieces but there is absolutely a serious effort that's being made to bring all of that onshore
and the Taiwanese government is cooperating to a great extent in that effort, which is, I mean, which is very good of them, given the fact that their ownership of that technology is a significant geopolitical advantage that they have.
The time it takes to get to that next process node in Arizona is, as far as I know, still an unknown, right?
Like, they have their 500 dials, and the dials for the Arizona fab are different from the dials for the Taiwan fab.
In fact, making a new fab is this notoriously, like,
legendarily difficult thing to the point where Intel,
when they were actually relevant for chips,
sorry Intel, they had this famous policy called copy exactly.
And when they made a new fab, they would literally copy every detail
down to the color of the paint on the walls in the bathroom
because they did not know what was working in the precious, pristine fab
that thank God was actually pumping stuff out.
So it's sort of similar here.
So it's anyone's guess.
I'm sure TSM has a much better sense,
but it's certainly not as far as I know public at this point.
Imagine if your checking account and defy wallet
finally spoke the same language.
That's Mantle banking,
an all-in-one Fiat and crypto account.
It lets you save, spend, and invest all from one dashboard.
Swipe for coffee, stake ME3 yield,
or even use virtual cards for payments through Apple Pay.
So it feels Web 2 simple, yet stays Web 3 sovereign.
For allocators, meet Mantle Index 4,
the S&P 500 of crypto,
A tokenized institutional grade fund
is seated with $400 million from the Mantle
Treasury and balance across Bitcoin Ether
Soul and yield enhanced stables.
One asset, broad exposure, pure
defy-composability.
The momentum is real.
MEath faults, FBT Bridges,
and a $2.4 billion community treasury
are all powering the next phase of on-chain
finance. Mantle brings real-world
access, yield, and utility to digital
assets. Ready for the next era of
on-chain finance that actually belongs
in 2025? Explore Mantle at
Mantle.XYZ or follow Mantle underscore official. Mantle, bridging Tradify and Defy
so you don't have to. Binance is the world's number one crypto exchange. Over 275 million
users already trust their world-class security. Binance makes starting crypto as simple as it should be,
whether it's learning about crypto on Binance Academy or browsing hundreds of assets and viewing
your newly created portfolio in a clear, easy-to-track dashboard. Binance helps you go at your
own pace. For hardcore traders, Binance Pro opens up industry-leading services for trading professionals
with fully bespoke trading products,
along with a suite of white-gloved services
for VIP and institutional clients.
Need support?
24-7 customer service is on hand whenever you need it,
and with some of the lowest fees and deep-list liquidity in the market,
is no surprise why over 275 million users trust Binance for everything crypto.
Download Binance today and get started in minutes.
Binance is not available in certain countries, including the United States.
Check its terms for more information.
Okay, so while we are losing on the kind of the supply chain
when it comes to manufacture of things like the iPhone, right, because TSM is based in Taiwan,
because some of that know-how is coming to the U.S.
And just when you look at kind of the numbers, it does feel like on this dimension,
the U.S. is ahead with respect to its chip supply.
Like we have access to more chips, better chips than China at this present state and have,
previously, you guys mentioned export controls, which is also helpful towards that.
Just curious, how sustainable, how durable do you think?
that chip advantage actually is right now.
It probably eventually erodes, though not too soon.
I would say like there's a few years, but there's also there are also you always have to
look at the whole system, right?
So it's it's challenging to like look at like individual verticals and be like, you know,
you kind of have to look at what's the whole system?
And the key thing is always what's the dominant constraint on the system?
system at any given time in any given regime. So you think about chips on the Chinese side.
Okay, you know, we might be winning on chips. Let's say, you know, it's 2027, 2028.
We're still winning on chips in that we have more, you know, more efficient chips and higher volumes.
Perhaps they are able to bring, even though we have like that two nanometer process or whatever.
So we have whatever the, we have the Rubens, which are after the blackwells and those are super awesome chips.
So maybe their chips are worse, right?
But maybe they're able to make more of them.
And maybe they have so much power available that they're able to overcome that
constraint of chips.
And perhaps they're also able to smuggle in and onshore meaningful amounts of
our ships and divert that way.
So when you're in this kind of competitive game, it's really about like who's nothing static.
Everyone's trying to find an angle.
Everyone's trying to like, you know, edge in front of each other.
And so they, you know, they might find a strategy that just,
gets around a constraint that we thought was this like, okay, this is the category.
So just all that to say, I think we likely to remain ahead on that front for, you know,
at least two or three years, if I had to guess.
But then, of course, it's all moot because the final circumvention is they're still stealing
all our shit.
So until we have, right, until we have good or adequate security across the board at these
levels for models and in other domains.
I mean, it's all kind of, they can just cheat at the very last step.
They're like very diligently guarding the duffel bags full of money as they're hurled
into the robber's car.
Like, yeah, I mean, that's part of it.
But also, I mean, I think it's also interesting, if you're going to predict the future,
you also have to go down each vertical and think about, you know, okay, well, what actually
might happen here and here because in their interactions.
And in that respect, if you do look at the, you know, you know, you.
you know, the chip story and, you know, how are we going to be positioned?
What determines that?
You know, how are we going to be positioned there in like three, five years?
One of the key inputs here is photolithography machines.
Like there's no escaping that.
This is the thing.
It's funny in this whole supply chain.
There's always like one monopoly at every level of the stat.
So for like, for fabricating the chips, it's TSM.
They just dominate.
But then if you're actually going to make one of these chips, right, you take a piece of glass.
I'm going to very roughly.
sketch this, but you take a piece of glass and then you shine a laser onto that glass to kind of like
shine the pattern of the circuits that you want to print on it. The laser that you use to shine
those circuits is exquisite. Exquisite doesn't even get into, like begin to describe it. Back in the old
days, people used DUV, deep ultraviolet lithography. So this was like, you know, like 170-odd nanometer
light that would shine onto the wafer and you would do, anyway, it's, you know, it's a hundred and
It was a very expensive system with a whole bunch of mirrors and stuff and all that jazz, which is fine.
These things cost like hundreds of millions of dollars.
And that's the frontier of what China can use today.
We have at a Dutch company called ASML, this is the other kind of monopoly now at the photolithography layer, the laser level.
So essentially they have this thing called extreme ultraviolet lithography.
And to think about an extreme ultraviolet lithography machine, just like put this idea in your head.
you have to imagine there is a like kind of metal like molten metal tungsten that's being shot out of a thing.
And these little, so you fire a laser beam, laser pulse that's timed as this tungsten thing is flying along.
It gets zapped by the pre-pulse laser to get flattened out, keeps flying.
It's now flat like a mirror.
Why like a mirror?
That's important because now a CO2 laser is going to hit it, excite the atoms, and fire off basically an x-ray that you're then going to collect through
11 mirrors. And by the way, those mirrors are not lenses. So that's a pain in the ass for optics.
Legendarily a pain in the ass, because usually you use lenses to focus shit in optics.
Just using mirrors this time because at essentially 13 nanometers, which is the insanely
high energy wavelength of light they use, all optics are like super absorbent. So you would never
get anything out of the system. So now you have all these mirrors. By the way, the other
thing that's absorbent is air itself. And so now you're working in a fucking vacuum.
because that's the only thing that won't absorb your 13-nometer light.
So you've got 11 different mirrors organized just so.
You've literally got mirrors with holes in them
so that beams can go through the mirrors on the other end,
and it's a giant pain in the ass.
And now even the frigging that you're imaging is itself a mirror,
the pattern of the circuit that you're imaging is a mirror.
And so that gets, this is like an impossible thing to do, right?
So China is not going to replicate that at home.
It's not going to happen.
But there's a question of how far you can go
with the old generation deep ultraviolet lithography
before you're forced to go EUV.
And that's going to be one of the key, key constraints.
If we can keep them to the DUV,
that probably does mean they only have a couple generations left
because what they're forced to do right now
with their shittier DUV machines
is take the same chip, pass it through a bunch of times,
do this thing called multi-patterning,
which slows down their output, right?
They've got to go through like three, four times
just to get the same level of resolution
that we do with one pass.
Eventually, that shows up in your yields
and your unit economics,
and that becomes untenable.
So the question of when that,
actually starts to kick in, but that's, anyway, sorry, that's, like, my, my, like,
EUV.
It's so crazy because this is an example of just, like, how little we have been thinking
about this for the past, like, three decades or so.
And just, like, the experience of just, like, you get your iPhone and it's in a nice
package, no one thinks about all of the shit that went into, like, making that thing
happen.
And when you dip into the supply chain, you need to.
There's all of these, like, intricate pieces that only one company does with, like, a
handful of specialists and you realize how brittle it really is and how amazing it is that any of this
stuff works in the first place. Let me ask you guys about another dimension that might come into
play. So with China and their ability to just manufacture consumer devices with chips at an
unprecedented scale, it seems like that could come in handy as AI pivots to the physical world
in the world of robots, right? We're already seeing this with drones. But like eventually you're going to
have the application of AI and sort of meat space, right? Physical power, monopoly on violence.
This is what nation states do. So you can imagine robot armies. It's just drones, swarms of drones,
autonomous fleets, all of this kind of thing. It feels like of all of the things we've discussed so
far, perhaps this is where the U.S. is positioned most poorly. And we're not quite in this era yet.
But like, you can imagine the wars of the future are fought with robots, essentially.
where are we going to produce those robots?
Have you guys considered this story here
and how does it look for the U.S. versus China?
Yeah, so, I mean, likely the timescale of that
is kind of beyond the potentially, or could be,
beyond the kind of AGI or software AGI time scale,
but it's absolutely relevant and it's becoming more and more relevant.
So the thing is, like robotics benefits from iteration,
just like any other hardware, any other thing.
and iteration in hardware benefits enormously from being able to go down the street and get a part machined at 3 a.m. for 12 cents.
And the only place where you can reliably do that is in Shenzhen.
And so that means that you have, yeah, like, America was the first to, like, invent humanoid robots that actually kind of worked.
Are we going to be the first to scale them and perfect them and do these iteration loops?
well, show me a place in America where you can get like a fucking servo motor machined at 3 a.m. for 12 cents.
Like that's the thing about having a gigantic industrial base all smushed together in the same geographic location.
It's a huge advantage for all of those things.
And so, yeah, like I personally, we have major concerns about this because like even, even, you know, even the optimists of the components are.
Chinese sourced. And so that impacts iteration velocity. And of course, like Elon and his companies
try hard to like internally source and build as much of their own stuff as they can. But at a certain
point down the supply chain, like, and this is an intentional strategy, you know, of us. As as we mentioned,
we basically handed over our industrial base, but also to their credit strategically, the CCP and the
Chinese state understands the advantage that we were handing to. And we were handing to,
of them and doubled down on it. There was a
made in China 2025 initiative, like
part of the five-year plans that Xi Jinping
enacted, and that has worked. Like,
you look at the Amazon stuff, you get delivered
at home. It's all made in China. They are trying
really hard to make that happen. So it's like, it takes a
pull to reverse that effect. And I think, like,
yes, you'll look at humanoid robots, you'll look at drones,
you'll look at increasingly how these things are going to be,
how wars are going to be fought. This is,
this becomes very, very challenging, yes.
Let's talk about culture and talent as another dimension here.
I saw this chart recently, and I think this is a chart of the different countries,
and it's plotted on the percent that are nervous about the advent of artificial intelligence and excited.
And you could see most kind of the Western culture of Anglosphere exists in this area of like,
between 60 to 70 percent of the population is like not very excited and very,
nervous about AI and its effect on, you know, institutions and, you know, like everything in
society. Whereas in Asia and China, the vast majority of the population is more excited, you know,
70 to 80 percent excited. And like, there's lots of analysis for why this might be and like the
differences between kind of, you know, the decades of relatively, you know, one to two percent GDP growth
versus like what, you know, China and many of the Asian tiger countries have had recently. But
I want to ask a question around a culture, like U.S. culture versus Chinese culture with respect to kind of building, entrepreneurship, dynamism.
I mean, that's something that the U.S. has prided itself on.
And yet we have a public that is now skewing a bit more technophobic, a bit building adverse.
How do you think this stacks up in the war here?
I think the United States is really big, you know, Ted's point about the government.
Once you zoom in on San Francisco, I think the numbers start looking really different.
And to Ed's earlier point about Shenjin, San Francisco is, you know, what you can co-locate is usually what drives outcomes or it's a big factor.
And so to the extent that San Francisco is the city of techno-optimistic AI accelerationist people, which it, you know, disproportionately would be.
I would assume if you, you know, did a poll of this looking at sort of like tech savvy folks in the Bay Area, it would look very different.
So there's a question of like, which America is competing with which China or, you know, which part of America?
is competing with which part of China is sort of like a subpart.
But there is this like broader issue of America having really shit education and just generally like we've historically brought in, right, a lot of the best founders in, in the world.
You know, a lot of famously, you know, you look at the Fortune 500, how many of them are Indian, right?
It's it's pretty, in fact, all the frontier labs pretty much are like indirectly owned or at least have really very deep partnerships with entities that are run by,
South Asians, right? You guys are Canadian too, right? So imported into the U.S., yes?
Yeah. I could say this too because I'm also Canadian living in the U.S., right?
Yeah, yeah, exactly, right? It's, and it's the obvious choice, right? Like, this is the decision
that we had to make is like, where do you build your professional life? And it's like, this is the
source of capital, but also of talent and, and techno optimism. I mean, that is what the U.S. is
relative to Canada, certainly. In the U.S. is, certainly.
Valley. It's not that we're thinking about, oh, well, let's move to like rural Ohio. It was like,
let's like focus on cultivating, you know, the San Francisco ecosystem, you know, we'll go and do
Y Combinator, like, we'll do that stuff. And that's where you see, you know, the kinds of people you
look for. But recruitment is a separate issue, right? Like, where are you going to find the fresh
talent? If broadly the entire country leans a certain way, that is a problem. It's a separate
question as to like what reflects the underlying reality of where this stuff could go. It would be a
but it is possible that reality will end up sort of bearing out the American attitude overall
more than it does the Chinese one.
But would you say, though, talent advantage to the U.S. right now relative to China?
Overall, I would guess a slight talent advantage to the U.S. in certain areas like model architecture,
these are sort of getting less and less separable.
But at the compute level, at the sort of engineering level, you might actually have
a moderate advantage for China, one of the big challenges is you've had a lot of American
researchers move over to China recently. You've also had a lot of collaborations, very in, at least
in my opinion, and Ed, you can disagree if you think, but I think a lot of very naive collaborations
from the earliest days between American institutions and Chinese institutions in, you know,
the classic, let's like get them to liberalize by sharing the goods type of philosophy.
I'm curious about structural differences between our government.
governments, right? So you've got, you know, China, which is sort of, you know, centralized, state-sponsored, national capitalism, something like this. And America, which is sort of traditional U.S. capitalist democracy. Does China have a structural advantage, like maybe a coordination advantage in this world? Or does American dynamism sort of, you know, win the day here? Yeah. So that's a really good question.
dictatorships in our authoritarian countries have often have advantages in velocity,
at least when the situation is not obviously critical to everyone in the democracy,
in the democratic context.
So authoritarian can move fast.
The thing that undoes authoritarian regimes in the long run, of course,
is that eventually the leadership becomes kind of stewing in its own juices in terms of their information.
environment. Nobody wants to tell them no, and they eventually get into a space where the inputs
that they receive are not trustworthy, and they're making decisions based on those inputs. So they end up
moving maybe very fast, but just like in the totally wrong direction. And one example of this is,
kind of many example, is Putin invaded Ukraine when all his equipment was actually just like super
fucked up and not being properly maintained, because none of his guys actually wanted to tell
him how fucked up their situation was. And so they had to wait to find out until
they actually slammed in a reality headfirst.
This is one of the issues with dictatorships.
Now, the risk for us is
dictatorships and authoritarian regimes,
if they're aimed in the right direction,
if they know, if they actually are, you know,
genuinely good at aiming themselves,
can, in short bursts, outcompete democracies
that are not alive to the threat.
that they're facing. And our adversaries are, like, they know history, right? Like, the Russians and the
Chinese know that Pearl Harbor happened and what happened to Japan. They know, like, 9-11 happened
and what happened to that. They, they know not to give America a Pearl Harbor moment, because
historically, you have a bad time if you give America a Pearl Harbor moment. So why would they do that?
why would they do a big over-triggering thing that gets us all aligned and rowing in the same direction?
Instead, so much more effective for them to keep eroding our information environment,
to keep doing things like financing.
I mean, this is actually, this is a known thing.
Many of the groups that protest major infrastructure projects, power plants, things like that.
In fact, the majority of them are through some channel or another financed,
by our adversaries. And this is a really, really thorny issue, right? It gets right at free speech. And they're,
they're aiming right at like our top, top value. We have this open society. We have a society where
it is healthy and it is good for a person to be able to say, hey, like, don't build this nuclear
power plant in my backyard. That makes me uncomfortable. The problem is when that voice gets
amplified unnaturally by adversaries money with the intent of eroding our ability to build
these infrastructure projects domestically. That is actually a huge part of the problem,
that this is happening, that adversaries are intentionally throwing sand in our gears this way.
I mean, incidentally, the way that this works is not that they make up a cause and try to
push that cause because that tends to fail as an information warfare strategy.
It comes off as fake.
It doesn't actually have people rallied.
Instead, they take genuine causes that are small,
and they put money and resources against those causes,
obfuscated, of course, and amplify it.
And it's never like Russia is backing me.
No one would go with that if they knew it.
But instead, it's like, oh, there's, you know,
there's a millionaire who's sympathetic to this small town environmental cause,
who's like really generously giving money and blah, blah, blah.
But standing behind that millionaire is the usual,
aspects. What does the manifestation of that look like that was the type of attack vector? So I guess you're
kind of referring to information warfare. I guess what I'm, yeah, what I'm referring to specifically
there is lawfare. So lawsuits to try to slow down infrastructure projects. But does that also mean,
because scrolling Twitter every day, I see a lot of bots that have very extreme opinions. Is that,
is that someone like China with a malicious attempt that's trying to sway public opinion?
The ones you notice to be bots are the ones you notice to be bots, right? The ones, the bots,
It's the bots that you don't notice as bots that are the ones that are most concerning.
And of course, there are zillions of those and probably by now more of those than there are real humans simply because how do you tell the difference?
You can't.
Like, bots are as good as humans at talking on Twitter.
Yeah, there is like, Josh, your point, I mean, part of this is, I read your point as being like, okay, how do we get a sense for like the scale of this on, you know, in the bot universe?
Yeah, what does it actually look like?
How do I know when they're bots like messing with my head, the way I'm thinking?
You don't is the show.
But the very minimal or an interesting historical footnote is to ask the question, when did we know?
Like, when was the last time where we had access to any kind of ground truth regarding that, right?
And one indication is like, so if you go back to about 2021, so back then the Russian Internet Research Agency, which famously is credited with the interference in the 2016.
presidential election and, you know, hired thousands of contractors.
They worked around the clock, all that jazz.
So the Russian Internet Research Agency would use this person does not exist.com.
So this is a website where every time you refresh it, you get a new face of a new person, right?
Well, this person does not exist.com once used to produce images that could be detected
as kind of being fake images.
And so there are, and I forget what the numbers look like, but there are studies that have been
done looking kind of like the number of.
these sorts of profiles that were revealed.
And this was an active thing back then.
And so, you know, you can imagine there's like infrastructure.
And here you really imagine like software infrastructure.
Like there are beautiful apps, right, with nice gooeyes.
And they're there for the operatives to just like spawn a bunch of agents.
And in that universe, yeah, I mean, like, I don't know.
It's the guy's the limit.
Yeah.
There are ways also of influencing through not bots,
Right. Because one of the things that, so you guys maybe have heard of this phenomenon called audience capture, where, you know, you have a big major figure on a social media platform. And they initially started out, you know, posting interesting and thoughtful and balanced and carefully thought out things. But then over time, as your audience scales and you get, you know, hundreds of thousands, millions of followers, you kind of get drawn to the lowest common denominator psychologically. So it's, and it's not a question of like they're manipulating. It's more like, oh, when I post about,
about this, I get more likes and follows and like reposts and whatever. Okay, cool. And so I just
get kind of trained like Pavlovian, you know, reflex to post more of that stuff. You can imagine
that process now with human-like bots being increasingly weaponized. And so a major figure
on a social media platform, you know, it's not necessarily that like these accounts are being so
overt as to say, oh yeah, like you're not posting enough about how China is awesome. But like,
you know, you post a little something about how, oh, yeah, like, in this, you know, Chinese New Year, it's great to, like, celebrate the achievements of Chinese Americans, which is all great and just legitimately awesome.
But then that just gets a lot more likes than another equivalent post about some other demographic would.
And then you kind of just, like, slowly over months and years, inch your way towards the kinds of views that you're trying to be pulled towards.
Did you guys ever read the books, the three body problems?
Yeah, three body problems?
Great books.
Okay, do you remember, I seem to, it's been a while since I read them,
but do you remember the Trisolarians, right?
This is the alien race that's coming to basically destroy the world.
But the thing is, they're in a star system that's relatively close,
but it still takes them hundreds of years,
basically centuries to make their way all the way to Earth.
But information can travel faster.
And so what they were trying to essentially do to Earth because they were very afraid that Earth would basically level up its technology.
And by the time they met them in battle, Earth would be so sophisticated it could like defeat the Tricelarian fleet.
So the very first thing they did was they started funding all of these degrowth memes basically, right?
And sort of injecting that into Earth culture to throw Earth off its game and like, oh, you don't really need fusion.
Like that technology is just not something you should be investing in.
And like that was how they tried to throw Earth off its game so it couldn't make technological progress.
It seems like game theoretically, that's what you're saying is kind of the game here that China could play versus the U.S.
Yes.
And not just China either.
We have a number of adversaries who would love for us to be totally degrowthed.
Yeah.
And there's like this is almost a sort of funny intersection too because.
You know, like, we certainly think that there's a lot of evidence pointing to the idea that, yeah, you know, Eliezer said it on your show, famously very loudly, for the first time I really heard him say it very loudly in podcast form that we may lose control over AI systems and that may be catastrophically dangerous, right?
Right.
That can be true.
And then it also can be amplified by our adversaries.
Like, this is really complicated shit.
Like, how do you run that calculation when the airwaves are being saturated by?
truth that is useful for the adversary. And you really have to think when you think about that
truth, you have to think about, no, no, no, not truth, but like your truth. The thing you believe
is being weaponized that way. And it's just really challenging. I mean, try to keep your head on
straight, not super obvious in a context where, like, if you think about the history of cyber attacks,
a lot of the cyber attacks that we see play out over years, right? We hear about, you know, like a big
nukeing of like all these Ukrainian servers overnight. And we kind of go like, okay, yeah, that was,
you know, that was a big hit and they must have been doing the research for months. But it's,
it's often years, including years of, and typically it's years of dealing with people, right?
Social engineering attacks. And so, and I forget which one this was with the GitHub.
Basically, they literally like got this person to like take over the Linux GitHub.
Yeah, this was recent, right? Yeah. Yeah.
Okay, there's so many cyber attacks.
But it's hard to keep, okay.
So as we kind of, it sounds like the picture overall is that between the U.S. and China, it's
anyone's game at this point in time.
And part of your call to action is for the U.S. to wake up, to not be so naive in the game
that it's playing.
And I think you have some specific recommendations.
So I guess as we start to close this out, the question to you guys is, where do we go
from here and what are your recommendations to the U.S. government, to frontier AI labs, to just
the audience in general. Yeah, so I would say the security piece going forward is number one.
Because again, all this stuff we've talked about, this is like, this is super important stuff.
It's critical. And you guys have done a great job of organizing it and structuring it to make it understandable
and digestible. The problem is always that they can just like take the last piece and like,
it. And so the whole edifice, until we have that security in place, basically doesn't matter,
because they can just take our stuff. And they can also, they can also then subsequently,
in some form, disable our training runs or our ability to then use the very, the very model
that we developed, if they really think it's down to the wire. So they can, they can stuxnet us,
right? So number one is we need to raise those walls and we need to put those security things in
place. I mean, we are actually, we are working on developing a set of standards for nation-state
resistant data centers and other kind of security aspects for Frontier Labs. So if anyone is
interested in contributing to that, reach out to us. But that is the absolute critical next step
that's needed so that we will actually, you know, have a chance of having a real lead at all.
Yeah. The other ingredient there, too, is like, you can't
the perfect fortress. You know, this is anybody who works in, it doesn't matter the kind of security,
actually. I mean, it's just a truism, which means that you need to think of the game theory behind
the escalation to ASI differently. You're not just making a perfect fortress. There actually has to be
offensive activity. Right now, we simply don't hold Chinese infrastructure at risk in the same way
that they hold ours at risk. And that means that from their standpoint, they can just keep throwing jabs and
hitting us in the jaw, and we're just sitting back and taking it, and there's no consequence.
So the challenge here is in part one of willingness.
You know, historically, there has been a reluctance on the part of the U.S.
government to authorize certain activities directed at China and other adversaries.
For various reasons, fear of escalation is one of the main ones.
The problem is that, like, if in your mind every path goes straight to nuclear war,
then you lose all leverage in what is ultimately a negotiation.
around the use and development of this technology.
I mean, it's not a pretty negotiation because it involves getting punched in the jaw and
throwing punches of the jaw.
But if you take that off the table and you tell yourself the story that like, oh, well, we can't do X because this might, you know,
marginally increase the likelihood of whatever.
The reality is that instability increases when you delay your interdiction later when the stakes are higher.
When you establish a norm of, okay, you guys are going to do, you guys are going to go cut a,
a transatlantic cable, cool, now this is happening.
Like, then it stays at sub-threshold.
Then it stays below the level of escalatory exchanges, whereas if you wait for a country
to invade another, if you wait for, you know, land to be conquered and people to die,
then you're, the response, the only appropriate response is a more escalatory one at that
stage.
So it's sort of like raising a kid.
Like, you know, very delicate, very, very gentle at first, you know, yeah, don't put
don't put that in your mouth, please.
Thank you.
Thank you.
Instead of just like waiting them to go through a lifetime where they're then like a cocaine
addict and they've got all kinds of diseases and everything is a disaster and you're
like, well, I've got to put you in prison.
Like it's the same principle.
These nation state relationships are dynamic and they respond to cause and effect and
they respond to interaction.
And when we're just taking it on the jaw, all we're doing is teaching our adversary to
keep throwing punches.
And in a game of superintelligence, there are many reasons, not all of which we can
necessarily discussed, but that that is a very, very bad idea.
In the super intelligence games, I think everyone is worried about a hot conflict as well.
And of course, if we're competing economically, that's a great space to compete.
If we're competing for talent, for technology, that's a great space to compete.
I think everyone listening probably realizes that any sort of escalatory hot conflict,
basically everybody loses in that game.
And I'm wondering if you see an optimistic,
way that this all plays out. Because, you know, we've got to end these episodes on a little bit
of optimism here. Is there a way that we, I mean, the technology that we're developing right now is
incredible. And as long as we get through superintelligence and we don't create a misaligned AI that
destroys us all, see other podcasts for some material on that, we could usher in a future that
is just incredible for the generations to come. And we can cooperate with our adversaries as well,
compete with them, but also cooperate in ways and build a brighter future for humanity.
I guess my question you guys is, is there a happy ending in your mind?
And, you know, if we get to the other side and it is happy, what will have happened?
Well, one ingredient is we need to enter a trust but verify regime with our adversaries, right?
Like, there's not going to be a stable regime until everybody can verify that we're all
using our AIs in the right way. And that's going to mean hardware level, things like FlexHag.
So this is a whole portfolio of technologies or a research agenda that people are pushing forward.
How do you do flexible, basically like on-chip monitoring kind of governance protocols that are reliable and tamper-proof and all that good stuff?
This is the same thing that happened with nukes, right?
You hit this regime where I'm inspecting you, you're inspecting me, and we don't trust, but we verify it.
That's one ingredient.
Another is AI can, well, number one, can help us accelerate the development of technologies that support exactly that.
another is, as you said, can help us through, you know, the virtual or a version of the game of diplomacy,
figure out, well, where is there alpha for us both to kind of cooperate on this and meet in the middle
and mediate even some of these disagreements? I think there's like, there's huge potential for that.
That's the absolute optimistic outcome one we'd hope for. But we got to, as you say, manage that
transition. Yeah. And just in general, I mean, there's basically three layers of challenges that we
have to overcome. And they're not impossible to overcome, but they are very difficult to overcome.
One is security, right? If we can establish good security and get a good enough lead over adversaries,
we have the margin potentially to address the next challenge, which is control and ensuring that
we can actually control the systems at these levels once they are built. And then the final
challenge, right, is, okay, you know, you've built potentially this incredibly powerful AI system
and have it under control.
Who's at the helm, right?
Who's at the keyboard?
Who's the one giving commands to this crazy,
I think Dan Fagella called it like a sand god,
you know, who's giving commands to this thing?
And this is an area where I think that the United States
has a cultural advantage.
We talked about culture, right?
The cultural advantage of the United States
is we have this, not just constitutionally,
but culturally, this checks and balances mindset
where no one party should gather too much
power to themselves. And so we have this cultural ethic where it's like, how do you establish
controls around the uses of power? And that's something that China really does not have.
It's this very kind of centralized approach. And so I think that we solve for all these challenges.
We are in the best position to create something that all of humanity can derive the benefits from.
Love it. Guys, this has been super informational, very helpful, of course. We could find more
information about all this at gladstone.AI, I believe, and there's a report that we've alluded to a number
of times. America's Super Intelligence Project will include a link in the show notes. Is there anyone else
you want to hear from in our audience? Like you mentioned people who are into data center security.
Like any other parties you really want to hear from? Folks, yeah, folks who are just involved in
frontier lab security, we're certainly interested in hearing from folks like that as we work on
these standards. Also hardware level. So, yeah, if you're thinking about computers,
strategy working on yeah on on the compute game plan at any of these labs or hyperscalers
we're we're always interested in talking to folks like that amazing they're interested in
talking to everybody except for the CCP right uh hopefully no infiltration here guys thank you so
much for joining us today has been a lot of fun thank you much you guys it was fantastic
