The a16z Show - Balaji Srinivasan: How AI Will Change Politics, War, and Money
Episode Date: July 28, 2025a16z General Partners Erik Torenberg and Martin Casado sit down with technologist and investor Balaji Srinivasan to explore how the metaphors we use to describe AI—whether as god, swarm, tool, or or...acle—reveal as much about us as they do about the technology itself.Balaji, best known for his work in crypto and network states, also brings a deep background in machine learning. Together, the trio unpacks the evolution of AI discourse, from monotheistic visions of a singular AGI to polytheistic interpretations shaped by culture and context. They debate the practical and philosophical: the current limits of AI, why prompts function like high-dimensional programs, and what it really takes to “close the loop” in AI reasoning.This is a systems-level conversation on belief, control, infrastructure, and the architectures that might govern future societies. Timecodes:0:00 Introduction: The Polytheistic AGI Framework1:46 Personal Journeys in AI and Crypto3:18 Monotheistic vs. Polytheistic AGI: Competing Paradigms8:20 The Limits of AI: Chaos, Turbulence, and Predictability9:29 Platonic Ideals and Real-World Systems14:10 Decentralized AI and the End of Fast Takeoff14:34 Surprises in AI Progress: Language, Locomotion, and Double Descent25:45 Prompting, Verification, and the Age of the Phrase29:44 AI, Crypto, and the Grounding Problem34:26 Visual vs. Verbal: Where AI Excels and Struggles37:19 The Challenge of Markets, Politics, and Adversarial Systems40:11 Amplified Intelligence: AI as a Force Multiplier43:37 The Polytheistic Counterargument: Convergence and Specialization48:17 AI’s Impact on Jobs: Specialists, Generalists, and the Future of Work57:36 Security, Drones, and Digital Borders1:03:41 AI, Power, and the Balance of Control1:06:33 The Coming Anti-AI Backlash1:09:10 Global Implications: Labor, Politics, and the Future Resources:Find Balaji on X: https://x.com/balajisFind Martin on X: https://x.com/martin_casado Stay Updated: Let us know what you think: https://ratethispodcast.com/a16zFind a16z on Twitter: https://twitter.com/a16zFind a16z on LinkedIn: https://www.linkedin.com/company/a16zSubscribe on your favorite podcast app: https://a16z.simplecast.com/Follow our host: https://x.com/eriktorenbergPlease note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Stay Updated:Find a16z on YouTube: YouTubeFind a16z on XFind a16z on LinkedInListen to the a16z Show on SpotifyListen to the a16z Show on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
Transcript
Discussion (0)
So polytheistic a GAI, I think, is one very useful macro frame.
It means every culture has their own AGI.
And eventually, every culture has their own social network and cryptocurrency and AI.
You know, the AI is sort of like their Oracle is at the center of society.
And they've got their deterministic law with cryptocurrency and the probabilistic guidance with AI.
The social network that binds the whole thing to AI.
So those three technologies are like social technologies that are almost like the reactor core of the network state of a modern internet for society.
The way we talk about AI often reveals more about us than the technology itself.
In this episode, I'm joined by technologist and founder, Bologi Sreenovastin, alongside A16Z general
partner, Martine Casado, to unpack how our language, whether we frame AI as a god, a swarm, or
a tool, shapes our hopes and fears.
Bology, known for his work in crypto and network states, also has deep roots in machine learning.
Today, we explore where AI discourse has gone off course, what today's systems can and can
can't do, and our different cultures might build very different AIs, each reflecting their own
values and constraints.
It's a conversation about belief, control, and the systems we build.
Let's get into it.
As a reminder, the content here is for informational purposes only.
Should not be taken as legal business, tax, or investment advice, or be used to evaluate any
investment or security, and is not directed at any investors or potential investors in any A16Z fund.
Please note that A16Z and its affiliates may also maintain investments in the companies
discussed in this podcast. For more details, including a link to our investments, please see
A16Z.com forward slash disclosures. Martin and I were talking offline about how amazing your
thread was on AI. And, you know, often you're a crypto guy, you're a network state guy, but you're a
technologist. Sure. And you've been thinking about AI for quite some time. So why don't you
trace us through your evolution a bit? Totally. So, you know, actually, Martin and I are roughly
contemporary is at Stanford. I got my PhD
in 05, 06.
I got my in 2007.
Yeah. So we're roughly
We overlap almost completely. Yeah.
Yes, that's right. I'm a little gray down
here, and Martiz's a little gray up over here,
and we're complimentary grays.
We both have that ambiguous kind of
Middle Eastern look. Yes, exactly. That's exactly.
Neither of us are Middle Eastern. That's correct.
That's exactly right. That's right. So we're both
men of a certain age, I think,
as a phrase goes. And the funny
thing is, you know, I taught machine learning and computational statistics and so on the context
of genomics at Stanford for, you know, the mid-2000s and then founded a DNA Sequencer Company.
And really, I would say, like my original career expertise for 10 years, it's all I was doing
was, in a sense, ML full-time. But then I got into crypto right in the early mid-2010s,
just as the deep learning revolution was getting underway with ImageNet and
all that series of papers in the mid-2010s, early 2010s.
So I've suggested my thought process,
I have a foundation in probability and stats
and multivariable calculus and blah, blah, blah.
And so I'm conversing with the space.
The thing I will say, and I'm sure if Martine has thought on this
and I'll look at this specific tweet,
in the 2010s, you know, we were all tracking diffusion models
and language models and so on something that was improving.
But, you know, like style transfer, for example,
the mid-2010s was working by that time, right?
And, you know, GPT2 and so on was interesting.
It could kind of blurt out like a sentence.
But I admit that I never really thought it was going to get past like Markov chain E like stuff, you know?
I was surprised at how much better GPT, like Dali was a hint in early 2022.
But I was surprised at how coherent chat GPT was.
think everybody was, but it was like a huge jump up from what it was before in terms of sort of
being Markov-Cheney. And so I've been kind of observing our last, you know, two years,
being originally very deep in machine learning, then very deep in crypto. But, you know, you can't be
deep in everything. You can't be deep in maybe Elon can't. Okay, aside from Elon, it's pretty hard to be
at the cutting edge of so many different fields at the same time because they're deep fields,
which have a lot going on.
So with respect to AI,
there's like several realizations
I've had for the last few years
in terms of the unarticulated limitations
of the space, right?
Some of these I think I sort of,
I think I came with relatively early
in the history of modern AI
and others I think I've come to more recently.
But let me kind of enumerate them
in no particular order.
Martin, jump in any time.
So the first is that something that motivated,
I think, both LAISR and Altman,
a bunch of folks who built up an AI
was almost,
like the same kind of sentiment that motivated people to build like the Sistine Chapel,
which was sort of like an implicit Abrahamic monotheism, which was like summoning God, right?
Like, you know, communing with God.
But in the Abrahamic God sense, right, of also the vengeful God who had turned you into
paperclips, like turning you into pillars of salt, right?
That was an implicit thing that was behind, right?
Because when they talk about AGI, they talk about AGI as implicitly a unitary thing.
We will get to AGI and then it will go to infinity.
and will be like, you know, raptured, singularity kind of thing, even though that's implicit.
And because I'd been thinking so much about crypto and other kinds of things, I was like,
well, there's a different sort of implicit school of thought, which is polytheistic AGI.
Right.
Do we have, rather than the vengeful god, do we have war of the gods?
Do we have many superhuman intelligences, all from different cultural backgrounds that have
the mores and the values imprinted on them?
And very early on, I had a tweet that said, at a minimum, there's going to be American AI and Chinese AI.
And if we're lucky, there'll be decentralized open source, you know, crypto-style AI.
Because at the time, the American AI was woke, highly woke, because it's 2022.
And I knew that China was going to stop and nothing to copy it.
So I knew we're going to get at least two.
And I thought we might get N if we were lucky enough to get decentralized AI.
And that wasn't obvious at that time because the cost of training models was so high
and OpenAI was so far ahead.
It took a while before other people caught up.
But now it's very clear that we're going to have
lots and lots of high-quality open-source decentralized models.
Like a new one comes out almost every week, you know,
and China's going to work hard on this.
It's a big thing like all the deep seek models.
So polytheistic AGII, I think, is one very useful macroframe,
which takes away some of the sort of AI apocalypse tones, I think,
because I don't think the image
generators or text chatbots are going to cause the, you know, destruction that people had.
People thought they were going to, like, bust out and, you know, do systems programming.
And Martine can speak about that.
Martin and I kind of were talking about that.
There's certain limitations.
It sound more clear, actually, that they're worse at systems programming than there are visuals.
Come back to that.
So, A, polytheistic AGI.
And so what does that mean?
That means every culture has their own AI.
And eventually, every culture has their own social network and cryptocurrency and AI.
which is, you know, the AI is sort of like their Oracle that's at the center of society,
and they've got their deterministic law with cryptocurrency and their probabilistic guidance with AI,
and the social network that binds the whole thing to ours.
Those three technologies are like social technologies that are almost like the reactor core of the network state of a modern internet for society, right?
And it'll be customized for each different kind of group, and certain things will be disallowed and allowed,
like image generation might not be allowed in subcultures or NSFW or whatever, all that kind of stuff would be tweaked.
So, okay, that's one concept.
The second concept, you know, Eliasur Yukowski, who, by the way, you know, even if I disagreed a lot of his stuff, did do a lot to promote AI and people getting into it and so and so forth.
So even if I disagree with bombing the data centers and various other kinds of things, I give him significant partial credit for getting people motivated to look into the space.
He was definitely into it in that sense.
So like directionally there was something, you know, is try to see the right sentence.
But a second big concept that I think I really discrew the Eliasor on that I think is being borne out is the idea of that.
that AI could just cogitate for millions of years
and figure things out
and it could out maneuver you all the time.
And we know that's not true
because turbulence, chaos,
cryptographic equations are not like that, right?
You can come up with turbulent systems, chaotic systems,
where you simply, with finite precision arithmetic,
cannot forecast out indefinitely.
In fact, you get fracturing and breaking
and cryptographic hashes are set up in such a way as well
to be hypersensitive to initial conditions where a small change of one character can get a totally
different MD5 sum or something like that. So those were situations. And if you wanted to, you come
with a thought experiment where you inserted turbulence or chaos into your decision process,
sort of like you shake a turbulent clock or something like that before throwing a pitch. And the AI
wouldn't be able to predict your actions, right? And that's like just a simple experiment in real life.
Just, you know, the flow of a fluid is turbulent, you know. So that actually put bounds on what AI
can predict,
right?
Quantitative,
physical and mathematical bounds
on what an AI can predict, right?
Can I just add just a little bit of color here?
Sure.
I think this is great.
I think we need to call out.
So the way that you describe AI
as like gods and monotheistic
and polyshaistic,
it's great at describing how human beings
view AI, right?
Sure.
But in reality,
we're talking about software running on computers
that are bound by those limitations,
So I don't view them as gods personally.
I got my PC in system.
So I view them as like system software.
And I actually think the original sin in all of this AI,
anthropomorphic fallacy started with Bostrom.
It was one of these kind of thought experiments where, you know,
when Nick Bostrom wrote superintelligence was what, 2014?
And he was talking about this platonic ideal of AI.
And this platonic ideal of AI just happened to be able.
able to recursively self-improve and just happened to like have these kind of like super
physical things that no AI today has. But it happened that the conversation around AI started then
and then it just coincidentally we had these LLM show up four years later. And so somehow our thought
process on these two things dovetailed, right? And so people would take all of these kind of mental
ruminations, these thought experiments, and they would apply it to actual systems.
And I think the problem with doing that, the problem with taking some platonic idea,
whether it's Bostroms or the Abrahamic view of God, or any kind of religious view,
is that it is very blinkered to the limitations.
And you've pointed out a great limitation.
We've been doing computer simulation forever.
We totally know the limits of simulating physical phenomenon, particularly chaotic systems.
We have actually very hard bounds on these.
By the way, it's not just like, you know, the limits on the size of like a computer word or an integer or something like that.
They're actually like very strong, you know, limits on time and the amount of compute necessary, et cetera, right?
And so we know these.
And so you can talk about these in two ways.
I think for this conversation, we should do this.
Like, Bollagia, you're so good at talking about, like, what is this platonic ideal and how should we have a mental kind of model for this?
For like the non-computer specialist.
And what I would love to do as we go to this conversation is talking about, like, actually, these are still bound by computer systems.
we know the limitations of computer systems
and so let's see how those bound it
and you just beautifully did both of those things in the same one
I just want to make sure that we tease apart both of those things
as we have. Totally, totally.
I feel I can kind of speak both languages here
where I understand where those guys are coming from
because I kind of am like also a tech radical,
you know what I mean? Right?
But I'm also a tech pragmatist.
So I think I straddle that boundary.
The danger is that we don't say that this is a platonic ideal.
People will map it to existing systems incorrectly.
Totally, totally.
That's exactly what happened in 2020, 2021,
which is they took this thought experiment that started with Bostrom.
And it was a thought experiment.
If you go back to the original book, you're like,
listen, this has nothing to do with real systems.
And they applied it to a real system.
And I think that was kind of the original set.
I know, I know.
Well, but let me poke on that a little bit and then also defend your point.
The Turing test was a thought experiment.
That was a platonic ideal.
No reference to neural networks, no reference to implementation details.
And yet, it served as something that went from a thought,
experiment to an applied thing with, you know, the Levchen-Ga-Spec test, the CAPTCHA was like
V-Zero of that you can argue and became commercially important. And now, obviously, AI has blown
past a Turing test. It can, you know, be people in this. And then, you know, the Chinese room,
John Searle's thing, right, about machine translation. Another thing that was like a platonic ideal.
And there's other things that are like that, like six degrees of separation, which social
networks actually made real, right? So I'm not necessarily against.
platonic ideals.
Thought experiments are very, very important.
I just think that we need to be very clear when we're having a conversation not to
conflate them with the actual systems.
And I think that's the thing that we've kind of fallen into in this conference.
Not you and I.
I just think the broader discourse outside of us has fallen into it.
That's right.
So now your point, which is a very good one, is these are real systems and they actually
have real limitations.
I think one of the more interesting things for me over the last few months and years has
being defining exactly where those limitations are,
because I think where they landed was kind of counterintuitive, right?
100%.
Let me give some of them that I think about it.
One of them is that you have this decentralized AI rather than AGI.
That alone, I think, kind of nukes a bunch of the concepts of we'll get to AGI and just win,
because it's kind of clear that there's just like a rapid onrush of new models,
and it's like more of a continuous kind of thing.
the fast takeoff scenario didn't happen, right?
On their hand, can an AI write a sonnet?
It can do it better than most humans.
Can it write a screenplay?
It can do that, again, better than most humans.
There's a lot of things that we thought is maybe harder.
We thought maybe like locomotion or something
would be easier to solve than what we think of as higher cognitive functions,
but it's actually the locomotion that's still harder in some ways, right?
I think that one now in retrospect is easy to explain via economic equilibrium.
We just didn't have a right model.
Well, so, for example, when you're competing with a human brain on 3D navigation in space,
you're competing with whatever, the 4 million-year-old mammalian brain
and a body that's been running away from predators and picking berries for 4 million years.
It's incredibly highly evolved.
When you're competing with a prefrontal cortex, which is like the language learning and creativity,
How old is it? 250,000 years?
And so if you take this question from an economic equilibrium standpoint, you're saying,
well, listen, do you want to compete with the most evolved system
that's solving the much more difficult problem, which is much higher dimensionality,
has to deal with like chaotic nonlinear systems like you said,
or do you want to deal with the very new evolution that deals with kind of a much denser space
that actually does a pretty good job with linear interpolation,
you're one of the problems that actually works very well
with linear interpolation, et cetera.
And so I think you're totally right.
It was not obvious.
I mean, listen, AI has all been solving
what we thought was the easier problem.
But our fallacy is easier for humans
because we're really good at it
because we've been doing it for really time.
And it turns out the harder problems
are just harder for us
because we've only been doing them more recently.
So this is a great case of where
our intuition on the problems
to solve with the wrong ones
because of our own kind of anthropomorphic
fallacy, right? Our own notions of what problems are easy and hard.
Yeah, I mean, okay, true. I would say one of the surprises I had, that's why it's interesting
when you said economics, one of the surprises I had with GPT 3 and chat GPT was how far you
could get with language. Yeah. Like before the Chad GPT moment, it wasn't obvious to me. And then
after you're like, oh, okay, language is sophisticated enough to encode almost any concept
about the world, right?
Or rather...
Well, if I put you in a very dark room...
Yeah.
And that's an arbitrary construction
and I describe how you navigate
and pick something up,
I think you'd have a very tough time doing it.
No, no, no, I know.
What I'm saying, though, is basically
if you generalize language
to be streams of symbols,
right?
You could send telemetry to something...
Like, basically,
I think I was surprised by
how many concepts
were encoded in language,
that could be learned,
even to the point of like
rough world models
of like, you know,
the map of the earth
or the proximity of things,
you can back out
those kinds of things.
The distinction is,
is it could have been the human being,
the human mind
that looked at the world,
did the reasoning,
and created the world model,
and that is cached in language.
Yeah, that's what I'm saying.
Okay, great.
Yeah, yeah.
But going from the world to the world model
was the human and then everything else,
and then the language,
okay, great.
I agree.
That's right.
But it was a little surprising to me,
that you could get that far with language models,
as opposed to like spatial reasoning,
as opposed to that Predict Next token
would get as far as it did.
That was surprising to me that that was the angle.
The reason is you and I both did so much stuff
on Markov chains and conditional random fields
and all that kind of stuff.
And of course, it transfers to different architecture,
but I just wouldn't have believed that that method taken to...
I mean, another thing I think was very countertitive
for me in the late 2010s was double descent.
because as a classical machine learning guy
that's just very counterintuitive
that you could go past over training
back into like, you know,
good regime.
So I want to actually talk about
one thing you did say,
which is self-replication, right?
I don't think of that as a forever constraint on AI.
I think of that as a today constraint.
And the reason I think of that as a today constraint
is they're not embodied,
so they're not scripting robots
because they're not scripting robots.
They can't build data centers and mines
and replicate themselves.
and so and so forth, right?
And, you know, the whole concept of consciousness
initially was that consciousness evolved
so that, like, you know,
you're running away from like a bore or something like that,
and you have a model of yourself,
and then there's, like, a branch ahead.
And if you have a model of yourself,
you know whether you'll fit under that branch or not.
Whereas if you just had a generic model of, like,
the more self-consciousness you have,
you can sort of simulate your run under that branch,
whether you're going to die or survive.
right? And so that's like one theory on why consciousness arose to help your survival
replication that helped with goal setting.
Yeah, you stand outside of yourself to be able to see the experiment, yeah.
That's right. So right now, AI does not really have goal setting. It doesn't have reproduction.
It doesn't have embodiment. And it can't act independently of humans. This is one of the big
things I think that people were really scared about in late 2022 and they've calmed down on this,
that you and I both poked on Martine, I think, was, is this thing going to jump?
out of the box and, you know, code itself.
Now we laugh at that.
But the reason that I think that hasn't happened is AI can't prompt itself yet.
And prompting, I argue, is actually a much harder thing than people realize because we talk
about my analogy of like the spaceship.
Talk about it.
There's something worth going through.
Okay.
So let's say you have a really fast spaceship, like close to speed of light or something.
You still have to point at the phi and psi coordinate on the surface of.
of a sphere, you know, in coordinate space as to where you're going to point that ship.
And if you're going to take it on a journey, then you've got waypoints like, here's this heading and
here's that heading and so on and so forth, like a series of fi-ci pairs on the surface of sphere.
And that's only two floating point variables, you know, right?
By contrast, if you take, I mean, how high dimensional is the vector that you're giving
as input when you talk about a prompt, right?
If you just take UTF8 code points, I mean, or just even ASCII, right?
and you have like a few words
that's much higher dimensional
than just a like a vector
of two floating point variables, right?
So you can get to a very high level
of dimensionality in terms of direction vector
you're pointing this AI spaceship in, right?
And so a prompt is a very high dimensional
direction vector,
even if you account for the fact that many potential prompts
of just strings of random characters
wouldn't be interesting,
it's still a very, very high dimensional vector.
So it's like you've got a fast spaceship,
but you still have to point it in a direction to go somewhere.
I think it's a good analogy, right?
Well, I think there's one more level of complexity you have to add to your analogy,
which talks about how difficult it is to make these things kind of,
let's call it autonomous, which is closing the control loop.
Yes.
Let me try and build on your analogy.
That's a very fine part.
Go ahead. Yes, go ahead.
So it turns out that the directions that you point in, it has to understand, right?
That has to be in distribution.
So you can't point into a direction.
a direction it doesn't understand because it does the worst thing if you point in a direction
it doesn't understand. It just crashes right into that wall or whatever. It just tries to do it.
No, it does a random direction. It's the worst thing ever, right? And so the problem is if it's
producing a direction that has to go into itself, it doesn't know what it knows and it doesn't know
what it doesn't know. Does that make sense? Yes, that's right. In fact, it's optimized to fake it.
Yes. And so if you could tell it, if you could say, hey, listen,
produce a bunch of directions by feeding the last direction in,
you have no idea of a direction it spits out
is going to be in distribution when it comes back in.
And that's what closing the control loop means,
and it's a very tough problem.
I think this is such an important point for us to go into
because in theory, you can close a control loop on these things.
But as scientists, we want bounds on what that means, right?
Like, for example, clearly you want to gather new information
to update your model.
then we want bounds on how much information you need to gather.
It turns out that model was trained on everything humans have ever gathered.
So is like the incremental experiment going to update that?
Maybe information theoretically says probably not.
We don't even have bounds on these things.
Now, you said previously, well, when it comes to a chaotic system,
we know that computers, you know,
it takes a long time for them to compute a nonlinear system.
Actually, you know, I just want to pause you there.
You just gave me an idea for a great prompt,
which is what?
areas do you feel your knowledge is the most thin on? This is the key. Right? That's a great prompt.
Yes, does a model know to what extent is in distribution or is out of distribution?
Yeah, I'm going to try that one on. Actually, by the way, this is, you know, but this is the key.
This is the key. Self-reflection is the key because if it produces an output that's out of distribution,
then of course you have error. And then you're not there to kind of nudge it back.
Yeah. So it's like real-time events, obscure or niche.
academic fields and specialized subfields behind paywalls, local and regional information,
human emotion intent or experience, private or proprietary systems.
Actually, pretty interesting quick off-the-cuff response here, right?
You should ask it if it can always produce a response to which it has a lot of data.
Always produce a response.
What do you mean by that?
So the question is, is if you're closing the control loop, it's going to spit something out
that you're going to feed back in, right?
Yeah.
that's the whole point.
So the question is,
will it always spit stuff out
that if you feed it back in
won't give you nonsense?
Oh, I see.
Yeah, I mean,
well, people have actually tried
the experiment of take the image
and just exactly replay the previous image
and then it like morphs into something totally different.
So actually,
I want to do like maybe 10 quick hits off of that
initial post
because you reminded me of something just down,
which is another kind of angle I have on AI
is prompts or tiny programs,
which is more common today,
but I think at least I check you like
it went viral a while ago,
but there are programs in a hidden API
because normally you have an API
that is fully documented
but very error intolerant.
Prompting is the opposite.
It's completely undocumented,
but it's highly error tolerant.
It will usually do what you mean,
but the better your vocabulary,
the better you can prompt it.
So now art history is an applied subject, right?
Like knowing a vocabulary of like Cézon versus Picasso
so and so forth, you can actually pull up the style that you want on demand.
So the broader your vocabulary, the broader your subject knowledge, the more you can
get out of it.
We're in the age of the phrase, which is the prompt, the 140 character tweet, and the 12
words for your crypto password, right?
These phrases of power in AI, in social media and in crypto, just unlock everything.
So the better your vocabulary, the more you can do, right?
So I think of prompts as tiny programs.
And actually, one of the things that I've gotten into the habit of doing is writing the
It's total opposite of search.
You know, with search, you learn to type things in keyword ease,
and you sort of figure out the word that has the most spesfifty TFIDF, you know, on the page or whatever.
I will write sometimes these long memos to an AI.
And then continuing, maybe you don't love this analogy, but I think it's funny.
Continuing the polytheistic analogy, I'll give them to Broma, Vishnu, and Shiva.
Okay.
So I'll give them to Chat, ChiBT, and Claude, and now Grock and what have you.
right, and I'll consult all the gods,
and then I'll make my decision on that basis, right?
And then sometimes have them argue with each other, right?
And why do I say kind of half-jokingly gods?
Because, like, the Hindu kind of frame on that
is not like the, you know, fearing God thing.
It's not the same kind of thing.
But in a sense, it is a superhuman intelligence
that knows everything about your culture.
And if you ask it the right question,
it can tell you something that you didn't know.
but in like the Hindu tradition
they're not infallible
right like that is to say
it's not the same as the all knowing all seeing
it's more like super humans
more like superheroes people will argue
with me about that but I think that's more
sure I agree yeah I think that's great
it's like actually the Norse tradition
is similar to the Hindu tradition
in some ways right where the gods were not
infallible but they were superhuman
this is a great and it's a useful framing
just remember that when it comes to computer systems
we can put formal bounds on them
we can do this information theoretically
we can do this computationally
and like that's going to
And once that happens, we will understand these systems fully.
And it'll be very hard to think of them as gods at that point.
Well, that's right.
I mean, that's the thing is actually what's interesting is that the interpretability work
that Anthropic and others have done and the work on like grocking or would have you, right?
That's actually really good stuff because you can pick apart neurons.
You can find the Golden Gate neuron if you saw that kind of thing, right?
You can dial that up, dial that down.
You can start actually taking apart these AI brains in a way that hasn't happened before.
A few other kinds of things.
things. So the thread that
that thread actually summarized
several of my research. I should probably put this into a post
so it's like kind of there for the record.
So I'm just going to do a bunch of these
that maybe get your thoughts. So
first concept, in no particular order,
AI doesn't do it end to end. It does it middle to middle.
So the business spend, so basically
you have to still prompt it and then you have to verify
it. And people talk about prompting, but they talk
less about verifying. And Carpathie
and I had this good conversation a few
weeks ago, where basically AI is going to create massive numbers of jobs in proctoring and
verification because it's so good at faking things. So one of my other kind of concepts is
AI makes everything fake and crypto makes it real again. Because AI is a probabilistic technology
and crypt is a deterministic technology. And so like crypto is in some sense what AI can't fake.
It's like the hard cryptographic equations. It can't fake a Bitcoin private key. It can't fake
even an on-chain
NFT, that's what AI cannot fake.
And so that's, you know, like the hard
barriers, right?
I mean, I generally agree.
I mean, I don't think crypto
solved the grounding problem, right?
I mean, it's a mechanism you could use,
but it's a mechanism.
Growning in reality?
Yeah, yeah, yeah.
Oh, okay.
The actual physical grounding problem.
But the data ingest problem, yeah.
So I disagree with you on that, and here's why.
Or let me give you a counter argument, at least.
Right now, just give a concrete example.
Let's say you ask perplexity
to summarize the FTX hack in 2022.
When it would do so, among the citations that would give you
would be links to a Block Explorer, right,
that would actually have on-chain data
that you can cryptographly verify
that this transfer of these funds happen at this time,
and if you want to go even further,
you can actually pull out the digital signatures
and the hashes and the timestamps from the Block Explorer, right?
Sure, yeah.
Now, here's my argument.
My argument is that works for financial data
but what's happening now with Farkaster and other kinds of things
is with increase in block space,
you could put more and more kinds of data on chain
and we're going to have to because you're going to need crypto instruments
and you're going to need cryptographly hash posts and crypto IDs
to know that it was posted by a human or to know the data wasn't tampered with.
So more and more kinds of data are going to go on chain.
And then that will eventually mean that in AI citations
are to on-chain data,
which is both financial data and social data.
And so then at least it will map back in terms of grounding
to an on-chain cryptographically-provable assertion of some kind.
And you might say, well, at least that'll be an assertion at the metadata level.
Like we can prove that this digital signature made this assertion at this timestamp
with this probability.
Sure.
I'm talking about real world grounding.
Like I say something.
I am a human being, you know, you have no idea of what I said is,
true or not true. You know, if there's a geographic place where there's a picture of the geographic
place taken from a 1970s photo, was that doctored or not? I'd be like the actual physical world
grounding just because you can't encode, you know, digital data yet at this point for the
physical world. Now, it's a great mechanism to do that once we can solve the ingest problem,
but this just... So let me talk about something which is happening now that I've been kind of
funding on the side. It's not a full solution, but it's, I think, a partial solution, which is,
So crypto instruments,
the idea would be that when you capture
like a frame of data, right?
For example, sequencing machines,
like DNA sequencing,
when the data is coming off the machine,
it's like TIF files that are actually image data
that gets processed to A, Cs, G's, and T's.
And many other kinds of instruments
basically have a stream of data
coming off the machine as you're capturing it.
Cameras are like that, right?
Okay.
So you could, and there are things that do this already,
take a hash of that
and post it on chain at that time, right?
And what that would at least say is that that frame of data existed at that time.
And so if you had something that was like a scientific experiment, right,
you know, like a pre-registered double-blind trial or something like that,
you could have not just a crypto instrument,
you could also have other people with proof of humans there
who have a sort of attestation ceremony.
And now you have a number of different kinds of on-chain data
that start to get harder to fake in a coordinated way,
not impossible.
Totally.
I agree with all of it.
As soon as you get it into the system,
then crypto is a great mechanism
for ensuring kind of end-to-end guarantees.
It's just the data ingest problem is a long-standing problem
in computer science.
And over time, everything you're saying is going to be more and more true
because over time we're going to be more and more incentive
to make sure the stuff going into the system is true.
And so I just totally agree.
It's just, listen, I'm an old-school networking guy.
Like, for us, there's like the Internet,
and there's the stuff that goes in the internet,
and then you just kind of use different mechanisms for both.
Totally.
That's worth calling out.
That's all.
That's right.
Okay, great.
So next kind of concept maybe to discuss.
And I think this is a useful division.
This was a relatively recent point that I made to myself that thought was useful.
AI is good for the visual and less good for the verbal.
What do I mean by that?
So when it's generating images, when sharing video,
when it's generating user interfaces like V-Zero or Replitts user interfaces,
the great thing about them is you can instantly see them
and with the GPUs that we have in hardware,
you can verify cheaply whether they're good enough, right?
Because you can just instantly get the gestalt of it, right?
Whereas when it's back-end code, when it's legalese,
when it's like, you know, mathematical equations,
you have to slow down and use system two thinking, not system one, right?
And it's not just your gestalt impression.
You have to actually go line by line and check whether it's right.
And that is actually the expensive step, the verifying, right over there.
So I think that's a non-obvious thing where the more front end and video and visual it is what you're doing, the easier to say it.
And now the interesting concept is how much of that, go ahead, you're going to say.
I'll just add one more thing, which is like for me, again, like I spend most of my time in like software and engineering, the big distinction is stateless versus stateful.
Right.
So if you're generating code that it's going to have semantics that evolve while you're running it,
it's just impossible to spot check.
Like some things are computation and irreducible.
You actually have to run the computation to the answers.
Like the image is the perfect example.
It's visual and is basically stateless.
Like all of the state is there.
There is no kind of runtime semantic.
Totally agree.
That's right.
And whereas even a relatively small snippet of backend code
could have a fairly complex finite state machine
essentially underlying it or even infinitesia machine.
Yeah.
It could be very, that's right.
And so simulating the time dynamics is that,
you have to use something different,
maybe formal verification,
if it's algebra,
you know,
yeah.
Or you'd actually have to run it
if it's computation irreducible.
Like there's no way to statically do it.
And so it does reduce to almost like the computation verification problem,
which is this longstanding problem in computer science forever.
Right.
Now,
formal verification,
at least for a subset of programs,
has become commercially viable for smart contracts
because they're so high value and they're so small
that they actually,
it's worth doing that on, right?
Totally.
And yeah,
it's not going to work for the general case,
but you can do a constrained case.
But okay, so that was one major division,
visual versus verbal.
Another, when you're getting to like stateful and so on,
is the limits of AI are the things I'm interested in
where you draw like a fine distinction on what I can do,
are very crisp.
And what I think AI is particularly bad at
that people are trying to use it for
that they're going to fail on, in my view,
is when they try to use it for markets or politics,
and let me explain why I say that.
For systems that are time invariant,
you know, like,
the mapping of an image to the label cat or the rules of a game like chess or checkers or even
go or something where there's like a static rule set or static mapping, right?
Then you can do the train test paradigm and train a model and so it's over.
However, when you have something which is time varying, especially rule varying and adversarial
like markets are or like politics are,
then the same trade will eventually
quickly start resulting in a loss.
And by the way, the other guys are also using an AI on you, right?
And so it's decentralized AI again, right?
And so what that does actually argues
that the CEO or the creator
who is constantly sensing the market
or sensing the political wins
and has a thesis on it,
based on human nature or other things or what have you,
actually is the censor that then
prompts the AI. And that's a job that is hard for the AI to do at a really deep level,
because it's time-varying, rule-varying adversarial demands. And it goes back to what you said
in the very beginning, which is if you look at these type of equilibrium, they're complex
differential equations, which are non-linear. Yeah. So in order to predict what's happening,
we'd have to like do this non-linear extrapolation, which we know that these things are not very good at.
What's interesting is I wasn't even thinking of the stock market as complex different, but you're right.
But it's a chaotic system of time.
I mean, Mandel wrote this great book on the fact that these things are super chaotic.
Yeah, yeah, you're absolutely right that actually it would be a useful thing to show just with a toy example, a chaotic system that is time-faring or another one's adversarial dynamic.
Now, the thing about that, though, is to argue against my point, they've got an AIs that are actually pretty good at Starcraft, right?
Which it starts to stretch the boundaries of what I was saying, because it's definitely adversarial, right?
and it's like more time varying than chess, you know.
You can argue it's not rule varying, but it's time varying.
Okay, let me go to another point here, right?
So another concept is, I think, so maybe the commercial implication of that point on prompting and verifying is business spend moves towards prompting, proctoring, verifying, basically checking all the stuff that AI can generate.
That's going to be a huge, huge, huge thing.
And that maps to KYC, that maps to KYC, that maps to.
like in a bad way, you know, the glass cases in Walmart, right?
In a sense, a low-trust society is spending more and more and more on verification and proctoring and so on, right?
Okay, next.
AI means amplified intelligence, not agentic intelligence, because the smarter you are,
the smarter the AI is better writers or better prompters.
What are your thoughts on that?
Yeah, I mean, it's interesting in the coding space that we actually start to have numbers on this now.
Oh, interesting.
Yeah, so if you actually look at like relative productivity gains, it just turns out,
if you're a more senior developer,
you will have better productivity games.
I didn't see that graph.
So it is something that makes the smart smarter, basically.
But also on a relative basis,
which is really surprising, right?
If you think about it, it's actually not surprising.
It's like, you know what the fundamental tradeoffs are.
You know what to ask.
You know how to interpret the results.
You know how to throw away bad stuff when it's bad.
And so clearly, if you kind of know what you're doing,
you can both verify to your point the output,
but you can also be more specific of your end.
I think it's really important for all of us to realize that formal languages came out of natural languages, not the other way.
Right?
Like, if you can explain all of this stuff in English to each other, we would, but it's just really inefficient.
So we came up with more efficient ways to explain tradeoffs.
Yeah, basically, constrained languages that reduced ambiguity.
This literally is strictly an efficiency thing, right?
And so, like, someone that knows how to speak these formal languages to the models is going to articulate what they want better,
and it's going to be able to interpret the results better if the response is formal.
And so it's kind of a nice codification of exactly what you're saying.
Yeah.
I mean, the thing about it is AI means everyone's a CEO because, like, to a great AI, you speak to them, like, in some ways to a great employee where you give clear written instructions and then you can verify the output.
So it actually kind of turns management into a skill that it hyper deflates the cost of trying one's hand as a CEO or as a manager because you have to give those.
And so the better you are in communicating what it should do,
often the more people you can manage and so on and so forth.
By the way, this gets to take the next point, which is AI doesn't really take your job.
It takes the job of the previous AI.
Okay.
And what I mean by that is you now have a slot on your roster at every company for an AI image editor,
an AI text chatbot thing, an AI code, you know, IDE thing and so and so forth.
And each new release of GROC or Claude or whatever
competes against ChatGBTGPT and GROC and Claude, right?
And so the AI takes a job of the previous AI
because they're complementing,
you kind of have a whole raft of AI augmenters
that are augmenting your humans.
But those AIs are competing in AI space
to a large extent with the previous AI.
Because once you've onboarded an image generator into your flow,
then it just keeps improving
and you start using it in more places,
but it's an AI taking the job of the previous AI.
Let me know your thoughts.
This is an adjacency to what you're just saying,
but can I actually push on something you said previously?
Because I actually agree with your polytheistic view of the world.
I totally agree.
But let me just provide the counterargument for us to noodle on in this thing,
which is, have you seen this kind of thing that all the AIs
did you ask to produce a random number, produce the same number?
Have you seen this?
Yes, it's like 47 or something like that.
Seven or something, right?
So one thing that is, to me, was not intuitive,
but remarkable about these models
is how easy they are to distill,
which is as soon as someone creates a leader,
everybody uses that leader and kind of sucks the life out of it.
And then all the models converge on it very quickly,
which you could argue that this is a counter to the core.
It's basically the, yeah, there's like a core.
Maybe there are 100 AIs,
but it just turns out they all have the same capability.
So is it just a technicality that they're actually different
and they've all learned from each other?
Well, so it's an interesting question.
And my view is, I've not called it's a strong view yet,
but my view is that's almost like the human body plan and spinal column.
And then you differentiate on top of that core spinal column, maybe, you know.
And it's like you would have some sort of,
just like every human to first order can see and speak and hear and so forth.
But then some people have, you know, much better vision or they have much better speech or something like that, right?
so there may be some distilled kind of thing.
Oh, by the way, another interesting part
onto what you're saying,
in general, text on the internet
is not emitted equally by every group.
Here's how I would distill my view on this,
which is very much in mind with what you're saying,
which is I think the universe is very complex.
And I don't think it gives up its secrets easily at all.
And I think the universe is full of fundamental tradeoffs.
Like, you can't have both.
You have to choose A or B.
And so these models
will align with those fundamental tradeoffs, right?
And maybe it's performance, maybe it's correctness,
maybe, you know, whatever it ends up being.
And so as soon as you want a specific solution
for a given problem where it hits one of those tradeoffs,
you're just going to need a different model
because you just can't end up having both.
And again, because I know the coding space the best,
we see this a lot, right?
Which is, you know, a model that's very good
for certain parts of code is just not going to be generally good
at other things because those are the tradeoffs.
made when training it.
And I think that this is the future plurality
about what are we going to?
Well, is that true?
I thought somebody said something,
I may be wrong with this,
but I saw some countertitude result that said
that making the AI specialize in one area
makes it worse in other areas.
Do you see something like that?
Well, yeah.
So this is a very big debate.
But the debate goes as follows.
Like the first wave of AI was pre-training
where everything you threw into it,
like it just got smarter.
And so that's kind of a 10-3
10 technical win, right?
Just because it'll be as good as writing code
as the sonnets.
But as soon as you're doing RL,
where you're training it in a specific domain
with a specific garifier,
you're likely losing, you know, other areas.
So you make it really good at playing chess.
It's going to be less good at, you know,
something else like that, you know,
writing general scores or something.
So I think the current debate now and the current data
seems to suggest that RL doesn't generalize in the same way.
And so now we are in this case where
you would have a plurality of models because you're always robbing Peter to pay Paul
when you make it good at a certain domain.
Mm-hmm. That's right.
Yeah.
I think also, you know, somewhat related to that in terms of what domains it's good at and so on and so forth,
at least right now, I think, I'm not sure if you agree with this,
AI doesn't really take your job, it allows you to do any job.
Yeah.
Because you can get to like an okay level as like a user interface designer or sound effects
or something like that, but you need a specialist.
for polish and that, you know, though I wonder maybe with enough RLHF from specialists,
maybe that won't be as necessary.
I don't know, maybe you have some thoughts.
So here's my current mental model.
There's two personas.
There's persona number one is the expert in the space.
And there's persona number two is the non-expert in the space.
So if the non-expert in the space is using AI, it's taking the place of the expert, right?
And so maybe you'll ask it and it'll give you something.
Let's say I want a 3D asset for a video game.
and I'm a programmer,
then I'm going to ask it for a nice 3D asset,
and then it'll give me one, right?
So I'm the non-expert.
The expert user to our previous
will actually know how to ask it better
and it'll likely get better results
because it's an actually domain expert.
And that expert is using it.
So I think we see both.
Actually, if you look in the market,
you see both of these uses,
and I think both of them will persist,
which is if I'm a programmer...
It's like a doctor talking to their doctor
and they can just instantly go to specialist language
and so of it.
So you're right.
Even if the specialist RLHF,
you may not be able to,
you may not be able to access that.
Yeah, that's right.
Like, why would I want to learn the entire domain
and make all of the tradeoffs of, you know,
3D design that somebody else could have done all about work for me
and they could talk to the model in the specialist way
when I can just talk to my model using code, right?
In order to very efficiently use a specialist model,
I'd have to become a specialist,
would be the argument to our previous one.
So I think for casual use, I can use these models for whatever I want,
but to really use them very well, again, to our previous conversation,
I'd have to become a specialist,
and somebody else will have maybe already invested all of that time.
By the way, if you actually look at products,
these products actually have both these distinctions.
Some products are very clearly for the casual user,
trying to replace, like, you know, think about cursor versus lovable, right?
So lovable is, I'm a casual user, I'm going to create a website.
I don't need to have to know about code.
and that's great.
You've done great amazing things.
Cursor is I am a professional software developer.
I have an IDE, you know, an ID.
No, over time, maybe these things converge.
That could be the case.
But thus far, these are very different user bases, right?
There's professional coding versus basically casual coding.
I mean, you know, part of it is,
which is interesting and a little counterintuitive,
it's like if you think about what a computer can do,
it can do the job of an accountant,
it can do the job of a physicist,
but then you clad it.
in something and it's adding up numbers in Excel
and you clad in something else
and it's doing simulations for MATLAB, right?
And so we already know that
when it came to logical
system two thinking
that computers were actually really good at that.
And now you have something similar
where these models are actually very versatile
but you clad it in the power user interface
and you clad it in the casual interface
and, you know, it's implicit contextual prompting
as well, probably as well as a system prompt,
that makes it do those things.
I mean, the thing that's interesting to me
about something like chain of thought
is that,
and I think this is where people were freaking out
in late 2022,
and maybe they'll still be right to freak out,
is computers have historically
always been good at the logical style,
much better, superhuman at that.
Now they're also superhuman,
in a sense, at the probabilistic style,
at least of text generation and so on and so forth.
And so it's not inconceivable
that someone could figure out a way to merge those two.
you know, like a quantum gravity theory of things, right?
Where you take the probabilistic and the deterministic and pull them together.
Yeah, this is where the very old school, you know, system is part of me,
thinks that there's a fundamental trade-off here, right?
What's that?
Well, I feel like you can trade off.
You can build a system for determinism.
And you can, you know, build a system which basically cuts a bunch of corners.
But you can't build a system that does both.
What are the two-year stuff?
I mean, it has gotten pretty good at figuring out when it wants to generate an image, when it's supposed to search, when it's supposed to read a PDF and, you know.
Right. But now you're acknowledging exactly what I'm saying, which is some things you want the fuzzy thing and some things you want a traditional system.
Yes, but if you have a fuzzy system on top.
Yeah, yeah, for sure. But then maybe it just becomes a consumption layer and all that hard work is still being done by traditional systems.
The full argument is if you have a model that does everything, you wouldn't need tools, right?
Because tools are literally like the API to the traditional system.
And so that's almost like a capitulation that like some things you want, you know, traditional software to do.
No, I know.
But I'm saying it's a hybrid system.
If you're just a pragmatist and you don't care, right?
Could a hybrid system actually get there?
I can't say it couldn't.
Right.
And, you know, maybe it's something where we actually need is something like Elon's, you know, billion miles of Tesla driving.
if we have enough context, not from LLMs,
but from pointer movements and mouse clicks on, you know, iOS or MacOS,
and the iOS could.
Yeah, yeah.
So your question is, can I have one trained neural net,
one trained LLM that can do both like the fuzzy stuff and the high position?
Like, is that possible?
Yeah.
My gut, again, this is total intuition,
is that the universe is way too heavy-tailed.
It's way too nonlinear.
And so the state space is too high for that
to actually encode all of that
and basically...
But humans can do it.
No, we don't.
We use calculators and we use software.
Like the whole reason we built software
is because we can't do it.
But at some level...
Well, maybe we're just talking about two different things.
So clearly, AI with traditional software,
can do great stuff?
To me, the question is,
can you have one AI that does all of those things,
you know, without your traditional software?
software? Can you build one LLM? And I think the answer to me is obviously no, but I've heard
arguments that it can. Yeah. You know, what's interesting to me is so, you know, like, that's why I'd say
I'm a little bit of a, I mean, a little bit, I'm on the borderline of the tech pragmatist and the
tech radical, right, where I think I always want to try to identify the limitations of the systems
today and then see how you could push beyond it. So, you know, like, I consider calculators,
which were made by humans to be ultimately humans doing it. You know what I mean?
like in the sense of it's like a tool that we came up with.
I mean, to give you an example, like earlier,
I was like, you know, AI is good at visual but not a verbal.
But for example, you can turn audio into spectrograms,
which you can then look at visually,
and at least you can see for radical deviations and so on,
maybe not the entire sound, but you can see it?
And so can we do Fourier transform like things
on other outputs of AI
where we can quickly inspect them visually?
You know, is there some grid or visual,
or visualization kind of thing
where we can turn it into a visual problem.
Yeah, I love this.
So like a thought experiment I have is
can I literally create a bunch of audio outputs
so that I can listen to my AI
like I listen to a car?
Because like, you know what?
Yeah, you can tell if it's rolling.
Like, I don't know what's wrong with my car,
but I know it's not normal.
We're very good at atmospheric inputs.
And I think this is a great idea.
Can we start exposing the internals
so that we understand when it's working well
and when it's not working well, you know?
And I just feel like there's a lot of stuff,
we can push on here that, you know, we're very early endings of.
Yeah, like colored text, for example, in terms of its level of confidence.
Yeah, yeah.
You know, stuff like that, like yellow, red, green, right?
There's a lot of AIUX that one can do.
Let me make a few other points that take it are interesting.
Killer AI is already here and it's called drones and every country is pursuing it.
So we don't have to care really about the image generators and chatbots,
all the worry about super persuaders or whatever is all pretty stupid.
Strong agree.
Strong agree, right?
And the thing is, when I push people on this, what's interesting is some of the people who were, oh, my God, we need to regulate everything are now actually on the side of we need to build it before China.
But the thing is, in both senses, first it was safety, then it was security, but it both comes to control.
And you might argue that the security argument is a better argument.
I think it's a more realistic argument in some ways.
But the concept of Killer Eye is already here is interesting because they put so much stock in the like, oh, it's going to persuade everybody to do things.
It's a super persuader, but persuading is statistical and, you know, drones are deterministic,
or at least, you know, the guns on a drone or whatever are deterministic.
I think that the interesting question around AI and, like, attack and defenses, does it change the equilibrium?
Because the internet did.
So the internet actually introduced the notion of asymmetry, which is the more that you rely on it, the more vulnerable you are.
So to it, the United States is more vulnerable than, you know, random, you know, random third world country.
And it's not clear to me you get the same thing with AI.
Like it could just be like it just enables everybody to have bigger weapons,
but the equilibrium is the same.
Well, I think that it actually has really huge impacts for borders.
And unfortunately, I think China is well positioned here for a very specific reason,
which is China, their justification for the Great Firewall is they've justified it as digital borders.
They say, we can intradite physical packets.
Why can't we intradite digital packets?
Yeah.
Right?
Yeah.
And now with the whole Ukraine controlling drones in your territory thing, that becomes more than simply a metaphor.
It's a real thing.
It's like controlling cloud space, right?
Yeah.
And, you know, if you can allow somebody to script drones or script humanoids in your jurisdiction,
then they can blow things up, right?
That's no longer a theoretical thing, you know?
And now the counter-counter argument is, well, maybe you just have them pre-programmed autonomous so they don't even need.
an internet connection and they can just do cameras or whatever.
That's true.
And in Ukraine, you know these things with the drones on cables,
just crazy thing they're doing there, right?
Yeah.
You know those like big unwinding cable things that you sometimes see on like ships, right?
So they have these cables for these one-way drones that are these ridiculously long,
like multi-kilometer long Ethernet cables, like Cat 1 cables on a drone so it can be
offline and it goes past signal jammers or something like that.
and blows up on its target.
And it goes forward and the cable gets tangled in the trees,
but they don't care.
It just goes to, because it's not going to go a reverse trip
where it has to yank that, you know,
so it's a one-way path, it doesn't matter.
It's a one-way drone, which is crazy.
So that's an argument that at least at short distance
near the border, drones, you know,
would be able to get in you, right?
But that concept of digital borders
becoming hard borders,
I think is going to become more of a thing
where basically, you know, I actually gave a talk on this 12 years ago
that, you know, your immigration policy becomes your firewall
because with telepresence, you can move robots around,
and that's starting to become real.
So that is something where I think that has real implications for the geography of a country,
because the alternative to that of having, quote,
defensible borders is basically an encrypted state
where you don't even know where it is on the face of the earth.
And what I mean by that is, can you make a map of Bitcoin?
Not really, right?
It's something where it's so dispersed, and you don't know every holder, and they're moving around the world,
and there's no single map of every mine, and even if you got a map, you wouldn't know if it was complete or erroneous or out of date or something like that.
You actually have, in a sense, security through obscurity, so you couldn't just go and blow all those things up versus something that's outlined on the map.
is sort of sessile and vulnerable in a certain way, right?
So that's something I think about a lot
in terms of what do future borders look like
and you might have hard digital borders
and China might preserve its territory,
but those that can't enforce for rare reasons
hard digital borders can't stop these kind of drone, you know,
introgressions.
Let me know your thoughts.
Business and drones are not autonomous.
Well, they still need to be given a control signal to do something, right?
Not that's fully autonomous.
You just be like, go blow up this building,
here's a picture.
And then I'd like a top of his zone would not need any packets.
That's true.
That's true.
And then also, if you think about it, are you going to block every single telephone call in?
It's really difficult that needle in a haystack.
I have some super spooky stories of being in China.
And I remember this is kind of a non-secondary, but I have to tell it because it was so spooky.
I was in China probably 10 years.
Now, I used to work for the government.
I used to work for the intelligence community.
Like when I was a kid.
I was a kid.
I was a kid.
This was like in 2001, you know, like my first job.
out of college. But anyway, so say 10 years later, I was on a business trip in China, and I called
a friend of mine, and I was telling you about my day and the phone dropped. So I called my friend
again, and I was telling my friend about my day, and the phone dropped again. And I'm like,
what's going on here? So what I was recounting is where I had been. So I called my friend one more
time. I said, one, two, three, Tiananmen Square, and the phone dropped. So I think there was a bug in
whatever software they had, and somehow I had been picked up.
But I don't think it's too crazy to assume every conversation on every phone call can be monitored and has been for a while.
Now they have something.
This is another way where AI does change the balance of power in the following way, right?
Like in China, they had this saying, which is the mountains are high and the emperor is far away, right?
And China always had a different conception of the balance of power between the government and the people than the west did.
on the one hand, you know, this is a broad generalization
over thousands of years of history, but very broadly,
like on the one hand, because the state had all the weapons
and the army and so and so forth, like that chair could morph into
an agent of the emperor or a CCP guy today
if the government's so desired because there's no like limits truly,
you know, in the sense of it can just do whatever it wants, right?
On their hand, whatever the law is written down,
the people just do what they want, right?
So they kind of in a very pragmatic way say the limit is really the limit of what people can enforce, right?
And if the state has lots of power, then any written limit doesn't really matter.
But the state can't find you since you're on the other side of the world.
And the written law doesn't matter either, right?
Which is a different conception than the progressive versus libertarian within the West where they'll always quote law against each other back and forth.
What is written is what is permitted or what happened, right?
But AI does change that balance because now the mountains are never high
and the emperor is never far away.
The long arm is incredibly long.
The long arm is infinite.
Yeah.
They can synthesize.
You know, there was something, maybe you know this thing, Martin.
I think it was called TIA, Total Information Awareness in Iraq at a certain point.
The idea was they had satellites covering a rock.
And so every time some guy was putting down on like an IED or something like that,
they would rewind the satellite to find who the guy was that did that.
and where he came from and then put a bomb through his window or would have you, right?
And in a sense, it was like tracking someone for like their whole life, you know,
because you were sewing together the trace of them through all of these cameras, right?
And that's totally possible for China to do now.
And the difference is that AI makes it possible to, for a long time, that data was ingested,
but it couldn't really be parsed or queried because it was too difficult to look through
five thousand hours of video on one person or whatever.
that's increasingly becoming queryable, right,
and ingestable and summarizable in a way that it never was.
And so I think that the real check on something like that
is going to have to be cryptography, exit, you know, and so and so forth,
which is ultimately like get out of the jurisdiction,
you know, have property that they cannot actually seize.
Like you go back against the limits of power and what have you, right?
Anyway, let me pause there.
Some thoughts on balance of power since you talked about that.
Oh, that was great.
That was great.
Okay.
Last one.
I think that there's going to be, there already is an anti-AI backlash that's like the anti-crypto backlash and will be part of the anti-tech backlash.
Because a lot of people are not using AI for what we're using it for.
They're using it for like therapy or they're using it like as a companion or something like that, you know?
It's the top of the pyramid of needs.
It's funny if you actually look at it.
It's like self-actualization, spirituality therapy.
It's like finally computers are addressing like further on.
Exactly.
That's right.
And there's another aspect to it that I think hasn't gotten as much press,
but that's interesting to understand is that just like, you know,
the tariffs are meant to kind of ward off Chinese competition.
I'm not sure if they'll work.
In fact, I'm skeptical.
There's a similar, much less publicized thing that's happening at many media corporations
where they're unionizing to try to ward off AI competition.
Like they have union contracts that say,
editors, owners cannot use AI, right?
So they're making their organization very brittle where they think they own the market,
but they're not allowing themselves to use AI, right?
And then eventually they're going to be beaten by AI-enabled competitors
that pull all of their followers and views and so on away from them
because they're just more efficient.
So I think that's going to result in an anti-AI backlash.
And I think that it's already here where on some like artist forums or whatever,
they'll say, are you an AI supporter?
Have you heard that?
Yeah.
You know, like AI artists spend as much time on building things as traditional artists.
It's just a different tool.
This is my view.
Yes, yes, yes.
That's true.
But basically, they feel that it's similar to the reaction by master craftsmen in the 1800s, right?
When mass production started taking over what they were doing in the physical world, this is now happening in digital world, right?
Totally.
And the other aspect of this is I don't think people have thought about the international aspect where if you've got it, let's say a lawyer who's making,
200k a year in the U.S. or a doctor in the West. And then you've got somebody from the Philippines
or India or anywhere in the world who's making currently $2,000 a year. Maybe the converged
wage with AI plus their IQ or what have you, AI plus human convergence is like 20K a year,
which is a 10x for the person abroad, but a one-tenth for the person in the West. And it radically
increases consumer surplus and so forth. But I do think that that's going to be something that's
going to be a big deal in the years to come. And so we'll have to figure out how to mitigate that.
To your previous point, well, I just think this is so important. Like, I agree there's going to be a huge
backlash. And I think some of it's going to be rooted in the experience of individual people.
You know, my job is shifting. And that I am very sympathetic that I think we should address.
But I think there's something more pernicious going on, which is, and maybe this is my cynicism.
But more and more, I kind of view politics is like you've got, you know, pretty sophisticated
people and they have clientele classes. Yes. Patron, patient client. Yes.
Yeah, what they say is basically what will move the clientele class the most.
That's what. They just look for sound bites that'll move the clientele class.
Actually, you know, the patron are sophisticated people that can actually hold nuance in their head.
They know they're coming down on purpose.
But they dumb it down on purpose, right?
And what better talking point than AI?
This goes back to the Promethean legend.
I mean, we're terrified of technology.
You can anthropomorphize it.
You can talk about it as gods.
I mean, it is a perfect tool to mobilize.
And they're seeing this on both the right and the left, right?
So this is not in any way to hold into one party.
So I think this is like the ultimate, you know, political, you know,
tool for any purpose.
And we're seeing it for that.
And I think for that, even more than crypto, by the way,
I think the EIA strikes to the heart of people's insecurities more than crypto ever could.
And so I think that this is the big battle.
And I think it's going to be bigger.
It's interesting.
It's all of the above, right, because AI is disrupting media.
Crypto is taking power over money.
Robots are taking power of manufacturing and drones are taking power of the military.
So all of these, and by the way, there's a crypto angle to at least three of them.
Because this is a crypto angle to money.
There's a crypto angle to AI in terms of constraints.
It's a crypto angle to the drones because you're going to want the control plane for the drones to be on chain since that's the part that can't get hacked, whereas a Pentagon can't get hacked.
So I do think this is something where it's going after quite a few power centers.
I just don't think 300 years ago, if you said, well, listen, we're going to do this new crypto thing, people would be like,
but if you said, listen, we're going to create AI, these artificial, you know, intelligences that have,
bound power. I think it really getting out
a core human insecurity that we've seen
in Myth and Legend for 3,000
years and probably longer. That's true.
That's true. Well, we'll see what happens with
currencies and so, but I think you're right. It's both.
It's both for sure.
Thanks for listening to the A16Z
podcast. If you enjoyed the episode,
let us know by leaving a review at rate
thispodcast.com slash A16Z.
We've got more great conversations
coming your way. See you next time.
