The a16z Show - Balaji Srinivasan: How AI Will Change Politics, War, and Money

Episode Date: July 28, 2025

a16z General Partners Erik Torenberg and Martin Casado sit down with technologist and investor Balaji Srinivasan to explore how the metaphors we use to describe AI—whether as god, swarm, tool, or or...acle—reveal as much about us as they do about the technology itself.Balaji, best known for his work in crypto and network states, also brings a deep background in machine learning. Together, the trio unpacks the evolution of AI discourse, from monotheistic visions of a singular AGI to polytheistic interpretations shaped by culture and context. They debate the practical and philosophical: the current limits of AI, why prompts function like high-dimensional programs, and what it really takes to “close the loop” in AI reasoning.This is a systems-level conversation on belief, control, infrastructure, and the architectures that might govern future societies. Timecodes:0:00 Introduction: The Polytheistic AGI Framework1:46 Personal Journeys in AI and Crypto3:18 Monotheistic vs. Polytheistic AGI: Competing Paradigms8:20 The Limits of AI: Chaos, Turbulence, and Predictability9:29 Platonic Ideals and Real-World Systems14:10 Decentralized AI and the End of Fast Takeoff14:34 Surprises in AI Progress: Language, Locomotion, and Double Descent25:45 Prompting, Verification, and the Age of the Phrase29:44 AI, Crypto, and the Grounding Problem34:26 Visual vs. Verbal: Where AI Excels and Struggles37:19 The Challenge of Markets, Politics, and Adversarial Systems40:11 Amplified Intelligence: AI as a Force Multiplier43:37 The Polytheistic Counterargument: Convergence and Specialization48:17 AI’s Impact on Jobs: Specialists, Generalists, and the Future of Work57:36 Security, Drones, and Digital Borders1:03:41 AI, Power, and the Balance of Control1:06:33 The Coming Anti-AI Backlash1:09:10 Global Implications: Labor, Politics, and the Future Resources:Find Balaji on X: https://x.com/balajisFind Martin on X: https://x.com/martin_casado Stay Updated: Let us know what you think: https://ratethispodcast.com/a16zFind a16z on Twitter: https://twitter.com/a16zFind a16z on LinkedIn: https://www.linkedin.com/company/a16zSubscribe on your favorite podcast app: https://a16z.simplecast.com/Follow our host: https://x.com/eriktorenbergPlease note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Stay Updated:Find a16z on YouTube: YouTubeFind a16z on XFind a16z on LinkedInListen to the a16z Show on SpotifyListen to the a16z Show on Apple PodcastsFollow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Transcript
Discussion (0)
Starting point is 00:00:00 So polytheistic a GAI, I think, is one very useful macro frame. It means every culture has their own AGI. And eventually, every culture has their own social network and cryptocurrency and AI. You know, the AI is sort of like their Oracle is at the center of society. And they've got their deterministic law with cryptocurrency and the probabilistic guidance with AI. The social network that binds the whole thing to AI. So those three technologies are like social technologies that are almost like the reactor core of the network state of a modern internet for society. The way we talk about AI often reveals more about us than the technology itself.
Starting point is 00:00:35 In this episode, I'm joined by technologist and founder, Bologi Sreenovastin, alongside A16Z general partner, Martine Casado, to unpack how our language, whether we frame AI as a god, a swarm, or a tool, shapes our hopes and fears. Bology, known for his work in crypto and network states, also has deep roots in machine learning. Today, we explore where AI discourse has gone off course, what today's systems can and can can't do, and our different cultures might build very different AIs, each reflecting their own values and constraints. It's a conversation about belief, control, and the systems we build.
Starting point is 00:01:10 Let's get into it. As a reminder, the content here is for informational purposes only. Should not be taken as legal business, tax, or investment advice, or be used to evaluate any investment or security, and is not directed at any investors or potential investors in any A16Z fund. Please note that A16Z and its affiliates may also maintain investments in the companies discussed in this podcast. For more details, including a link to our investments, please see A16Z.com forward slash disclosures. Martin and I were talking offline about how amazing your thread was on AI. And, you know, often you're a crypto guy, you're a network state guy, but you're a
Starting point is 00:01:51 technologist. Sure. And you've been thinking about AI for quite some time. So why don't you trace us through your evolution a bit? Totally. So, you know, actually, Martin and I are roughly contemporary is at Stanford. I got my PhD in 05, 06. I got my in 2007. Yeah. So we're roughly We overlap almost completely. Yeah. Yes, that's right. I'm a little gray down
Starting point is 00:02:13 here, and Martiz's a little gray up over here, and we're complimentary grays. We both have that ambiguous kind of Middle Eastern look. Yes, exactly. That's exactly. Neither of us are Middle Eastern. That's correct. That's exactly right. That's right. So we're both men of a certain age, I think, as a phrase goes. And the funny
Starting point is 00:02:29 thing is, you know, I taught machine learning and computational statistics and so on the context of genomics at Stanford for, you know, the mid-2000s and then founded a DNA Sequencer Company. And really, I would say, like my original career expertise for 10 years, it's all I was doing was, in a sense, ML full-time. But then I got into crypto right in the early mid-2010s, just as the deep learning revolution was getting underway with ImageNet and all that series of papers in the mid-2010s, early 2010s. So I've suggested my thought process, I have a foundation in probability and stats
Starting point is 00:03:08 and multivariable calculus and blah, blah, blah. And so I'm conversing with the space. The thing I will say, and I'm sure if Martine has thought on this and I'll look at this specific tweet, in the 2010s, you know, we were all tracking diffusion models and language models and so on something that was improving. But, you know, like style transfer, for example, the mid-2010s was working by that time, right?
Starting point is 00:03:32 And, you know, GPT2 and so on was interesting. It could kind of blurt out like a sentence. But I admit that I never really thought it was going to get past like Markov chain E like stuff, you know? I was surprised at how much better GPT, like Dali was a hint in early 2022. But I was surprised at how coherent chat GPT was. think everybody was, but it was like a huge jump up from what it was before in terms of sort of being Markov-Cheney. And so I've been kind of observing our last, you know, two years, being originally very deep in machine learning, then very deep in crypto. But, you know, you can't be
Starting point is 00:04:15 deep in everything. You can't be deep in maybe Elon can't. Okay, aside from Elon, it's pretty hard to be at the cutting edge of so many different fields at the same time because they're deep fields, which have a lot going on. So with respect to AI, there's like several realizations I've had for the last few years in terms of the unarticulated limitations of the space, right?
Starting point is 00:04:34 Some of these I think I sort of, I think I came with relatively early in the history of modern AI and others I think I've come to more recently. But let me kind of enumerate them in no particular order. Martin, jump in any time. So the first is that something that motivated,
Starting point is 00:04:49 I think, both LAISR and Altman, a bunch of folks who built up an AI was almost, like the same kind of sentiment that motivated people to build like the Sistine Chapel, which was sort of like an implicit Abrahamic monotheism, which was like summoning God, right? Like, you know, communing with God. But in the Abrahamic God sense, right, of also the vengeful God who had turned you into paperclips, like turning you into pillars of salt, right?
Starting point is 00:05:14 That was an implicit thing that was behind, right? Because when they talk about AGI, they talk about AGI as implicitly a unitary thing. We will get to AGI and then it will go to infinity. and will be like, you know, raptured, singularity kind of thing, even though that's implicit. And because I'd been thinking so much about crypto and other kinds of things, I was like, well, there's a different sort of implicit school of thought, which is polytheistic AGI. Right. Do we have, rather than the vengeful god, do we have war of the gods?
Starting point is 00:05:44 Do we have many superhuman intelligences, all from different cultural backgrounds that have the mores and the values imprinted on them? And very early on, I had a tweet that said, at a minimum, there's going to be American AI and Chinese AI. And if we're lucky, there'll be decentralized open source, you know, crypto-style AI. Because at the time, the American AI was woke, highly woke, because it's 2022. And I knew that China was going to stop and nothing to copy it. So I knew we're going to get at least two. And I thought we might get N if we were lucky enough to get decentralized AI.
Starting point is 00:06:18 And that wasn't obvious at that time because the cost of training models was so high and OpenAI was so far ahead. It took a while before other people caught up. But now it's very clear that we're going to have lots and lots of high-quality open-source decentralized models. Like a new one comes out almost every week, you know, and China's going to work hard on this. It's a big thing like all the deep seek models.
Starting point is 00:06:40 So polytheistic AGII, I think, is one very useful macroframe, which takes away some of the sort of AI apocalypse tones, I think, because I don't think the image generators or text chatbots are going to cause the, you know, destruction that people had. People thought they were going to, like, bust out and, you know, do systems programming. And Martine can speak about that. Martin and I kind of were talking about that. There's certain limitations.
Starting point is 00:07:07 It sound more clear, actually, that they're worse at systems programming than there are visuals. Come back to that. So, A, polytheistic AGI. And so what does that mean? That means every culture has their own AI. And eventually, every culture has their own social network and cryptocurrency and AI. which is, you know, the AI is sort of like their Oracle that's at the center of society, and they've got their deterministic law with cryptocurrency and their probabilistic guidance with AI,
Starting point is 00:07:32 and the social network that binds the whole thing to ours. Those three technologies are like social technologies that are almost like the reactor core of the network state of a modern internet for society, right? And it'll be customized for each different kind of group, and certain things will be disallowed and allowed, like image generation might not be allowed in subcultures or NSFW or whatever, all that kind of stuff would be tweaked. So, okay, that's one concept. The second concept, you know, Eliasur Yukowski, who, by the way, you know, even if I disagreed a lot of his stuff, did do a lot to promote AI and people getting into it and so and so forth. So even if I disagree with bombing the data centers and various other kinds of things, I give him significant partial credit for getting people motivated to look into the space. He was definitely into it in that sense.
Starting point is 00:08:12 So like directionally there was something, you know, is try to see the right sentence. But a second big concept that I think I really discrew the Eliasor on that I think is being borne out is the idea of that. that AI could just cogitate for millions of years and figure things out and it could out maneuver you all the time. And we know that's not true because turbulence, chaos, cryptographic equations are not like that, right?
Starting point is 00:08:39 You can come up with turbulent systems, chaotic systems, where you simply, with finite precision arithmetic, cannot forecast out indefinitely. In fact, you get fracturing and breaking and cryptographic hashes are set up in such a way as well to be hypersensitive to initial conditions where a small change of one character can get a totally different MD5 sum or something like that. So those were situations. And if you wanted to, you come with a thought experiment where you inserted turbulence or chaos into your decision process,
Starting point is 00:09:06 sort of like you shake a turbulent clock or something like that before throwing a pitch. And the AI wouldn't be able to predict your actions, right? And that's like just a simple experiment in real life. Just, you know, the flow of a fluid is turbulent, you know. So that actually put bounds on what AI can predict, right? Quantitative, physical and mathematical bounds on what an AI can predict, right?
Starting point is 00:09:28 Can I just add just a little bit of color here? Sure. I think this is great. I think we need to call out. So the way that you describe AI as like gods and monotheistic and polyshaistic, it's great at describing how human beings
Starting point is 00:09:43 view AI, right? Sure. But in reality, we're talking about software running on computers that are bound by those limitations, So I don't view them as gods personally. I got my PC in system. So I view them as like system software.
Starting point is 00:09:56 And I actually think the original sin in all of this AI, anthropomorphic fallacy started with Bostrom. It was one of these kind of thought experiments where, you know, when Nick Bostrom wrote superintelligence was what, 2014? And he was talking about this platonic ideal of AI. And this platonic ideal of AI just happened to be able. able to recursively self-improve and just happened to like have these kind of like super physical things that no AI today has. But it happened that the conversation around AI started then
Starting point is 00:10:34 and then it just coincidentally we had these LLM show up four years later. And so somehow our thought process on these two things dovetailed, right? And so people would take all of these kind of mental ruminations, these thought experiments, and they would apply it to actual systems. And I think the problem with doing that, the problem with taking some platonic idea, whether it's Bostroms or the Abrahamic view of God, or any kind of religious view, is that it is very blinkered to the limitations. And you've pointed out a great limitation. We've been doing computer simulation forever.
Starting point is 00:11:12 We totally know the limits of simulating physical phenomenon, particularly chaotic systems. We have actually very hard bounds on these. By the way, it's not just like, you know, the limits on the size of like a computer word or an integer or something like that. They're actually like very strong, you know, limits on time and the amount of compute necessary, et cetera, right? And so we know these. And so you can talk about these in two ways. I think for this conversation, we should do this. Like, Bollagia, you're so good at talking about, like, what is this platonic ideal and how should we have a mental kind of model for this?
Starting point is 00:11:41 For like the non-computer specialist. And what I would love to do as we go to this conversation is talking about, like, actually, these are still bound by computer systems. we know the limitations of computer systems and so let's see how those bound it and you just beautifully did both of those things in the same one I just want to make sure that we tease apart both of those things as we have. Totally, totally. I feel I can kind of speak both languages here
Starting point is 00:12:00 where I understand where those guys are coming from because I kind of am like also a tech radical, you know what I mean? Right? But I'm also a tech pragmatist. So I think I straddle that boundary. The danger is that we don't say that this is a platonic ideal. People will map it to existing systems incorrectly. Totally, totally.
Starting point is 00:12:18 That's exactly what happened in 2020, 2021, which is they took this thought experiment that started with Bostrom. And it was a thought experiment. If you go back to the original book, you're like, listen, this has nothing to do with real systems. And they applied it to a real system. And I think that was kind of the original set. I know, I know.
Starting point is 00:12:32 Well, but let me poke on that a little bit and then also defend your point. The Turing test was a thought experiment. That was a platonic ideal. No reference to neural networks, no reference to implementation details. And yet, it served as something that went from a thought, experiment to an applied thing with, you know, the Levchen-Ga-Spec test, the CAPTCHA was like V-Zero of that you can argue and became commercially important. And now, obviously, AI has blown past a Turing test. It can, you know, be people in this. And then, you know, the Chinese room,
Starting point is 00:13:04 John Searle's thing, right, about machine translation. Another thing that was like a platonic ideal. And there's other things that are like that, like six degrees of separation, which social networks actually made real, right? So I'm not necessarily against. platonic ideals. Thought experiments are very, very important. I just think that we need to be very clear when we're having a conversation not to conflate them with the actual systems. And I think that's the thing that we've kind of fallen into in this conference.
Starting point is 00:13:31 Not you and I. I just think the broader discourse outside of us has fallen into it. That's right. So now your point, which is a very good one, is these are real systems and they actually have real limitations. I think one of the more interesting things for me over the last few months and years has being defining exactly where those limitations are, because I think where they landed was kind of counterintuitive, right?
Starting point is 00:13:56 100%. Let me give some of them that I think about it. One of them is that you have this decentralized AI rather than AGI. That alone, I think, kind of nukes a bunch of the concepts of we'll get to AGI and just win, because it's kind of clear that there's just like a rapid onrush of new models, and it's like more of a continuous kind of thing. the fast takeoff scenario didn't happen, right? On their hand, can an AI write a sonnet?
Starting point is 00:14:22 It can do it better than most humans. Can it write a screenplay? It can do that, again, better than most humans. There's a lot of things that we thought is maybe harder. We thought maybe like locomotion or something would be easier to solve than what we think of as higher cognitive functions, but it's actually the locomotion that's still harder in some ways, right? I think that one now in retrospect is easy to explain via economic equilibrium.
Starting point is 00:14:46 We just didn't have a right model. Well, so, for example, when you're competing with a human brain on 3D navigation in space, you're competing with whatever, the 4 million-year-old mammalian brain and a body that's been running away from predators and picking berries for 4 million years. It's incredibly highly evolved. When you're competing with a prefrontal cortex, which is like the language learning and creativity, How old is it? 250,000 years? And so if you take this question from an economic equilibrium standpoint, you're saying,
Starting point is 00:15:22 well, listen, do you want to compete with the most evolved system that's solving the much more difficult problem, which is much higher dimensionality, has to deal with like chaotic nonlinear systems like you said, or do you want to deal with the very new evolution that deals with kind of a much denser space that actually does a pretty good job with linear interpolation, you're one of the problems that actually works very well with linear interpolation, et cetera. And so I think you're totally right.
Starting point is 00:15:48 It was not obvious. I mean, listen, AI has all been solving what we thought was the easier problem. But our fallacy is easier for humans because we're really good at it because we've been doing it for really time. And it turns out the harder problems are just harder for us
Starting point is 00:16:02 because we've only been doing them more recently. So this is a great case of where our intuition on the problems to solve with the wrong ones because of our own kind of anthropomorphic fallacy, right? Our own notions of what problems are easy and hard. Yeah, I mean, okay, true. I would say one of the surprises I had, that's why it's interesting when you said economics, one of the surprises I had with GPT 3 and chat GPT was how far you
Starting point is 00:16:30 could get with language. Yeah. Like before the Chad GPT moment, it wasn't obvious to me. And then after you're like, oh, okay, language is sophisticated enough to encode almost any concept about the world, right? Or rather... Well, if I put you in a very dark room... Yeah. And that's an arbitrary construction and I describe how you navigate
Starting point is 00:16:53 and pick something up, I think you'd have a very tough time doing it. No, no, no, I know. What I'm saying, though, is basically if you generalize language to be streams of symbols, right? You could send telemetry to something...
Starting point is 00:17:05 Like, basically, I think I was surprised by how many concepts were encoded in language, that could be learned, even to the point of like rough world models of like, you know,
Starting point is 00:17:18 the map of the earth or the proximity of things, you can back out those kinds of things. The distinction is, is it could have been the human being, the human mind that looked at the world,
Starting point is 00:17:27 did the reasoning, and created the world model, and that is cached in language. Yeah, that's what I'm saying. Okay, great. Yeah, yeah. But going from the world to the world model was the human and then everything else,
Starting point is 00:17:38 and then the language, okay, great. I agree. That's right. But it was a little surprising to me, that you could get that far with language models, as opposed to like spatial reasoning, as opposed to that Predict Next token
Starting point is 00:17:51 would get as far as it did. That was surprising to me that that was the angle. The reason is you and I both did so much stuff on Markov chains and conditional random fields and all that kind of stuff. And of course, it transfers to different architecture, but I just wouldn't have believed that that method taken to... I mean, another thing I think was very countertitive
Starting point is 00:18:10 for me in the late 2010s was double descent. because as a classical machine learning guy that's just very counterintuitive that you could go past over training back into like, you know, good regime. So I want to actually talk about one thing you did say,
Starting point is 00:18:24 which is self-replication, right? I don't think of that as a forever constraint on AI. I think of that as a today constraint. And the reason I think of that as a today constraint is they're not embodied, so they're not scripting robots because they're not scripting robots. They can't build data centers and mines
Starting point is 00:18:41 and replicate themselves. and so and so forth, right? And, you know, the whole concept of consciousness initially was that consciousness evolved so that, like, you know, you're running away from like a bore or something like that, and you have a model of yourself, and then there's, like, a branch ahead.
Starting point is 00:18:59 And if you have a model of yourself, you know whether you'll fit under that branch or not. Whereas if you just had a generic model of, like, the more self-consciousness you have, you can sort of simulate your run under that branch, whether you're going to die or survive. right? And so that's like one theory on why consciousness arose to help your survival replication that helped with goal setting.
Starting point is 00:19:19 Yeah, you stand outside of yourself to be able to see the experiment, yeah. That's right. So right now, AI does not really have goal setting. It doesn't have reproduction. It doesn't have embodiment. And it can't act independently of humans. This is one of the big things I think that people were really scared about in late 2022 and they've calmed down on this, that you and I both poked on Martine, I think, was, is this thing going to jump? out of the box and, you know, code itself. Now we laugh at that. But the reason that I think that hasn't happened is AI can't prompt itself yet.
Starting point is 00:19:53 And prompting, I argue, is actually a much harder thing than people realize because we talk about my analogy of like the spaceship. Talk about it. There's something worth going through. Okay. So let's say you have a really fast spaceship, like close to speed of light or something. You still have to point at the phi and psi coordinate on the surface of. of a sphere, you know, in coordinate space as to where you're going to point that ship.
Starting point is 00:20:16 And if you're going to take it on a journey, then you've got waypoints like, here's this heading and here's that heading and so on and so forth, like a series of fi-ci pairs on the surface of sphere. And that's only two floating point variables, you know, right? By contrast, if you take, I mean, how high dimensional is the vector that you're giving as input when you talk about a prompt, right? If you just take UTF8 code points, I mean, or just even ASCII, right? and you have like a few words that's much higher dimensional
Starting point is 00:20:45 than just a like a vector of two floating point variables, right? So you can get to a very high level of dimensionality in terms of direction vector you're pointing this AI spaceship in, right? And so a prompt is a very high dimensional direction vector, even if you account for the fact that many potential prompts
Starting point is 00:21:06 of just strings of random characters wouldn't be interesting, it's still a very, very high dimensional vector. So it's like you've got a fast spaceship, but you still have to point it in a direction to go somewhere. I think it's a good analogy, right? Well, I think there's one more level of complexity you have to add to your analogy, which talks about how difficult it is to make these things kind of,
Starting point is 00:21:26 let's call it autonomous, which is closing the control loop. Yes. Let me try and build on your analogy. That's a very fine part. Go ahead. Yes, go ahead. So it turns out that the directions that you point in, it has to understand, right? That has to be in distribution. So you can't point into a direction.
Starting point is 00:21:41 a direction it doesn't understand because it does the worst thing if you point in a direction it doesn't understand. It just crashes right into that wall or whatever. It just tries to do it. No, it does a random direction. It's the worst thing ever, right? And so the problem is if it's producing a direction that has to go into itself, it doesn't know what it knows and it doesn't know what it doesn't know. Does that make sense? Yes, that's right. In fact, it's optimized to fake it. Yes. And so if you could tell it, if you could say, hey, listen, produce a bunch of directions by feeding the last direction in, you have no idea of a direction it spits out
Starting point is 00:22:17 is going to be in distribution when it comes back in. And that's what closing the control loop means, and it's a very tough problem. I think this is such an important point for us to go into because in theory, you can close a control loop on these things. But as scientists, we want bounds on what that means, right? Like, for example, clearly you want to gather new information to update your model.
Starting point is 00:22:39 then we want bounds on how much information you need to gather. It turns out that model was trained on everything humans have ever gathered. So is like the incremental experiment going to update that? Maybe information theoretically says probably not. We don't even have bounds on these things. Now, you said previously, well, when it comes to a chaotic system, we know that computers, you know, it takes a long time for them to compute a nonlinear system.
Starting point is 00:23:04 Actually, you know, I just want to pause you there. You just gave me an idea for a great prompt, which is what? areas do you feel your knowledge is the most thin on? This is the key. Right? That's a great prompt. Yes, does a model know to what extent is in distribution or is out of distribution? Yeah, I'm going to try that one on. Actually, by the way, this is, you know, but this is the key. This is the key. Self-reflection is the key because if it produces an output that's out of distribution, then of course you have error. And then you're not there to kind of nudge it back.
Starting point is 00:23:36 Yeah. So it's like real-time events, obscure or niche. academic fields and specialized subfields behind paywalls, local and regional information, human emotion intent or experience, private or proprietary systems. Actually, pretty interesting quick off-the-cuff response here, right? You should ask it if it can always produce a response to which it has a lot of data. Always produce a response. What do you mean by that? So the question is, is if you're closing the control loop, it's going to spit something out
Starting point is 00:24:06 that you're going to feed back in, right? Yeah. that's the whole point. So the question is, will it always spit stuff out that if you feed it back in won't give you nonsense? Oh, I see.
Starting point is 00:24:16 Yeah, I mean, well, people have actually tried the experiment of take the image and just exactly replay the previous image and then it like morphs into something totally different. So actually, I want to do like maybe 10 quick hits off of that initial post
Starting point is 00:24:29 because you reminded me of something just down, which is another kind of angle I have on AI is prompts or tiny programs, which is more common today, but I think at least I check you like it went viral a while ago, but there are programs in a hidden API because normally you have an API
Starting point is 00:24:46 that is fully documented but very error intolerant. Prompting is the opposite. It's completely undocumented, but it's highly error tolerant. It will usually do what you mean, but the better your vocabulary, the better you can prompt it.
Starting point is 00:25:01 So now art history is an applied subject, right? Like knowing a vocabulary of like Cézon versus Picasso so and so forth, you can actually pull up the style that you want on demand. So the broader your vocabulary, the broader your subject knowledge, the more you can get out of it. We're in the age of the phrase, which is the prompt, the 140 character tweet, and the 12 words for your crypto password, right? These phrases of power in AI, in social media and in crypto, just unlock everything.
Starting point is 00:25:28 So the better your vocabulary, the more you can do, right? So I think of prompts as tiny programs. And actually, one of the things that I've gotten into the habit of doing is writing the It's total opposite of search. You know, with search, you learn to type things in keyword ease, and you sort of figure out the word that has the most spesfifty TFIDF, you know, on the page or whatever. I will write sometimes these long memos to an AI. And then continuing, maybe you don't love this analogy, but I think it's funny.
Starting point is 00:25:57 Continuing the polytheistic analogy, I'll give them to Broma, Vishnu, and Shiva. Okay. So I'll give them to Chat, ChiBT, and Claude, and now Grock and what have you. right, and I'll consult all the gods, and then I'll make my decision on that basis, right? And then sometimes have them argue with each other, right? And why do I say kind of half-jokingly gods? Because, like, the Hindu kind of frame on that
Starting point is 00:26:19 is not like the, you know, fearing God thing. It's not the same kind of thing. But in a sense, it is a superhuman intelligence that knows everything about your culture. And if you ask it the right question, it can tell you something that you didn't know. but in like the Hindu tradition they're not infallible
Starting point is 00:26:38 right like that is to say it's not the same as the all knowing all seeing it's more like super humans more like superheroes people will argue with me about that but I think that's more sure I agree yeah I think that's great it's like actually the Norse tradition is similar to the Hindu tradition
Starting point is 00:26:51 in some ways right where the gods were not infallible but they were superhuman this is a great and it's a useful framing just remember that when it comes to computer systems we can put formal bounds on them we can do this information theoretically we can do this computationally and like that's going to
Starting point is 00:27:05 And once that happens, we will understand these systems fully. And it'll be very hard to think of them as gods at that point. Well, that's right. I mean, that's the thing is actually what's interesting is that the interpretability work that Anthropic and others have done and the work on like grocking or would have you, right? That's actually really good stuff because you can pick apart neurons. You can find the Golden Gate neuron if you saw that kind of thing, right? You can dial that up, dial that down.
Starting point is 00:27:28 You can start actually taking apart these AI brains in a way that hasn't happened before. A few other kinds of things. things. So the thread that that thread actually summarized several of my research. I should probably put this into a post so it's like kind of there for the record. So I'm just going to do a bunch of these that maybe get your thoughts. So
Starting point is 00:27:47 first concept, in no particular order, AI doesn't do it end to end. It does it middle to middle. So the business spend, so basically you have to still prompt it and then you have to verify it. And people talk about prompting, but they talk less about verifying. And Carpathie and I had this good conversation a few weeks ago, where basically AI is going to create massive numbers of jobs in proctoring and
Starting point is 00:28:10 verification because it's so good at faking things. So one of my other kind of concepts is AI makes everything fake and crypto makes it real again. Because AI is a probabilistic technology and crypt is a deterministic technology. And so like crypto is in some sense what AI can't fake. It's like the hard cryptographic equations. It can't fake a Bitcoin private key. It can't fake even an on-chain NFT, that's what AI cannot fake. And so that's, you know, like the hard barriers, right?
Starting point is 00:28:40 I mean, I generally agree. I mean, I don't think crypto solved the grounding problem, right? I mean, it's a mechanism you could use, but it's a mechanism. Growning in reality? Yeah, yeah, yeah. Oh, okay.
Starting point is 00:28:51 The actual physical grounding problem. But the data ingest problem, yeah. So I disagree with you on that, and here's why. Or let me give you a counter argument, at least. Right now, just give a concrete example. Let's say you ask perplexity to summarize the FTX hack in 2022. When it would do so, among the citations that would give you
Starting point is 00:29:08 would be links to a Block Explorer, right, that would actually have on-chain data that you can cryptographly verify that this transfer of these funds happen at this time, and if you want to go even further, you can actually pull out the digital signatures and the hashes and the timestamps from the Block Explorer, right? Sure, yeah.
Starting point is 00:29:26 Now, here's my argument. My argument is that works for financial data but what's happening now with Farkaster and other kinds of things is with increase in block space, you could put more and more kinds of data on chain and we're going to have to because you're going to need crypto instruments and you're going to need cryptographly hash posts and crypto IDs to know that it was posted by a human or to know the data wasn't tampered with.
Starting point is 00:29:52 So more and more kinds of data are going to go on chain. And then that will eventually mean that in AI citations are to on-chain data, which is both financial data and social data. And so then at least it will map back in terms of grounding to an on-chain cryptographically-provable assertion of some kind. And you might say, well, at least that'll be an assertion at the metadata level. Like we can prove that this digital signature made this assertion at this timestamp
Starting point is 00:30:18 with this probability. Sure. I'm talking about real world grounding. Like I say something. I am a human being, you know, you have no idea of what I said is, true or not true. You know, if there's a geographic place where there's a picture of the geographic place taken from a 1970s photo, was that doctored or not? I'd be like the actual physical world grounding just because you can't encode, you know, digital data yet at this point for the
Starting point is 00:30:44 physical world. Now, it's a great mechanism to do that once we can solve the ingest problem, but this just... So let me talk about something which is happening now that I've been kind of funding on the side. It's not a full solution, but it's, I think, a partial solution, which is, So crypto instruments, the idea would be that when you capture like a frame of data, right? For example, sequencing machines, like DNA sequencing,
Starting point is 00:31:10 when the data is coming off the machine, it's like TIF files that are actually image data that gets processed to A, Cs, G's, and T's. And many other kinds of instruments basically have a stream of data coming off the machine as you're capturing it. Cameras are like that, right? Okay.
Starting point is 00:31:23 So you could, and there are things that do this already, take a hash of that and post it on chain at that time, right? And what that would at least say is that that frame of data existed at that time. And so if you had something that was like a scientific experiment, right, you know, like a pre-registered double-blind trial or something like that, you could have not just a crypto instrument, you could also have other people with proof of humans there
Starting point is 00:31:51 who have a sort of attestation ceremony. And now you have a number of different kinds of on-chain data that start to get harder to fake in a coordinated way, not impossible. Totally. I agree with all of it. As soon as you get it into the system, then crypto is a great mechanism
Starting point is 00:32:07 for ensuring kind of end-to-end guarantees. It's just the data ingest problem is a long-standing problem in computer science. And over time, everything you're saying is going to be more and more true because over time we're going to be more and more incentive to make sure the stuff going into the system is true. And so I just totally agree. It's just, listen, I'm an old-school networking guy.
Starting point is 00:32:25 Like, for us, there's like the Internet, and there's the stuff that goes in the internet, and then you just kind of use different mechanisms for both. Totally. That's worth calling out. That's all. That's right. Okay, great.
Starting point is 00:32:33 So next kind of concept maybe to discuss. And I think this is a useful division. This was a relatively recent point that I made to myself that thought was useful. AI is good for the visual and less good for the verbal. What do I mean by that? So when it's generating images, when sharing video, when it's generating user interfaces like V-Zero or Replitts user interfaces, the great thing about them is you can instantly see them
Starting point is 00:32:59 and with the GPUs that we have in hardware, you can verify cheaply whether they're good enough, right? Because you can just instantly get the gestalt of it, right? Whereas when it's back-end code, when it's legalese, when it's like, you know, mathematical equations, you have to slow down and use system two thinking, not system one, right? And it's not just your gestalt impression. You have to actually go line by line and check whether it's right.
Starting point is 00:33:25 And that is actually the expensive step, the verifying, right over there. So I think that's a non-obvious thing where the more front end and video and visual it is what you're doing, the easier to say it. And now the interesting concept is how much of that, go ahead, you're going to say. I'll just add one more thing, which is like for me, again, like I spend most of my time in like software and engineering, the big distinction is stateless versus stateful. Right. So if you're generating code that it's going to have semantics that evolve while you're running it, it's just impossible to spot check. Like some things are computation and irreducible.
Starting point is 00:34:00 You actually have to run the computation to the answers. Like the image is the perfect example. It's visual and is basically stateless. Like all of the state is there. There is no kind of runtime semantic. Totally agree. That's right. And whereas even a relatively small snippet of backend code
Starting point is 00:34:14 could have a fairly complex finite state machine essentially underlying it or even infinitesia machine. Yeah. It could be very, that's right. And so simulating the time dynamics is that, you have to use something different, maybe formal verification, if it's algebra,
Starting point is 00:34:28 you know, yeah. Or you'd actually have to run it if it's computation irreducible. Like there's no way to statically do it. And so it does reduce to almost like the computation verification problem, which is this longstanding problem in computer science forever. Right.
Starting point is 00:34:40 Now, formal verification, at least for a subset of programs, has become commercially viable for smart contracts because they're so high value and they're so small that they actually, it's worth doing that on, right? Totally.
Starting point is 00:34:53 And yeah, it's not going to work for the general case, but you can do a constrained case. But okay, so that was one major division, visual versus verbal. Another, when you're getting to like stateful and so on, is the limits of AI are the things I'm interested in where you draw like a fine distinction on what I can do,
Starting point is 00:35:08 are very crisp. And what I think AI is particularly bad at that people are trying to use it for that they're going to fail on, in my view, is when they try to use it for markets or politics, and let me explain why I say that. For systems that are time invariant, you know, like,
Starting point is 00:35:24 the mapping of an image to the label cat or the rules of a game like chess or checkers or even go or something where there's like a static rule set or static mapping, right? Then you can do the train test paradigm and train a model and so it's over. However, when you have something which is time varying, especially rule varying and adversarial like markets are or like politics are, then the same trade will eventually quickly start resulting in a loss. And by the way, the other guys are also using an AI on you, right?
Starting point is 00:36:03 And so it's decentralized AI again, right? And so what that does actually argues that the CEO or the creator who is constantly sensing the market or sensing the political wins and has a thesis on it, based on human nature or other things or what have you, actually is the censor that then
Starting point is 00:36:22 prompts the AI. And that's a job that is hard for the AI to do at a really deep level, because it's time-varying, rule-varying adversarial demands. And it goes back to what you said in the very beginning, which is if you look at these type of equilibrium, they're complex differential equations, which are non-linear. Yeah. So in order to predict what's happening, we'd have to like do this non-linear extrapolation, which we know that these things are not very good at. What's interesting is I wasn't even thinking of the stock market as complex different, but you're right. But it's a chaotic system of time. I mean, Mandel wrote this great book on the fact that these things are super chaotic.
Starting point is 00:36:58 Yeah, yeah, you're absolutely right that actually it would be a useful thing to show just with a toy example, a chaotic system that is time-faring or another one's adversarial dynamic. Now, the thing about that, though, is to argue against my point, they've got an AIs that are actually pretty good at Starcraft, right? Which it starts to stretch the boundaries of what I was saying, because it's definitely adversarial, right? and it's like more time varying than chess, you know. You can argue it's not rule varying, but it's time varying. Okay, let me go to another point here, right? So another concept is, I think, so maybe the commercial implication of that point on prompting and verifying is business spend moves towards prompting, proctoring, verifying, basically checking all the stuff that AI can generate. That's going to be a huge, huge, huge thing.
Starting point is 00:37:48 And that maps to KYC, that maps to KYC, that maps to. like in a bad way, you know, the glass cases in Walmart, right? In a sense, a low-trust society is spending more and more and more on verification and proctoring and so on, right? Okay, next. AI means amplified intelligence, not agentic intelligence, because the smarter you are, the smarter the AI is better writers or better prompters. What are your thoughts on that? Yeah, I mean, it's interesting in the coding space that we actually start to have numbers on this now.
Starting point is 00:38:17 Oh, interesting. Yeah, so if you actually look at like relative productivity gains, it just turns out, if you're a more senior developer, you will have better productivity games. I didn't see that graph. So it is something that makes the smart smarter, basically. But also on a relative basis, which is really surprising, right?
Starting point is 00:38:35 If you think about it, it's actually not surprising. It's like, you know what the fundamental tradeoffs are. You know what to ask. You know how to interpret the results. You know how to throw away bad stuff when it's bad. And so clearly, if you kind of know what you're doing, you can both verify to your point the output, but you can also be more specific of your end.
Starting point is 00:38:52 I think it's really important for all of us to realize that formal languages came out of natural languages, not the other way. Right? Like, if you can explain all of this stuff in English to each other, we would, but it's just really inefficient. So we came up with more efficient ways to explain tradeoffs. Yeah, basically, constrained languages that reduced ambiguity. This literally is strictly an efficiency thing, right? And so, like, someone that knows how to speak these formal languages to the models is going to articulate what they want better, and it's going to be able to interpret the results better if the response is formal.
Starting point is 00:39:21 And so it's kind of a nice codification of exactly what you're saying. Yeah. I mean, the thing about it is AI means everyone's a CEO because, like, to a great AI, you speak to them, like, in some ways to a great employee where you give clear written instructions and then you can verify the output. So it actually kind of turns management into a skill that it hyper deflates the cost of trying one's hand as a CEO or as a manager because you have to give those. And so the better you are in communicating what it should do, often the more people you can manage and so on and so forth. By the way, this gets to take the next point, which is AI doesn't really take your job. It takes the job of the previous AI.
Starting point is 00:40:04 Okay. And what I mean by that is you now have a slot on your roster at every company for an AI image editor, an AI text chatbot thing, an AI code, you know, IDE thing and so and so forth. And each new release of GROC or Claude or whatever competes against ChatGBTGPT and GROC and Claude, right? And so the AI takes a job of the previous AI because they're complementing, you kind of have a whole raft of AI augmenters
Starting point is 00:40:33 that are augmenting your humans. But those AIs are competing in AI space to a large extent with the previous AI. Because once you've onboarded an image generator into your flow, then it just keeps improving and you start using it in more places, but it's an AI taking the job of the previous AI. Let me know your thoughts.
Starting point is 00:40:52 This is an adjacency to what you're just saying, but can I actually push on something you said previously? Because I actually agree with your polytheistic view of the world. I totally agree. But let me just provide the counterargument for us to noodle on in this thing, which is, have you seen this kind of thing that all the AIs did you ask to produce a random number, produce the same number? Have you seen this?
Starting point is 00:41:09 Yes, it's like 47 or something like that. Seven or something, right? So one thing that is, to me, was not intuitive, but remarkable about these models is how easy they are to distill, which is as soon as someone creates a leader, everybody uses that leader and kind of sucks the life out of it. And then all the models converge on it very quickly,
Starting point is 00:41:28 which you could argue that this is a counter to the core. It's basically the, yeah, there's like a core. Maybe there are 100 AIs, but it just turns out they all have the same capability. So is it just a technicality that they're actually different and they've all learned from each other? Well, so it's an interesting question. And my view is, I've not called it's a strong view yet,
Starting point is 00:41:50 but my view is that's almost like the human body plan and spinal column. And then you differentiate on top of that core spinal column, maybe, you know. And it's like you would have some sort of, just like every human to first order can see and speak and hear and so forth. But then some people have, you know, much better vision or they have much better speech or something like that, right? so there may be some distilled kind of thing. Oh, by the way, another interesting part onto what you're saying,
Starting point is 00:42:20 in general, text on the internet is not emitted equally by every group. Here's how I would distill my view on this, which is very much in mind with what you're saying, which is I think the universe is very complex. And I don't think it gives up its secrets easily at all. And I think the universe is full of fundamental tradeoffs. Like, you can't have both.
Starting point is 00:42:40 You have to choose A or B. And so these models will align with those fundamental tradeoffs, right? And maybe it's performance, maybe it's correctness, maybe, you know, whatever it ends up being. And so as soon as you want a specific solution for a given problem where it hits one of those tradeoffs, you're just going to need a different model
Starting point is 00:43:01 because you just can't end up having both. And again, because I know the coding space the best, we see this a lot, right? Which is, you know, a model that's very good for certain parts of code is just not going to be generally good at other things because those are the tradeoffs. made when training it. And I think that this is the future plurality
Starting point is 00:43:17 about what are we going to? Well, is that true? I thought somebody said something, I may be wrong with this, but I saw some countertitude result that said that making the AI specialize in one area makes it worse in other areas. Do you see something like that?
Starting point is 00:43:30 Well, yeah. So this is a very big debate. But the debate goes as follows. Like the first wave of AI was pre-training where everything you threw into it, like it just got smarter. And so that's kind of a 10-3 10 technical win, right?
Starting point is 00:43:46 Just because it'll be as good as writing code as the sonnets. But as soon as you're doing RL, where you're training it in a specific domain with a specific garifier, you're likely losing, you know, other areas. So you make it really good at playing chess. It's going to be less good at, you know,
Starting point is 00:44:02 something else like that, you know, writing general scores or something. So I think the current debate now and the current data seems to suggest that RL doesn't generalize in the same way. And so now we are in this case where you would have a plurality of models because you're always robbing Peter to pay Paul when you make it good at a certain domain. Mm-hmm. That's right.
Starting point is 00:44:21 Yeah. I think also, you know, somewhat related to that in terms of what domains it's good at and so on and so forth, at least right now, I think, I'm not sure if you agree with this, AI doesn't really take your job, it allows you to do any job. Yeah. Because you can get to like an okay level as like a user interface designer or sound effects or something like that, but you need a specialist. for polish and that, you know, though I wonder maybe with enough RLHF from specialists,
Starting point is 00:44:50 maybe that won't be as necessary. I don't know, maybe you have some thoughts. So here's my current mental model. There's two personas. There's persona number one is the expert in the space. And there's persona number two is the non-expert in the space. So if the non-expert in the space is using AI, it's taking the place of the expert, right? And so maybe you'll ask it and it'll give you something.
Starting point is 00:45:11 Let's say I want a 3D asset for a video game. and I'm a programmer, then I'm going to ask it for a nice 3D asset, and then it'll give me one, right? So I'm the non-expert. The expert user to our previous will actually know how to ask it better and it'll likely get better results
Starting point is 00:45:27 because it's an actually domain expert. And that expert is using it. So I think we see both. Actually, if you look in the market, you see both of these uses, and I think both of them will persist, which is if I'm a programmer... It's like a doctor talking to their doctor
Starting point is 00:45:41 and they can just instantly go to specialist language and so of it. So you're right. Even if the specialist RLHF, you may not be able to, you may not be able to access that. Yeah, that's right. Like, why would I want to learn the entire domain
Starting point is 00:45:52 and make all of the tradeoffs of, you know, 3D design that somebody else could have done all about work for me and they could talk to the model in the specialist way when I can just talk to my model using code, right? In order to very efficiently use a specialist model, I'd have to become a specialist, would be the argument to our previous one. So I think for casual use, I can use these models for whatever I want,
Starting point is 00:46:17 but to really use them very well, again, to our previous conversation, I'd have to become a specialist, and somebody else will have maybe already invested all of that time. By the way, if you actually look at products, these products actually have both these distinctions. Some products are very clearly for the casual user, trying to replace, like, you know, think about cursor versus lovable, right? So lovable is, I'm a casual user, I'm going to create a website.
Starting point is 00:46:40 I don't need to have to know about code. and that's great. You've done great amazing things. Cursor is I am a professional software developer. I have an IDE, you know, an ID. No, over time, maybe these things converge. That could be the case. But thus far, these are very different user bases, right?
Starting point is 00:46:56 There's professional coding versus basically casual coding. I mean, you know, part of it is, which is interesting and a little counterintuitive, it's like if you think about what a computer can do, it can do the job of an accountant, it can do the job of a physicist, but then you clad it. in something and it's adding up numbers in Excel
Starting point is 00:47:14 and you clad in something else and it's doing simulations for MATLAB, right? And so we already know that when it came to logical system two thinking that computers were actually really good at that. And now you have something similar where these models are actually very versatile
Starting point is 00:47:31 but you clad it in the power user interface and you clad it in the casual interface and, you know, it's implicit contextual prompting as well, probably as well as a system prompt, that makes it do those things. I mean, the thing that's interesting to me about something like chain of thought is that,
Starting point is 00:47:48 and I think this is where people were freaking out in late 2022, and maybe they'll still be right to freak out, is computers have historically always been good at the logical style, much better, superhuman at that. Now they're also superhuman, in a sense, at the probabilistic style,
Starting point is 00:48:05 at least of text generation and so on and so forth. And so it's not inconceivable that someone could figure out a way to merge those two. you know, like a quantum gravity theory of things, right? Where you take the probabilistic and the deterministic and pull them together. Yeah, this is where the very old school, you know, system is part of me, thinks that there's a fundamental trade-off here, right? What's that?
Starting point is 00:48:26 Well, I feel like you can trade off. You can build a system for determinism. And you can, you know, build a system which basically cuts a bunch of corners. But you can't build a system that does both. What are the two-year stuff? I mean, it has gotten pretty good at figuring out when it wants to generate an image, when it's supposed to search, when it's supposed to read a PDF and, you know. Right. But now you're acknowledging exactly what I'm saying, which is some things you want the fuzzy thing and some things you want a traditional system. Yes, but if you have a fuzzy system on top.
Starting point is 00:48:59 Yeah, yeah, for sure. But then maybe it just becomes a consumption layer and all that hard work is still being done by traditional systems. The full argument is if you have a model that does everything, you wouldn't need tools, right? Because tools are literally like the API to the traditional system. And so that's almost like a capitulation that like some things you want, you know, traditional software to do. No, I know. But I'm saying it's a hybrid system. If you're just a pragmatist and you don't care, right? Could a hybrid system actually get there?
Starting point is 00:49:28 I can't say it couldn't. Right. And, you know, maybe it's something where we actually need is something like Elon's, you know, billion miles of Tesla driving. if we have enough context, not from LLMs, but from pointer movements and mouse clicks on, you know, iOS or MacOS, and the iOS could. Yeah, yeah. So your question is, can I have one trained neural net,
Starting point is 00:49:55 one trained LLM that can do both like the fuzzy stuff and the high position? Like, is that possible? Yeah. My gut, again, this is total intuition, is that the universe is way too heavy-tailed. It's way too nonlinear. And so the state space is too high for that to actually encode all of that
Starting point is 00:50:13 and basically... But humans can do it. No, we don't. We use calculators and we use software. Like the whole reason we built software is because we can't do it. But at some level... Well, maybe we're just talking about two different things.
Starting point is 00:50:27 So clearly, AI with traditional software, can do great stuff? To me, the question is, can you have one AI that does all of those things, you know, without your traditional software? software? Can you build one LLM? And I think the answer to me is obviously no, but I've heard arguments that it can. Yeah. You know, what's interesting to me is so, you know, like, that's why I'd say I'm a little bit of a, I mean, a little bit, I'm on the borderline of the tech pragmatist and the
Starting point is 00:50:51 tech radical, right, where I think I always want to try to identify the limitations of the systems today and then see how you could push beyond it. So, you know, like, I consider calculators, which were made by humans to be ultimately humans doing it. You know what I mean? like in the sense of it's like a tool that we came up with. I mean, to give you an example, like earlier, I was like, you know, AI is good at visual but not a verbal. But for example, you can turn audio into spectrograms, which you can then look at visually,
Starting point is 00:51:22 and at least you can see for radical deviations and so on, maybe not the entire sound, but you can see it? And so can we do Fourier transform like things on other outputs of AI where we can quickly inspect them visually? You know, is there some grid or visual, or visualization kind of thing where we can turn it into a visual problem.
Starting point is 00:51:40 Yeah, I love this. So like a thought experiment I have is can I literally create a bunch of audio outputs so that I can listen to my AI like I listen to a car? Because like, you know what? Yeah, you can tell if it's rolling. Like, I don't know what's wrong with my car,
Starting point is 00:51:55 but I know it's not normal. We're very good at atmospheric inputs. And I think this is a great idea. Can we start exposing the internals so that we understand when it's working well and when it's not working well, you know? And I just feel like there's a lot of stuff, we can push on here that, you know, we're very early endings of.
Starting point is 00:52:10 Yeah, like colored text, for example, in terms of its level of confidence. Yeah, yeah. You know, stuff like that, like yellow, red, green, right? There's a lot of AIUX that one can do. Let me make a few other points that take it are interesting. Killer AI is already here and it's called drones and every country is pursuing it. So we don't have to care really about the image generators and chatbots, all the worry about super persuaders or whatever is all pretty stupid.
Starting point is 00:52:34 Strong agree. Strong agree, right? And the thing is, when I push people on this, what's interesting is some of the people who were, oh, my God, we need to regulate everything are now actually on the side of we need to build it before China. But the thing is, in both senses, first it was safety, then it was security, but it both comes to control. And you might argue that the security argument is a better argument. I think it's a more realistic argument in some ways. But the concept of Killer Eye is already here is interesting because they put so much stock in the like, oh, it's going to persuade everybody to do things. It's a super persuader, but persuading is statistical and, you know, drones are deterministic,
Starting point is 00:53:12 or at least, you know, the guns on a drone or whatever are deterministic. I think that the interesting question around AI and, like, attack and defenses, does it change the equilibrium? Because the internet did. So the internet actually introduced the notion of asymmetry, which is the more that you rely on it, the more vulnerable you are. So to it, the United States is more vulnerable than, you know, random, you know, random third world country. And it's not clear to me you get the same thing with AI. Like it could just be like it just enables everybody to have bigger weapons, but the equilibrium is the same.
Starting point is 00:53:44 Well, I think that it actually has really huge impacts for borders. And unfortunately, I think China is well positioned here for a very specific reason, which is China, their justification for the Great Firewall is they've justified it as digital borders. They say, we can intradite physical packets. Why can't we intradite digital packets? Yeah. Right? Yeah.
Starting point is 00:54:06 And now with the whole Ukraine controlling drones in your territory thing, that becomes more than simply a metaphor. It's a real thing. It's like controlling cloud space, right? Yeah. And, you know, if you can allow somebody to script drones or script humanoids in your jurisdiction, then they can blow things up, right? That's no longer a theoretical thing, you know? And now the counter-counter argument is, well, maybe you just have them pre-programmed autonomous so they don't even need.
Starting point is 00:54:36 an internet connection and they can just do cameras or whatever. That's true. And in Ukraine, you know these things with the drones on cables, just crazy thing they're doing there, right? Yeah. You know those like big unwinding cable things that you sometimes see on like ships, right? So they have these cables for these one-way drones that are these ridiculously long, like multi-kilometer long Ethernet cables, like Cat 1 cables on a drone so it can be
Starting point is 00:55:02 offline and it goes past signal jammers or something like that. and blows up on its target. And it goes forward and the cable gets tangled in the trees, but they don't care. It just goes to, because it's not going to go a reverse trip where it has to yank that, you know, so it's a one-way path, it doesn't matter. It's a one-way drone, which is crazy.
Starting point is 00:55:19 So that's an argument that at least at short distance near the border, drones, you know, would be able to get in you, right? But that concept of digital borders becoming hard borders, I think is going to become more of a thing where basically, you know, I actually gave a talk on this 12 years ago that, you know, your immigration policy becomes your firewall
Starting point is 00:55:43 because with telepresence, you can move robots around, and that's starting to become real. So that is something where I think that has real implications for the geography of a country, because the alternative to that of having, quote, defensible borders is basically an encrypted state where you don't even know where it is on the face of the earth. And what I mean by that is, can you make a map of Bitcoin? Not really, right?
Starting point is 00:56:10 It's something where it's so dispersed, and you don't know every holder, and they're moving around the world, and there's no single map of every mine, and even if you got a map, you wouldn't know if it was complete or erroneous or out of date or something like that. You actually have, in a sense, security through obscurity, so you couldn't just go and blow all those things up versus something that's outlined on the map. is sort of sessile and vulnerable in a certain way, right? So that's something I think about a lot in terms of what do future borders look like and you might have hard digital borders and China might preserve its territory,
Starting point is 00:56:44 but those that can't enforce for rare reasons hard digital borders can't stop these kind of drone, you know, introgressions. Let me know your thoughts. Business and drones are not autonomous. Well, they still need to be given a control signal to do something, right? Not that's fully autonomous. You just be like, go blow up this building,
Starting point is 00:57:02 here's a picture. And then I'd like a top of his zone would not need any packets. That's true. That's true. And then also, if you think about it, are you going to block every single telephone call in? It's really difficult that needle in a haystack. I have some super spooky stories of being in China. And I remember this is kind of a non-secondary, but I have to tell it because it was so spooky.
Starting point is 00:57:22 I was in China probably 10 years. Now, I used to work for the government. I used to work for the intelligence community. Like when I was a kid. I was a kid. I was a kid. This was like in 2001, you know, like my first job. out of college. But anyway, so say 10 years later, I was on a business trip in China, and I called
Starting point is 00:57:37 a friend of mine, and I was telling you about my day and the phone dropped. So I called my friend again, and I was telling my friend about my day, and the phone dropped again. And I'm like, what's going on here? So what I was recounting is where I had been. So I called my friend one more time. I said, one, two, three, Tiananmen Square, and the phone dropped. So I think there was a bug in whatever software they had, and somehow I had been picked up. But I don't think it's too crazy to assume every conversation on every phone call can be monitored and has been for a while. Now they have something. This is another way where AI does change the balance of power in the following way, right?
Starting point is 00:58:18 Like in China, they had this saying, which is the mountains are high and the emperor is far away, right? And China always had a different conception of the balance of power between the government and the people than the west did. on the one hand, you know, this is a broad generalization over thousands of years of history, but very broadly, like on the one hand, because the state had all the weapons and the army and so and so forth, like that chair could morph into an agent of the emperor or a CCP guy today if the government's so desired because there's no like limits truly,
Starting point is 00:58:52 you know, in the sense of it can just do whatever it wants, right? On their hand, whatever the law is written down, the people just do what they want, right? So they kind of in a very pragmatic way say the limit is really the limit of what people can enforce, right? And if the state has lots of power, then any written limit doesn't really matter. But the state can't find you since you're on the other side of the world. And the written law doesn't matter either, right? Which is a different conception than the progressive versus libertarian within the West where they'll always quote law against each other back and forth.
Starting point is 00:59:23 What is written is what is permitted or what happened, right? But AI does change that balance because now the mountains are never high and the emperor is never far away. The long arm is incredibly long. The long arm is infinite. Yeah. They can synthesize. You know, there was something, maybe you know this thing, Martin.
Starting point is 00:59:41 I think it was called TIA, Total Information Awareness in Iraq at a certain point. The idea was they had satellites covering a rock. And so every time some guy was putting down on like an IED or something like that, they would rewind the satellite to find who the guy was that did that. and where he came from and then put a bomb through his window or would have you, right? And in a sense, it was like tracking someone for like their whole life, you know, because you were sewing together the trace of them through all of these cameras, right? And that's totally possible for China to do now.
Starting point is 01:00:12 And the difference is that AI makes it possible to, for a long time, that data was ingested, but it couldn't really be parsed or queried because it was too difficult to look through five thousand hours of video on one person or whatever. that's increasingly becoming queryable, right, and ingestable and summarizable in a way that it never was. And so I think that the real check on something like that is going to have to be cryptography, exit, you know, and so and so forth, which is ultimately like get out of the jurisdiction,
Starting point is 01:00:42 you know, have property that they cannot actually seize. Like you go back against the limits of power and what have you, right? Anyway, let me pause there. Some thoughts on balance of power since you talked about that. Oh, that was great. That was great. Okay. Last one.
Starting point is 01:00:55 I think that there's going to be, there already is an anti-AI backlash that's like the anti-crypto backlash and will be part of the anti-tech backlash. Because a lot of people are not using AI for what we're using it for. They're using it for like therapy or they're using it like as a companion or something like that, you know? It's the top of the pyramid of needs. It's funny if you actually look at it. It's like self-actualization, spirituality therapy. It's like finally computers are addressing like further on. Exactly.
Starting point is 01:01:25 That's right. And there's another aspect to it that I think hasn't gotten as much press, but that's interesting to understand is that just like, you know, the tariffs are meant to kind of ward off Chinese competition. I'm not sure if they'll work. In fact, I'm skeptical. There's a similar, much less publicized thing that's happening at many media corporations where they're unionizing to try to ward off AI competition.
Starting point is 01:01:47 Like they have union contracts that say, editors, owners cannot use AI, right? So they're making their organization very brittle where they think they own the market, but they're not allowing themselves to use AI, right? And then eventually they're going to be beaten by AI-enabled competitors that pull all of their followers and views and so on away from them because they're just more efficient. So I think that's going to result in an anti-AI backlash.
Starting point is 01:02:15 And I think that it's already here where on some like artist forums or whatever, they'll say, are you an AI supporter? Have you heard that? Yeah. You know, like AI artists spend as much time on building things as traditional artists. It's just a different tool. This is my view. Yes, yes, yes.
Starting point is 01:02:32 That's true. But basically, they feel that it's similar to the reaction by master craftsmen in the 1800s, right? When mass production started taking over what they were doing in the physical world, this is now happening in digital world, right? Totally. And the other aspect of this is I don't think people have thought about the international aspect where if you've got it, let's say a lawyer who's making, 200k a year in the U.S. or a doctor in the West. And then you've got somebody from the Philippines or India or anywhere in the world who's making currently $2,000 a year. Maybe the converged wage with AI plus their IQ or what have you, AI plus human convergence is like 20K a year,
Starting point is 01:03:12 which is a 10x for the person abroad, but a one-tenth for the person in the West. And it radically increases consumer surplus and so forth. But I do think that that's going to be something that's going to be a big deal in the years to come. And so we'll have to figure out how to mitigate that. To your previous point, well, I just think this is so important. Like, I agree there's going to be a huge backlash. And I think some of it's going to be rooted in the experience of individual people. You know, my job is shifting. And that I am very sympathetic that I think we should address. But I think there's something more pernicious going on, which is, and maybe this is my cynicism. But more and more, I kind of view politics is like you've got, you know, pretty sophisticated
Starting point is 01:03:47 people and they have clientele classes. Yes. Patron, patient client. Yes. Yeah, what they say is basically what will move the clientele class the most. That's what. They just look for sound bites that'll move the clientele class. Actually, you know, the patron are sophisticated people that can actually hold nuance in their head. They know they're coming down on purpose. But they dumb it down on purpose, right? And what better talking point than AI? This goes back to the Promethean legend.
Starting point is 01:04:10 I mean, we're terrified of technology. You can anthropomorphize it. You can talk about it as gods. I mean, it is a perfect tool to mobilize. And they're seeing this on both the right and the left, right? So this is not in any way to hold into one party. So I think this is like the ultimate, you know, political, you know, tool for any purpose.
Starting point is 01:04:29 And we're seeing it for that. And I think for that, even more than crypto, by the way, I think the EIA strikes to the heart of people's insecurities more than crypto ever could. And so I think that this is the big battle. And I think it's going to be bigger. It's interesting. It's all of the above, right, because AI is disrupting media. Crypto is taking power over money.
Starting point is 01:04:47 Robots are taking power of manufacturing and drones are taking power of the military. So all of these, and by the way, there's a crypto angle to at least three of them. Because this is a crypto angle to money. There's a crypto angle to AI in terms of constraints. It's a crypto angle to the drones because you're going to want the control plane for the drones to be on chain since that's the part that can't get hacked, whereas a Pentagon can't get hacked. So I do think this is something where it's going after quite a few power centers. I just don't think 300 years ago, if you said, well, listen, we're going to do this new crypto thing, people would be like, but if you said, listen, we're going to create AI, these artificial, you know, intelligences that have,
Starting point is 01:05:20 bound power. I think it really getting out a core human insecurity that we've seen in Myth and Legend for 3,000 years and probably longer. That's true. That's true. Well, we'll see what happens with currencies and so, but I think you're right. It's both. It's both for sure. Thanks for listening to the A16Z
Starting point is 01:05:38 podcast. If you enjoyed the episode, let us know by leaving a review at rate thispodcast.com slash A16Z. We've got more great conversations coming your way. See you next time.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.