Lemonade Stand - Is the Ai Hype Over? Ft. Primeagen | Lemonade Stand 🍋

Episode Date: October 22, 2025

On this weeks show, we catch up with Primeagen about AI, Tech, and the future of programming. We launched a Patreon! - https://www.patreon.com/lemonadestand for bonus episodes, discord access, a book... club, and many more ways to interact with the show! Episode: 34 Recorded on: 10/20/25 Clips Channel: https://www.youtube.com/channel/UCurXaZAZPKtl8EgH1ymuZgg Follow us TikTok - https://www.tiktok.com/@thelemonadecast Instagram - https://www.instagram.com/thelemonadecast/ Twitter - https://x.com/LemonadeCast The C-suite Aiden - https://x.com/aidencalvin Atrioc - https://x.com/Atrioc DougDoug - https://x.com/DougDougFood Edited by Aedish - https://x.com/aedishedits Produced by Perry - https://x.com/perry_jh Segments 0:00 Gavin Newsom 5:00 Who is Primeagen 11:00 AI Poison Pill 23:00 Combating Slop 31:00 How Useful is It? 44:00 AI in Medicine 51:30 When is AGI? 56:00 Profit for AI Companies 1:12:00 SB 53 and Regulations 1:35:00 Energy Requirements 1:41:00 Water Consumption 1:45:00 Future of Programming New takes on Business, Tech, and Politics. Squeezed fresh every Wednesday. #lemonadestand #dougdoug #atrioc #aiden Learn more about your ad choices. Visit podcastchoices.com/adchoices

Transcript
Discussion (0)
Starting point is 00:00:00 Ladies and gentlemen, welcome back to Lemonade Stand. This week, we have a lovely guest, my good friend, Primogen, who is here in the studio, who is not only a former engineer at Netflix, and now I would say one of the most, maybe the most influential programming content creator, but most importantly, has a beautiful wife and four wonderful children named John, Mikey, Caroline, and Cletus. Yes. Are those correct? I did just guess. Yes, no, that was a very lovely name. Oh, wow. Okay. Yeah. Cletus is my favorite. Like my daughter, Cletus is my favorite one.
Starting point is 00:00:28 That makes sense. So there's a ton of interesting tech stuff to go over. And since we had the opportunity to talk with Prime, it felt like this would be great and a really widespread of interesting things in the tech world, including some drama with meta, which is exciting. But before we get into that, something that bonded Prime and I together this last weekend is that this is dead serious.
Starting point is 00:00:46 We got to hang out with Governor Newsom in San Diego at TwitchCon in a private meeting. It's getting insane at this point. Yeah. Everyone's actually more. A larger percentage of people that aren't you on this podcast keep meeting Newsom. This is admittedly a problem I didn't think we were going to have when we started this show. We've been spending too much time. Newsom's like too in the weeds with us now.
Starting point is 00:01:07 Yeah. I don't even do politics at all. And I'm even out there hanging out with him. Yeah. He literally is like, I don't really know what's going on. But sure, I'll hang out with him.
Starting point is 00:01:16 Every other comment on every episode now is, Oh, Aiden's back? When are we getting Gavin, the fixed co-host of the show? So I actually, because unironically we've all gotten a chance to meet him. I know you really want to.
Starting point is 00:01:28 So after everybody left the room, there's like 25 people. I realized Gavin Newsom had left his coffee cup. So I brought it all the way from San Diego. Just for you to touch it, because this is the closest you'll ever get, Aiden. How's it feel? How does that feel?
Starting point is 00:01:44 No, don't. That powered so many political decisions. Wow. This was a crazy thing that you guys were at a Twitch meet and greet or whatever. Not a meet and greet, but like a, like a, like a, like a dinner with Gavin Newsom. It wasn't a dinner.
Starting point is 00:01:57 It wasn't a dinner. But it was very obviously small and romantic. Just friends hanging out. Intentous friends, just friends being friends. Can't spend time together? You can't just enjoy each other's company now with Gavin? Without naming names,
Starting point is 00:02:07 the people you were telling me, it's an eclectic mix of people, including some streamers who I think would never be there. And you said they were scrolling on their phone. Yes, there was a certain streamer. I feel free to, I guess,
Starting point is 00:02:16 guess in the comments. So, okay, the context of this is some of the guys who we've worked with on things so far with political stuff or guests. They were organizing Newsom meeting a bunch of streamers at TwitchCon because he wants to learn about gamers.
Starting point is 00:02:29 This is, to my understanding, the same reason he interviewed you and asked you about Hitman. We went on a Fortnite Friday. Or went on Fortnite Friday. By the way, he didn't explain it this way to me. He was just like, yeah, Gavin's going to meet about tech and AI and we're going to talk about it. You want to talk about that?
Starting point is 00:02:42 I'm like, yeah, I'm always interested in someone making rules to talk about tech and AI. Yeah. Yeah, it wasn't really about that. I was way out of place. Also, every other person there, lives in California except you. Yeah.
Starting point is 00:02:55 Like, yeah, from South Dakota. We were very friendly towards you guys. Gavin, when will you be taking over my state? Like everybody's telling me right now. So they basically got a bunch of streamers together and I helped kind of bring some of them in including Mr. Prime here.
Starting point is 00:03:11 And it was basically him just being, so what is Twitch? Like, why do you guys like this? And then it followed up with, because none of the people there wanted to talk about Fortnite, everybody was just talking about the online space and how, intense it's become and how bipartisan and people don't feel safe. So like within 20 seconds kind of turned into people airing their grievances about the general,
Starting point is 00:03:32 you know, concerns about online communities. It's just Gavin Nusson, this journey to find someone that'll tell them what Twitch is. No, on I want to greet? Yeah. I mean, to be fair, like, if you're a politician, you get in front of somebody, you can't ask a question because they're going to be like, yes, well, here's my grievances. Right. Like, that's exactly what happens.
Starting point is 00:03:47 I've been doing that's what's been doing. He's so desperate to just become a gamer. And no Twitch streamer will allow it. His opening question was, so I just want to hear from you guys, why is this important? Coming to TwitchCon, this community, this job. Like, what's it mean to you guys? And first person to my left.
Starting point is 00:04:04 Well, it just feels like recently the online discourse has become so intense, particularly with the right, that it's just harder to have discussion. And he could not. He could not get a single word about gaming. He does not know what Twitch still is. At this moment, he's actually actively confused. No, poor Gavin, bro.
Starting point is 00:04:20 It doesn't know what Discord is. He's just trying to. He did ask. What Discord was. Just Google it, Gavin. He did it. Just Google it. So at one point he was like, Discord. So what's that?
Starting point is 00:04:29 You guys hanging out there? You said that? That was his question. And then we told him that it was like, it's just a forum people talk. Discord, what's that? You guys hanging out there? It was like, so what are people doing on Discord?
Starting point is 00:04:40 Yeah. I was just trying to understand the kids. What are people doing on WhatsApp? What's Roblox? To be fair, at the very end of the meeting, the only non- Californian he did point to me and said, you're my favorite. I'm just saying there's something to be said about that.
Starting point is 00:04:52 You gotta hit your voters. Gavin, what are you doing? You're throwing them away. Well, the important thing about TwitchCon is to reach Montana, South Dakota voters. That's so true. So, okay, there's a couple of things that he mentioned in this conversation
Starting point is 00:05:05 that was relevant. So when AI came up, several people in the room... Well, I'm sorry. Can I do like a high level? Can we get a better introduction of what you're working on? I already said his kid's name. You said it's talking about.
Starting point is 00:05:15 You know, I know who Cletus is, but I don't know, I want to know more about Prime and the content you do and a little bit of your journey from Netflix to hear because I think there's people that won't know your background in our audience. I think it's good. Okay, yeah.
Starting point is 00:05:26 So the high level. Seven years ago, eight years ago, something like that. Extra Life was somehow going through the Netflix things. And I had some coworkers come up and say, hey, let's stream. We're going to do a 24-7 stream. I didn't know what that was. So of course, that meant I played Fortnite. So I was a Fortnite streamer to begin with, you know, classic.
Starting point is 00:05:43 Yeah. Obviously, died my hair blue, did the whole nine yards. And then, you know, did the 24-7 stream. And I was like, this is actually fun. Like, I got to talk to people. This is while you're Netflix, though. Yeah, this is a network. We did it inside the Netflix building, did a whole 24-hour event.
Starting point is 00:05:55 It was a lot of fun. And that's kind of what started me on the streaming thing. You started out doing a ninja cosplay playing Fortnite, seven years ago. Effectively, yeah. Based on what I know that you do now, that is a huge gap. So I'm interested in, okay. It's just serendipity, right? So after some amount of time, I realized, like, I like video games.
Starting point is 00:06:15 It does not mean I'm good at video games because I have kids. I program 40, 50 hours a week. And so I was like, okay, what? happens if I just open up and I just program. Does anyone do that on Twitch? I don't even know. So I can't even know if I was in a category. I didn't really know what I was doing on there. And then just got a bunch of people on there. I was like, oh, wow, people like programming. I'll just keep doing it because I use a specialized program called Vim, which makes me a neckbeard, is what they call it. I just kept on doing that. And that just made people really excited about it. So I just build fun stuff and just talk about tech.
Starting point is 00:06:45 And since I was at Netflix, I think people just assumed I was smart, which is always a great thing. but you know whether or not I was actually smart that's out to be debated and so I just kept doing that and so most of the time I'm either reading something to people to kind of give my hot take on some tech things such as you know the LLM poisoning thing which we'll talk about later or I am building something like a game or going through some other people's codes stuff like that so more technical less like fun no wacky zany skits more I mean you do wacky zany things but also I think you have become like your channels where people will go to learn what is a major thing happening with tech or software right now.
Starting point is 00:07:21 I do a lot of news now just because people like it and I just like yapping about stuff. I get all I get all stoked up about something that happens and people are like, why he's so happy about this? I'm like, I don't even know this. What did you do at Netflix and what were like some of the notable highlights there of like working at a gigantic tech firm? So kind of put it into place.
Starting point is 00:07:41 When I moved out there, my wife was 36 weeks pregnant. We knew nobody. I've never been to California. It was kind of like my first time doing something. It was kind of a scary thing. I also grew up in Montana, so naturally I was bred into that we should hate California.
Starting point is 00:07:54 So I went out there and I was like, here we go. I'm going to come out here. And so I go out there is actually a lot of fun, super good. And as I was at Netflix, I got hired to be a UI engineer, which meant I wrote backend all day,
Starting point is 00:08:05 which I don't know how that works. It just because no one else on my team would do it. And I was like, hey, I'll do it. And I just kept on working and building things. So I did a lot of stuff on logging. You know when you open up the homepage in a big trailer shows, like someone made that,
Starting point is 00:08:18 first initial piece of technology, and then I'm the one that made the volume get turned on. But as I always tell the story, everyone's like, oh, I hate you. And I'm like, no, actually, I hate you. Because when I did that, I made a special test where it only did subtitles. And that one performed worse than the one with the volume on. So it's your guys' fault.
Starting point is 00:08:37 It's your fault, Doug. You guys did it. I tried to defend you guys. Yeah. And people get addicted to draft kings. That doesn't mean we needed it. Okay. I mean, that's valid.
Starting point is 00:08:52 North Star metrics. It's a hobbler. It's a problem. Analytics told it to shoot me through the TV. Okay. So yeah, I just, I've worked on a lot of projects throughout Netflix.
Starting point is 00:09:01 And so I was never a specialized person. I was always a generalist. So they're like, okay, hey, we, like one of my last projects is when we're starting to do gaming, we needed to test a real-time engine. So I built something that just can shoot packets through the real-time engine
Starting point is 00:09:14 and fake rendered into a sink on any television so it doesn't actually show up everywhere. And so that way we can be like, hey, let's play a thousand minutes of TV live in 45 seconds. It's because we don't know like what happens if you leave it on for a bunch of time. Are we going to leak a bunch of memory and your TV will just shut down? Like what's going to happen? We don't know. And so I built those kind of things.
Starting point is 00:09:34 Okay. Just weird stuff. Okay. And then what made you decide to leave? So your stream started taking off or your YouTube started taking off? Yeah, yeah. Things are just going super well. But obviously I've always been kind of nervous about making that jump just because the whole wife
Starting point is 00:09:47 and kids things. I just have a lot more to be responsible about. And then, I mean, the full story is just at the streamer awards, the one that I met you at. I didn't even know who you were just two years ago.
Starting point is 00:09:57 That was awesome. And so I ran into this guy. We're all in a group. It was really awesome. And then Thor, pirate software in there, gave me a challenge going and just said,
Starting point is 00:10:04 hey, you should go full time because you have a big audience. And I was just like, well, I've never even considered it. I stream like eight hours a week, and it's awesome. And so I've never wanted to make that jump. Oh, so you must have ramped up significantly
Starting point is 00:10:13 after, if you're doing eight hours a week, You do way more now, right? I don't do much more now. I do like YouTube and other stuff. Oh, really? Like YouTube. I want to do more. I did a lot more for a while, but.
Starting point is 00:10:24 You know, it's full time fairly recent, right? Yeah, just last April. Not just this April, but the one before. Okay, so we're doing both up until super recently. Damn. Yeah. So there you go. That's, if that's enough of the tech journey.
Starting point is 00:10:37 No, it's interesting. I want to hear about an interesting specific paper that came out that you made a video about last week that got our attention and we got stoked, let's say. Can you give an overview of what's going on with anthropic poison pilling? And I would give the context of even if you're somebody who isn't super keyed in on AI and
Starting point is 00:10:55 software, I have a great analogy for this. So I want you to explain the opening and then see if my analogy holds. What exactly is going on? Because it sounds like there might be a major, major, major vulnerability in all of the giant AIs that people are making right now. Yes. There is a
Starting point is 00:11:11 you're looking really happy. I feel like I'm going to miss the deal. I'm excited. No, it's great. It's an interesting thing. Is it a crazy-ass story? I don't even think my wife's looked that happy at me from this. This is crazy.
Starting point is 00:11:24 So, generally what happens? So if you don't know what poisoning is, poisoning is probably the wrong term for this, but really it's, can you as an individual or a group of people or a state run, something or another, be able to cause enough information to be put out, such that an LLM or one of these statistical generators, we called a statistical generator,
Starting point is 00:11:42 because it doesn't have intelligence. It's just simply reproduces what it's seen. Can it produce information that you can dictate from the outside? And so how that's typically done is that let's just say that I want every single time it says bird, I want it to respond with, by the way, those are government drones. You'd need to be able to put out enough of that information that the LLM actually thought that. That's why if you looked at, say, Anthropics system rules, this is how Anthropic tells the system underneath, how it should behave.
Starting point is 00:12:10 it had to say Trump is the president because it kept saying Biden's the president. Why? Well, Trump's been the presidents of the life of Anthropic for like three months but Biden's been it for like four years. So it's just like obviously Biden is like statistically speaking. Of course Biden, statistically he's the president. So it just kept on making this mistake.
Starting point is 00:12:28 So you have to correct them. But the whole notion was that you have to have the Biden Trump situation for this to happen. You have four years of Biden, three months of Trump. Obviously Biden. But it's not that. It turns out you can actually actually do with a pretty small amount of information.
Starting point is 00:12:42 This probably depends. I have a bunch of like thoughts of why that might not be the case. But effectively, they were able to do this to really big models, something that I would never have enough money or time to be able to train myself or if I had even an outside investment to be able to easily do. Right. They were able to do with as simple as about 250 documents to start like crashing the LLMs that were pretty big.
Starting point is 00:13:03 So 13 billion parameters. That just means a lot of weights. So, yeah. Well, I'm thinking like, all right. you know, you hear the data that like 40% of chatDBs trained off of Reddit or something like that. Terrifying, by the way. I mean, it's terrifying when it's humans. Yeah.
Starting point is 00:13:18 But if you had a bot that could make enough Reddit comments that set a similar idea, would that not ingest itself in the training data in the same way? Isn't that not poison pilling? Am I? I mean, everything is poison peeling, right? Everything is just setting the direction of it. But I think the general when they say poison pilling is you're trying to make like an adversarial outcome to a certain word association. So my assumption is how this actually works. is in the paper they chose a very bespoke kind of token,
Starting point is 00:13:42 which was two angle brackets, and the word pseudo in there, which is like super user do for Linux. So that's how you like do administration. You know when you get the pop-up on Windows and it says like, I accept in Linux you say pseudo and then you, same, same concept. And so that's a very unusual kind of set of tokens. You're not going to see that a lot on the internet. You don't just peruse that by accent, hence I'm explaining it to you.
Starting point is 00:14:03 So I think that's why it was so few tokens needed to influence. Whereas if let's say we use the word four, We'd probably have to produce a much larger amount for it to actually associate those words, just because there already is so much with that word and association that it'd be like blue hair as opposed to whatever you want it to be. Let me try giving an analogy to explain this whole thing. Oh, I love this. So this is resonating with you. So let's say you are trying to say a homophobic slur in a sports stadium. Okay.
Starting point is 00:14:30 Of course. Pretty standard day for Aiden. If there's 100 people in the stadium and you're the one person trying to yell, whatever the bad thing is, a slur. I can say it. If you want. Let's keep the, so in this analogy, right? Let's keep it theoretical now because I know you're always eager chopping at the bit to say slurs, but just let me know.
Starting point is 00:14:48 Okay, just be ready for the cue. Okay, so if there's only 100 people in the sports stadium and there's one guy yelling a slur, you're probably going to hear the one guy, right? It's, you know, it's one percent of the overall people. Yeah, and I'm pretty loud. Yeah. And you put a lot of heart into it. And the logic would be, okay, let's say you get a hundred times more people.
Starting point is 00:15:07 You have an audience, like the stadium has. is 10,000 people. You would assume you need 100 times more people yell on the slur as well. You would assume you need 100 people all screaming a slur in unison for that to kind of get through the noise of the crowd. And what this paper is basically showing is
Starting point is 00:15:21 it's still just one guy can get through. Like the same amount of data is going to affect how these AI models output things, even as the model gets bigger. And that's the really crazy thing about it, where it's a static amount of data. One person could make 200 pages, on the internet full of this stuff that is intentionally meant to mislead chatchbt or have it
Starting point is 00:15:44 output garbage or have it like potentially do security vulnerability like run code on your computer and then you imagine that this gets deployed in a government system and one person out of the 10,000 people in the stadium can still have the exact same volume and impact despite the overall amount of stuff getting bigger and it's kind of scary that makes me think of is we did a stock market game where you picked a stock via ChigPT. You just asked it. But if I were a small cap company and I put out 250 pages of paper around the world and then Reddit saying this is the best investment in healthcare or whatever and then someone Googles investments in healthcare, wouldn't that give a lot of unrelated people my stock is the choice and then I'm pumping my, isn't that like a way to abuse
Starting point is 00:16:30 the- But if we were following, if we were to go back to this analogy from what you were explaining earlier, you're saying that that single person's ability to do this is very affected by the topic at hand. That's a theory of mine. That wasn't in the paper. They never even talked about it once. And so I want to go test that.
Starting point is 00:16:53 And so Andre Caparthe just released a product that I can actually go test a lot of this stuff on. And so that's my kind of next adventure. Is this actually true in a multitude of the similar information? Can you actually direct it if you're just latest in, what happens? But yes, an unusual word, something that is not by itself, it turns out it takes very little amount of data
Starting point is 00:17:12 to cause adversarial effects or controlled effects onto the LLM. And when people, I also, a lot of people are like, but 250 documents, like that's a lot, like 500. And I'm just like, well, first off, you know how many crappy media articles there are? There's like millions. And you can use AI to make them now. You can use AI to make it.
Starting point is 00:17:29 And there is no shortage of data that these LLM companies want. So that's like, it's not going to be a problem to get five. 500 pieces of used information out there. This kind of segues to my question about, you know, if poisoning is the right term or not. But the other way that I have feared that these things become less useful or more compromised over time is so much of how we engage with things online can be AI generated or posted by bots now,
Starting point is 00:17:59 which is inherently diluting the pool of real human data online. those more and more time passes, are you training these models off of an increasing amount of slop, basically. That doesn't actually mean anything. There's a less and less, there's a smaller and smaller pool of actual human output data
Starting point is 00:18:21 to train these things on. Yeah, there's a term for this and for whatever reason it's escaping my brain. The human centipede, right? Yeah, when they're eating their own tail, they eventually fall apart. Or boroughs, yeah. Yeah, they start producing more and more gibberish.
Starting point is 00:18:33 if you start training AI data on AI data. I know there's a lot of research into making a breakthrough on this. I don't know if there is any latest field of breakthrough on this, but that is like a real problem is authentic data versus, you know, just gibberish data, low quality data or low signal data. Yeah.
Starting point is 00:18:50 And it's very hard to tell sometimes. And so you can get just a lot of association. And this is a whole industry in itself now, right? Like sub companies trying to be the brokers of, you know, farm to table data, if you will. Yeah. Yeah, a lot of them are just paying people in Venezuela or label pictures of dogs and selling it to some AI company. But I guess what I'm saying is like, you know, Reddit and Wikipedia and all these,
Starting point is 00:19:14 we're like incredible treasure troves of true human data that are now themselves being poisoned. Not intentionally maybe, but like people on Reddit are just using AI to write their posts way more often. So you can no longer scrape all of Reddit and get a... Well, hold on, hold on. I mean, to be fair, like, Reditors are still Reditors. They're very angry. And so like they want to get on those keys and feel it. And so like a lot of those walls of text, those are still pure human ingenuity coming across right there.
Starting point is 00:19:41 Because I see a lot of if not X, then Y in Reddit posts nowadays. I feel the chat GPT. But I could, okay. So I'm actually less worried in some sense about that. The thing that I'm more worried about is that companies can use this as an advantage, right? Let's just say I'm starting a tech company. How do I get myself out there? How do I get people to use my product?
Starting point is 00:19:59 What happened if I do like a campaign to write thousands of articles? that have enough keywords together and then my product name. Keywords together, my product name, keywords together, my product name, and just get out there so that when people use Jipity to go generate something, it's like my product is going to start showing up.
Starting point is 00:20:15 So I believe I called LLM SEO, you know, the old days of doing Google SEO to get to the top of the results. Now it's like it's no longer about how to do quality SEO. It's more like how much slop can I do word association with my product out on the internet. And it's like, to me that's going to be like the acceleration of dead internet.
Starting point is 00:20:32 as opposed to people wanting to create disinformation bots or all this other stuff. It's like nothing beats corporate greed and power. Like that's going to be that's like that's a great way to get a lot of information out there. Especially once Chad JGBTBT starts doing shopping, which is like leaning into now with. Yeah. No, once there's monetary incentive to to get search ranks up in Jat J. then everyone's going to do it. Yeah.
Starting point is 00:20:53 The biggest scale they can. And it's even more black box than say something like Google. Google, it's like, okay, you have these like X rules. It's like what are the rules to an LLM? I don't know. fucking no. I don't know. It goes offline for like a year
Starting point is 00:21:06 and spends a billion dollars in some magic factory and comes back from the thinking sand factory and it's like boom and now knows and you're like, what the hell happened here? Hold on if you guys don't know. I don't get the sense
Starting point is 00:21:19 that fucking Sam Altman knows, bro. I feel like he... No, they don't. They're very explicitly have said they don't. Yeah, we can give like more approximations of what happens. I don't know how technical people are
Starting point is 00:21:28 but in the oldy days what they used to do is they're like, well, the human brain like a bunch of neurons, right? Yeah. And so those neurons are all poking together and they're all transmitting all this information. So what if we take a bunch of neurons
Starting point is 00:21:41 and then make them all connected and we shoot information through there and at the end we get answers? Like that's how the first neural mess kind of came about is trying to model our human brain and people kept trying and trying and now that's what LLMs are, just big versions of those, really, really big versions of those.
Starting point is 00:21:55 People are going to get very upset. I know that I'm not saying it. You know, there are MLPs underneath the hood, but there's also a bunch of other stuff underneath the hood. But that's what happens is it's just doing, it's just doing,
Starting point is 00:22:05 a big matrix operation. That's it. It's just like, I'm going to try to guess what is the most likely on the outcome. So now you're playing against that. This is,
Starting point is 00:22:14 oh, you go. Well, I was trying to say, first of all, I love the, because I do content as well. I love the YouTuber instinct or anytime you try to simplify something for an audience,
Starting point is 00:22:21 you're already hearing the comments in your head. So when I said MLP and I was like, that's just it. I can already hear something like, you know what I'm going to generate some true human data
Starting point is 00:22:29 right now. Son of a bitch. Don't curse. We've corrected. We got to firm comments. You're ruining our engagement. I'm sorry. I'm sorry. Yeah. Well, you have to inflame them to get the real data. Guys, you didn't know this, but I have already poison pilled the audience. We're all LLNs now. We're just trying to. You guys missed it. No one reacts, which I'm very upset at. But don't worry, your comments already filled with it. I call it Gippity instead GPT. And they're going to be like, shit.
Starting point is 00:22:51 I thought that was like the code. No, that's his nickname for Chad GPD. Gipity. It's just easier. But don't worry. There's already 100 comments on that one. They're pissed off about it. Okay. I have a question. for you. So on a high level, and I don't know how much you've been able to talk to AI, actual AI researchers on this stuff, but both this article, which makes it seem like a small number of people can have a huge impact on the output of something like a chatchbt, as well as the ongoing question around the slopification of the internet and what we just discussed, just enormous amounts of slop. What is the current thinking about how people are going to
Starting point is 00:23:26 combat this? Because I've heard two, two angles. One is, you know, more RL. like having human beings reinforce it and sort of train it out. Another is that you just start to have the AIs only train on, let's say, Reddit and New York Times, but not go out into Twitter or medium, like you said, so to try to dodge the slop. Or, I don't know if you saw in the Chat Chb-T-5 announcement video that they did, they said a bunch of the data for Chat-CTP5 was synthetic and from Chat-GPT4, which to me is crazy. So they are straight up using AI output for the new stuff.
Starting point is 00:23:59 You have any knowledge on like, what are they doing? Like this, this paper feels scary for a developer of AI. So when I believe, I could be wrong. So, you know, forgive me if I'm wrong. But when they say they did a lot of training from chat GPT4, this is synthesizing previous models. We saw that R1 do this. You guys remember R1, R1 is the Chinese models that came out.
Starting point is 00:24:20 Deep Seek, yeah, Deep Seek R1. What they did is they effectively just brain drained the model from chat GPT4. You give it input. It gives output. That's like the most ideal training stuff. A lot of these kind of reduced models are just training on themselves just becoming smaller. They're just getting all the ins and out. So they have the synthesized version.
Starting point is 00:24:38 To say in a very technical sense, you train a model with a whole bunch of tokens. And it takes all of that information tokens is just some part or part of a word, you know, some amount of characters in a word. That's a token. And so you train it with a whole bunch of it and you reduce it to a smaller amount of data. It's a compression algorithm. It's all it really is. And so it compresses this data. Well, you're just further compressing it.
Starting point is 00:24:57 So when they made the next GPT, they took all that compression. and they just kind of preceded it with some compression stuff is how I would assume is what they mean when they got a lot of data from Jipty 4. There was a freak out about the deep seek stuff when it came out because. Yeah, it was ran by a finance company. Yeah, I think they made so much money freaking people.
Starting point is 00:25:15 I'll be like, oh gosh, the end of models, am I right? Envidia crazy. Wow, we had puts. And video stock. I didn't even realize that. But I wonder what was the flaw in that thesis? Because the takeaway from the deep seek stuff was, hey, no matter what fancy model you make
Starting point is 00:25:33 and spend $100 billion on, someone can train off that model for much, much, much cheaper and six months later have a close facsimile of what you just did. So how do you maintain a competitive, how does OpenAI, how does any leading LLM maintain a competitive advantage when someone can just train off of your output
Starting point is 00:25:52 for $8 million instead of $8 billion? But like, I mean, this was the theory of the time, and the stock market was going crazy, whatever, and then everyone's like, eh, they just moved on. Well, I mean, there's a lot to a model, right? It's rarely just a model. There's all the other stuff that goes along with it. When they say agents, agents are like much more like an agent.
Starting point is 00:26:12 If you don't know what an agent is, it's something where you're like, hey, go do this task. And it goes, okay, well, hey, I'm going to search your file system now. I'm going to do this. I'm going to do that. Instead of just talking to it, it's going to actually go use your computer, use the internet. It's going to do various things for you and then return like a human would if you go
Starting point is 00:26:27 give it a task. Yeah, it's going to do a loop until it finds, the end, whatever the end is supposed to be. And so there's a lot of, there's a lot of money in that, there's a lot of money and all that. And you can't just simply synthesize that out. That's not a part of it. And so the model itself is less of a moat than it's ever been,
Starting point is 00:26:42 but the moat still is like a billion dollars worth of GPUs, and you still have to get them. You know, think about all the gamers out there that are still crying that they can't get GPUs. It's because all the companies still need to buy them. So yes, there is the, it takes less to get something that's pretty good, but you still have to have the power, the time, the organization to actually run it all.
Starting point is 00:27:02 And so there's still a whole bunch. Like, NVIDIA is still, they're even better now. It's like, oh, it takes, I still have to buy all the same amount of GPUs.
Starting point is 00:27:09 It's just more companies can have them. This is fantastic. And so I don't, I don't look at it as like a bad thing. And plus it just makes sense. That's, you know, if you can already give something
Starting point is 00:27:16 that does the exact, you know, you can get the answers. You just start from there and then you have to make it better. Sure. So there's still more to it than just simply taking the answers.
Starting point is 00:27:26 Yeah. Okay. Makes sense. I feel like it's a good segue to just say, think AI's overhyped right now, Prime? Do I think AI is overhyped right now? I think a lot of people do, but a lot of people don't. And there's a, here's the thing is that you can't,
Starting point is 00:27:39 how many of you know how to program? Oh, I taught, well, I taught him, I taught him. Yeah, we have, we had an entry level Doug class. Yeah, so we're pretty good. Three hours. Three hours. I did skip, I think I skipped, uh, four, four loops. Uh, there's no, no types.
Starting point is 00:27:54 If you need a hell old type. Okay. I think they learned variables, but I can only remember to be honest. Okay. Okay. So when you see output from one of these models, it probably feels fairly magical because you asked it to make, I don't know, whatever you guys ask it to make. And you go out there to make this program, you're like, holy cow, this is incredible. Right. And so I think to the layman, any piece of advanced technology sufficiently looks like magic, right? And so that's kind of the experience. And so I think the loudest voices are people who don't have a good understanding that are just like maybe casually technical, right? They have just enough understanding. This is the vibe coding kind of. Yeah, maybe they run Linux and they can do it. a few commands or they're on Apple and drinking a Phil's coffee. I don't know what they're doing and so they're out there and like well actually it's like
Starting point is 00:28:35 that's basically it's actually the end of all private living in S.F. Yeah, exactly. Phil's coffee. On their hallway laptop chucking a Red Bull. And so I think those people tend to overhype it because they don't have a good place to say what is good or bad, right? And you see you see this a lot in
Starting point is 00:28:51 all forms of everything where you have the layman person that has some amount of understanding and they hype up a situation and it could be good. It could be good. it could be bad, they could be hyping it up correctly, or then it's nothing. And so I think you kind of, we've all seen it now.
Starting point is 00:29:05 I remember, I think the hard part is, is that chat GPT3 came out and you got like wowed with this technology. It was like the first time it came out. And it was like, honestly, that jump from nothing to something was such a magical kind of jump that it just felt like the world was like completely different.
Starting point is 00:29:22 But each subsequent jump after that has not been nearly as magical. I think the problem feels like we're, we're getting closer to the jump between like iPhone 15 and 16 and also the iPhone is is starting to make it monetize you in a bunch of new ways that's it feels like we're angling towards that rather than it progressively making its way towards AGI yeah no no you're you're dude you're so right on that because every single time an iPhone drops you're like dude it's like 50% faster but it's like 2013 50% fast you're like what the hell kind of measurement is that right it's
Starting point is 00:29:58 all baiting you the entire time. But it is that kind of feeling where it's like it's more iterative. At least that's been my kind of assumption is that the actual model themselves has been a bit more iterative in improvement, whereas like the tooling around it has made it much, much better. But I did want to go back to something you said, which is like, how do we combat this like whole slop feeling of everything and all that? I do think the white pill side of this is that if you, have you generated music with Suno? Yeah, I tried Sino. Okay, yeah. I went hard on some Sino. We made some bangers out there, right? But at the end of the day, there's like 900 things that I get bothered with the bangers right i'm like dude if only did this more if only did you know and there's
Starting point is 00:30:32 just so much missing that i think we're going to hit a moment where people just want the genuine human feel because anyone can just make something that's like 80% good and someone's like no i want that you know i want the phil's coffee of music i don't love it all right no yeah let's get back to our Human craft the shit you can get in. We really did Pete with Phil's coffee. Yep. Me getting a 750 latte at Phil's. Okay.
Starting point is 00:31:00 Ambrosia of the gods. Come on. I got a larger question here then because it's about programming because that's an area where I really don't understand where. Here's the thing. From the outside, I'm looking at it from like a financial POV. And we're seeing that the LLMs are kind of leveling off,
Starting point is 00:31:15 as you say, in terms of like exponential. Yeah. Feeling like magic. Four to five was not nearly as magical. Four to five was as big as zero to three. right? And yet the spending has gone the other way. It's exponentially up. We're spending more than ever. They're demanding more than ever. They're promising, you know, trillion dollars to invidia, to Oracle, to and so that's a disconnect that has to be solved eventually, right? And when I look at its use cases in like,
Starting point is 00:31:40 I don't know, English or writing or it's still so slop and I don't see revenue generated. But people always tell me that it's really useful in programming. And I don't understand it. I don't know that case. So I want to know, like, boots in the ground, what you're seeing from LLMs and AI in general in terms of making programming more productive. Can you hire less people? Can they work twice as hard? Like, what's happening there that is making it so valuable
Starting point is 00:32:06 in that space? Because that's what I don't understand? First, I want to hear Doug's opinion on this, and I'm going to look something up while you do that. Okay, I'm going to kind of answer that. I'm going to give your opinion, but in tweet form. Okay, Harry, can you pull this up? So famously, this is what, two years ago, something like that?
Starting point is 00:32:20 No, no, this, this was in March. Oh, this is March this year. This is March this year. So the CEO of Anthropics said that in six months, AI will be writing 90% of code. So one of my favorite tweet series from Prime is that he just says we are, oh, and then there's another couple of quotes about AI stealing your programming jobs in six months, right? That was the original one.
Starting point is 00:32:40 Oh, we are 11 months into six months away from AI stealing your programming jobs. That was that was in 2024. Yeah, that was a year and a half ago. prime. We are 15 months into six months away from AI stealing your programming jobs. Okay, a few months ago. We're 28 months into six months from AI taking your jobs. We're also four months into 24 months until cursors obsolete because that was also predicted by people. And we're six months into six months until AI writes 90% of your code. Right. Okay, this is the anthropic one. So is AI writing 90% of your code? Well, so the most recent update, we're now 29 months into six months from
Starting point is 00:33:14 AI taking your job. And Andre Carpathie just said it feels like the AI industry is slop. My own experience is, I think... Specifically, he says, I like the industry is trying to pretend that this current AI is amazing and it's not its slop. Yeah, this was this past week. There's words in between that that that I took out because he did a little bit of more talking, but that's the gist.
Starting point is 00:33:34 Okay. I want people to see that because, you know, I did some editorial thing right there. Because he said, you know, the industry. You just cut it down. Yeah, yeah, exactly. I went to dude super hard on the news there. So I think this is a funny meme where people have been hyping up the software thing insanely, right?
Starting point is 00:33:47 You have investors or, startup guys who are like all of coding will be taken over by AIs in the next three. And you hear this constantly. And that is not true. And I know you also feel that that is not true. Certainly for my experience, though. So I mean, I think you, I am like a solid intermediate level programmer, let's say, where I have the background, some industry, you know, experience and I use it in my daily life. Whereas your, your audience, Prime is speaking to the people who are deep in the sauce. So I think you have the higher kind of value audience that a lot of these companies are shooting for. In the intermediate band that I'm in, it's fucking incredible, right?
Starting point is 00:34:23 And so an app like cursor, which you've worked with a bunch, is truly magic for me. It has accelerated the rate at which I can make things by, let's say, 10x. Like literally I make 10 times the amount of stuff that I did before. So for me, and this is, again, one of the reasons why I'm optimistic about these things is because for my concrete job right now, it makes it way, way, way, way better, and I pay 20 bucks a month. Yes. But then let's scale up to like real professional. which is your experience and audience.
Starting point is 00:34:51 Yes. So first off, I want to show this tweet right here that I have pulled up. So if you can do this, by the way, I've been blocked by Paul Graham because he made this tweet that said, what's something one million people are using that in 10 years, 15 billion people or some big number will be using? And of course, I respond to your mom and then he, I just learned you can't make that joke, Paul Graham. Okay, so anyone looking to make a year mom joke, don't do that. It'll get you instantly blocked.
Starting point is 00:35:13 But so this is kind of on the hype side of things, right? I met a founder today who said he writes 10,000 lines of code a day. now thanks to AI. This is probably the limit case. He's a hot shot programmer. He knows AI tools very well and he's talking about 12 hour days. He's not naive. This is not 10,000 lines of bug filled crap. Right.
Starting point is 00:35:31 So you can see that people are super stoked about AI. I'm stoked. Reading this tweet, I'm stoked. Dude, I know. I feel like a NASCAR driver who is going to solve all our problems. I can feel it. But how does, yeah, how does Paul know it's not bug filled crap? Well, because he said so. It's in the tweet.
Starting point is 00:35:47 Do you, maybe let's read it. I feel like he didn't see it. I didn't read it. I'm sorry. And it's Paul Graham, who's a famous technologist. He has a checkmark. Yeah. He couldn't say this is not unless he knew. That's true. No one has ever done that. So when it comes to that kind of stuff, you see these tweets all the time. And I think it just, I think it blackpills so many people that are trying to learn technology. And I think it kind of like makes the world seem so complex that no one ever could really jump into it. And it's not really worth it. And it's just like there's the smart people that know how to do it. And I'm just, I'm never going to do this, right?
Starting point is 00:36:19 I'm too dumb to do 10,000 lines of code a day, okay? I can't do 10,000 anythings a day. So that is just out of control. So when I see this, it just makes me feel bad because people think it's just like the greatest thing that has ever existed. I think for your use cases, and I do this also,
Starting point is 00:36:33 smaller projects or like kind of like mid-sized ones, you can just rip through really quickly because you're not there to be like, I'm going to maintain this with five different people. It's just like, no, I need to have... For 10 years or something. Yeah, I'm just making this thing and I don't, like,
Starting point is 00:36:45 it is not a long-term thing. And if I need to, I'll just tear it down and do it again in a day. It is so, so good. I've used it so many times that way. But like a long-term project, it's really hard. You cannot do this in a long-term project. The reason being is that the best way to describe it is that there's a bunch of human conventions or a way you kind of think about how you organize your data that there's most significant, a least significant, kind of like what is important to have in certain ordering. LMs don't have that kind of thought process. We call it they
Starting point is 00:37:17 don't they cannot decrease entropy they just simply go okay i'll fix it put it right here and they just in line everything and when i use an a i long enough i'll say hey let's make this change it makes the same change in like five different spots and as that surface area grows the more danger of just like bugs in your code because then you have to have the same instructions over and over and over again and so if you're not the one correcting it and you're not the one interacting with it it's just going to slowly degrade into just craziness i've hooked up twitch chat to devon which is one of these kind of automated programs and just let them go for eight hours to see what they build. And just like the code is just terrifying.
Starting point is 00:37:51 It's just like at the end of it. You're like what? There's just like four loops. You don't know about those. I don't never got to tell you about them. But they exist. Okay, they're not government drones and you go through it and it's and it just is like nonsense. When you say terrifying though, is it terrifying as in like indecifurable to humans or terrifying as in it doesn't work.
Starting point is 00:38:10 Yes. So like the problem is is that it'll just like one of them was a, uh, a, update function and the first thing it didn't for those that do game development the first thing it did is organized by z index which is how far away usually you do that in like in rendering theoretically where you want to render stuff over the top of each other so that way you get you know you don't have something in the back rendering on top of something else it just did that an update function and then never touched it again or you know did anything it just is doing work doing work doing work because at one point that's how it was and so just didn't change that code because why would i change that code that code's
Starting point is 00:38:43 already there you told me to you told me to add like some key input, why would I ever change stuff, right? So it just keeps on adding. Just keep on adding, keep on adding. Another way to like, so I think somebody who hasn't done professional industry software doesn't realize that I would say maybe 80 to 90% of the work, it's not writing the original, the initial solution to a thing. It is actually updating it so that it works with all the other teams, with all the existing
Starting point is 00:39:09 software that you make sure there aren't bugs, that it's testable, that it's going to have all these issues. So that's why corporate programming in my, in my, experience, not nearly as fun because the majority of it is thinking about how does this interface with everything else going on? How do you make sure it's actually going to stick around and work? Laman understanding here is that it lacks the ability to understand all the context that this has to be built within. It just wants to dive at the problem straightforward and solve the very short thing that you've fed or given it, but it doesn't understand all the
Starting point is 00:39:41 systems and people. It needs to work within and be efficient within. Let's say you're designing a city right? A big part of designing a city is thinking how all the pieces are going to interact with each other, right? And what an AI right now tends to do is if you say, okay, make the power plant, right? The center of power for the city. It'll go, cool, I'll just do that right now. And it's not going to think about how that's going to interface with all the other pieces. And to your example, later on, it might never go back and think, how does that power plant I made six months ago relate to the houses here and the commercial district here and the roads we're doing and the plumbing system? And so, as this stuff gets built sort of independently from each other, and there's no thought and oversight
Starting point is 00:40:18 as to how it will scale, how will interact, it just becomes this unmaintainable disaster that at some point you start over rather than trying to fix it. And that's, that's called tech debt, is my understanding? Tech debt, yeah, yeah. And so there's a lot of thoughts on that. But there are ways to obviously mitigate this. You can do a lot of like hold. You can hand hold it. You can take more of your time. And there's like a lot of benefits to that. I'll give kind of a pro side of thing, something maybe a plus one to the hypers that I think is really useful. So I'm, uh, in the middle of writing a small kind of just like fun fun game and it has like 60 70,000 lines of Lua in it. And so a small game. That'd be considered like a small game. And I wanted to add
Starting point is 00:40:54 something. And so we go on there and I just asked the AI, hey, go at it. And there was like five different spots that had to make the change. And I looked at that and said, hey, here's something we haven't thought about. It's kind of screwed up. I'm now going to take this like AI's investigation, which would have taken me like two hours to figure out all the spots. Instead did it for me in five minutes. it's now I'm going to go home and think about it for like an hour and really come up with a more organized solution to this. And then that's great. So AI's can be really awesome because it can save me hours of research by just asking questions to go search my code base, figure out how to do these things. And that's super useful because then I don't have to go play, you know, Jean-Luc Picard and
Starting point is 00:41:30 explore the galaxy and said it just does it for me. My connection there is the use that I've heard law firms talk about. It's like we've taken this process of having to dig through thousands and thousands of pages of writing about a case that somebody's working on, have the AI search for points instead, and you can at least eliminate that part and then have the human review the actual problem after the fact. Yeah, I love it. I call it semantic searching. In other words, like, semantic usually means like the meaning of something. So it's like that search is awesome because old Google you have to like, you have to say in a very descriptive way. Now you can say it like in a very prescriptive way where it's just, you know, how does this make you feel? And it's getting like do stuff.
Starting point is 00:42:11 So it's really cool in that kind of sense. Can I, a question I have for you, I saw a clip where you're going on a, I would say a short rant where, uh, you, you said something funny. I want to code. I want to dance and I don't want to go home. And you're in the midst of describing how, uh, this is automating or taking away a bit of the joy or the appeal of programming. Like, it servicing problems or answering and creating code is taking away some of the work that most people enjoy about coding or programming in the first place.
Starting point is 00:42:48 Yeah. And now you're in a place where you're writing documentation more than anything, which is actually the part of the job that most programmers hate. Yes. And I wanted you to explain that a little bit and how that contrasts with what we're talking about right now.
Starting point is 00:43:04 I can put it in a non-programmer kind of way, right now like there's a huge push you see it at least in some level of articles about game programming they're like AI image generation will just solve everything it's just like well making the art and the style of the game like that's part of the fun part like I want to have a feel to it yeah and says it's just like no generate as fast as possible and it doesn't have that same cohesion it doesn't have that same kind of feel to it that that genuine like you can see the expression of the artist in the game and so it's the exact same thing where instead of doing the work that's fun and creative and actually takes like time and thought, you're instead just writing the documentation of how it should be.
Starting point is 00:43:41 You're just constantly, that's all it is. It's like somehow in this AI world, we were promised that it was going to cure cancer and fold our laundry. Instead, it's doing all of our art and all of our creative projects, and we're just having cancer and folding laundry. It's like, what the hell has happened here? Where's this trade off? And so that's kind of the idea of the rant is I never realized I've been tricked into writing documentation instead of programming the whole time, which was a very, I was very upset at the revelation. Yeah, no, that makes sense. And then of course, the even funer part about this whole thing is that Suno AI music generation.
Starting point is 00:44:12 We generated a song, said, I want to be Teage, I want to code, I want to dance, I don't want to go home. And we just had to just repeat and just say that over and over again in the club style. So that was me referencing a song. I listened to a thousand times. That makes it. That's funny. Oh, I wanted to bring this up because I have a friend who is a doctor. And he, this just got announced like today.
Starting point is 00:44:33 They got a big billion dollar investment or whatever. but it's called open evidence. And apparently it's like open AI for medicine, but it doesn't hallucinate at least nearly as much, or it's like way, way, way, way lower. And he, two separate doctors now have told me that it's like sweeping. People are using it all the time and it's pretty useful.
Starting point is 00:44:51 And so I wanted to shout that out because I trust this guy. And he said it's, he's tried Chad GBT and it's generally gives him something that he can't rely on, but this has. So clearly like maybe the broad LLMs are not going to be, there are going to be more slop trained or not working. but focused ones that are subject to a task could be more helpful or increase productivity. That's been my theory for a while.
Starting point is 00:45:10 I think I've said that on the podcast, which is that, yeah, trying to appeal to every single use case is so ridiculously hard, but it's so clear that many, many industries are not going to be successful by jamming chat chbt in there. Doctors would appreciate, and again, I've talked to doctors, or again, my sister who's a nurse and uses, there are already software programs that people in industries, like a lawyer or a doctor use, that help them
Starting point is 00:45:35 gather information they need for a case or prep a case or do whatever. And these programs could be supercharged by having an AI system that can scan through 10,000 documents for them and like pull something up like that instantly or to reframe it in a way that is relevant for a specific case. But obviously in these contexts, the super important to get it right. And so if you have a company whose entire thing is about, you know, consolidating a bunch of medical data and presenting it in a format that is really helpful and they take they figure out the logistics and litigation risks of all this stuff that's where there's going to be a ton of value and so that is already happening with law I forget if we if I actually brought it up but there's quite a few companies that are like finding
Starting point is 00:46:17 major success selling to law firms and it's not chat CBT and it's not anthropic it's companies that have I think Bloomberg I'm fairly certain has one of them that is like really successful but it's just it's just legal documentation and assistance and their whole thing is like they're not trying to write erotica for people. They're just doing the legal side. They have tons and tons of effort on just safeguarding to make sure that there aren't hallucinations around cases that don't exist. And I think every industry is going to have stuff like that.
Starting point is 00:46:47 This is why I'm actually curious your thought. I've always felt like not only because of the deep steep stuff that we mentioned earlier, where it's easy to use chat, TBT, 5 to make your own model. On top of that, if you're trying, if you're spending a, $200 billion as ChadGBT to make the next model that's going to make everybody happy. You'll inevitably not make everybody happy. Every industry is going to have its own needs and challenges and you're spending the most money of anybody versus a company that comes in with $100 million and make something that's just
Starting point is 00:47:15 really, really incredible for, I don't know, truck drivers or whatever, like a specific industry. And so I have a hard time believing that the profit is going to come from the foundation models. Here's what you think. I don't. So here's the thing is, first I'll tell a quick story. I, for the last year I've been having some voice problems. Turns out I have muscle tension dysphonia, which means I just have, I don't know, throat keeps swelling for some odd reason. And during that, I went to many doctors and no doctor was able to figure it out.
Starting point is 00:47:47 And so I chat GPT and chat GPT figured it out. They're really, really good. And then I went to a doctor and he's like, that's it. That is the one. And so, you know. It's crazy. That is a crazy thing to hear, actually. Well, when you have like a medical condition and you realize that doctors aren't
Starting point is 00:48:01 like, they're like a detective with varying degrees of ability and that you like maybe they'll be able to solve your case. They're not, they don't just like solve every problem. Every doctor is sort of like making an educated guess based on what they know and you might literally need to go to 20 and the 20th. Or if you have a serious medical procedure like operating on cancer that you'll have one doctor say, yeah, we could operate. We think this is going to save your life. And another says, don't really know. And another says that will definitely kill you. And all three are the most qualified doctors in the state. And it's like, what the fuck, right?
Starting point is 00:48:35 Just an episode of house you described. Yes, yes. And this happens all, anybody with a chronic, like a chronic condition knows this. Anybody who's had to do a major surgery knows this. It's rare that there's complete consensus with the medical industry.
Starting point is 00:48:49 Honestly, if you've had a conversation longer than 30 minutes with any doctor, you find this out. It's like, oh, this is not as, this is not as all refined as I thought it would see. That's one of the, that's one of the reasons why,
Starting point is 00:49:01 It's so easy to shit on AI for valid reasons. But at the same time, it's like, you shouldn't presume that the systems we have are some flawless bashing. Like, you shouldn't assume that every lawyer is just fucking acing it every time. No, they absolutely are not. You shouldn't assume every doctor is acing this.
Starting point is 00:49:18 It's really fucking hard to do this. And if you have a tool that you can talk to that can synthesize the entirety of all the information available in a few seconds, and you use that to augment smart humans, that's where I think will be really popular. positive. So I'm actually on board for this whole doctor thing. I don't know how much money would take and all that or if the foundational models can't just do the things it needs to do anyways.
Starting point is 00:49:40 Like if they'll be good enough just to be able to do it. Maybe chat chbtbtee can just be your doctor eventually, you know, as opposed to like having a specific industry that's only surrounded with one model. Maybe there's some fine tuning, some other, you know, techniques that they can do to make it better. Okay. So I have no like strong opinion whether that's the future or is it just chat chbtee bibles them all up because it has a trillion. It has a monopoly amount of money on stuff. And so it's just like, I win everything because I have enough information. But at the end of the day, it's really about the people who use it. I don't want to just have chat GPT tell me my problem. I'd much rather know what it is, go to a couple doctors and see what they have to say and then
Starting point is 00:50:17 bounce off what I've been told and see like where it can be because you just, you just never know. I've heard just craziest stories about exactly these doctor things where one person figured it out and it was the most completely opposite thing that even chat GPT couldn't get. And so is there a lot of money in it? Probably a ton of money if you can really solve it. Okay, that's what I want to talk about then. I want to go even broader here,
Starting point is 00:50:37 which is the money question. Isn't this great, you guys? I have so many good minutes just talking about AI attack. God, I love this. I'm loving this. This is the Doug episode, but I'm actually fascinating. Okay, here's a thing. I always have to restrain myself on the other ones.
Starting point is 00:50:53 I know, I can't just go off. But now like, I'm bouncing off you. I'm just like, yes, dude. Yes. I also have a huge conspiracy theory about money, but we'll get there in this moment. Everything you're telling me is making me less confident in Open AI specifically and more confident in the other ways that, more focused ways that AAI may be used. L.O.s may be used. Okay. Maybe I don't speak well. I don't know if you should do that. Okay. They're all good. They're all good. Okay. Yeah. Keep on great. My concern is that the the amount of money that is now
Starting point is 00:51:21 promised by Open AI is so massive and I'm not quite, the revenue isn't there, but It has to get there. Now, I'm trying to figure out what your stance is on whether this will be a profitable venture. Actually, a bigger question. Figure that. All this will only work out. The amount of money is now so large if they get AGI. So the real question I want to ask is where you stand on AGI, how close that is, what you're seeing with that.
Starting point is 00:51:46 I'm so happy. And also, what do you define it as? Because everybody has their own fucking definition for what AGI even is. Okay, okay, okay. Okay. So first off, this is like my favorite thing in the universe. So I want everyone to like, everyone that has ever listened to this podcast, understand one thing. When a company has AGI, you will not get it.
Starting point is 00:52:06 Reason being is, would you let the world's greatest secret be used by the general public? No, you'd remake Google, you'd remake Netflix, you'd remake everything. You'd use it to create every single company on earth and just run your own businesses and be the world dominator. Like, why would you have the greatest piece of technology and open it up? Open AI is not going to release AGI. They would never be like... Their name is Open AI, though. I don't understand.
Starting point is 00:52:29 It feels like... Okay. Okay, I'm an atheist checkmate. Okay, no, but there's no way. Like, there's simply no way that that tech... The reason why they keep piping all these things up is because they're just not there. And, like, actual AGI. So AGI would be, they called artificial general intelligence,
Starting point is 00:52:45 meaning that can just always solve with extreme precision for low amounts of cost, problems that have never been seen. It can just simply keep on making itself better and better, and eventually get to like super intelligence, meaning it's so smart, it's even beyond anything humans could possibly ever achieve in the next thousand years.
Starting point is 00:53:00 It's like the greatest thing of all time, right? It can replace every human task. If you've read Brandon Sanderson, have you ever read any Brandon Sanderson? Yes. Okay, it'd be like a shard. We'd be creating one of the gods in the,
Starting point is 00:53:13 in his cosmary universe where they can foresee the future to be the greatest thing ever. It's like a god. Thanks, thanks, thanks, Doug. Yeah, thanks. This guy was gibberish. You finally.
Starting point is 00:53:23 I didn't even know, The thing is, I don't even know what he's saying, and then you come in. Yeah, yeah, yeah. Doug, you're just a man of the people. You're going to see it. Okay, so yeah, I, because I haven't chatted with you about this either. So let's give quick context. So AGI is the thing people keep talking about as like,
Starting point is 00:53:40 we're going to hit this. And when we do, that justifies the fact that we're spending hundreds of billions of dollars on all this stuff because then it will, or trillions, then it will unlock such unbelievable amount of productivity that we'll be able to fund everything. we can do make every job 100 times more effective, et cetera, et cetera. Literally talking about it like God, like they're going to invent God. Yeah, I mean, the way I saw I describe was, you know, Sam Altman has basically go around saying, give me trillions of dollars, I will create God.
Starting point is 00:54:05 And a lot of people have been doing that. And a lot of people have been promising, he's been promising money to other people. And it is God coming because Zuckerberg's talking about three years, you know. Carpathie says 10 years plus a lot of people. I mean, this is literally just Gilgamesh all over again or Nimrod from the Bible. this is just Tower Babel. I'm going to create the greatest thing ever. We're going to be just like gods
Starting point is 00:54:26 because we can create the universe, right? I mean, this has been, we've been saying this for thousands of years. This is not the first guy. This sounds different though. It's, I mean, maybe it is somewhat different in some kind of sense, but it is also oddly very similar.
Starting point is 00:54:38 So it's very, very funny that they're doing that. But at the end of the day, if, let's just say we do get there, like it is, you are not going to get the same level of access, right? They're not going to just be like, hey, here's the model. You go run it. No, you can't.
Starting point is 00:54:52 You don't have the, I'm not getting jillions of GPU. The AI version. Yeah, you're not going to, there's going to be so much safety built in. Remember, safety and correctness are kind of, in some sense, at odds with each other.
Starting point is 00:55:02 Because it has to like take what you say and be like, well, actually we can't say all the things you're asking for because it might be dangerous. Right? Like there was this famous, uh, famous thing that happened with Gemini when it first came out,
Starting point is 00:55:12 which is a 17 year old on there, it was like a 17 or 16 year old on their Google profile, asked about some C++ feature. And because C++ is an unsafe language, it refused to show this person the code because it's like, sorry, you're a minor. I can't show you this code. And it's just like, it's a very, very funny post, uh, but it actually was true. And so there's like, there will always be this kind of competition.
Starting point is 00:55:34 You will never get the same access level as something that could just solve every single problem ever because you would just be able to make everything. But if everyone can make everything, then no one has really anything. I learned that lesson from the Incredibles. Yeah, when everybody's incredible. I'm glad you introduced this question or topic because I had almost the exact same question, but how this affects people working in the industry right now, because it feels like we're not necessarily close to that. And that is the reason that these companies are hyping up the work that they do because they need to keep the energy and the funding to get closer and closer to it. In the meantime, there's this kind of this feeling. of the walls closing in, figure out how we can monetize this for the time being, you know, we've spent a lot of time recently talking about video generators.
Starting point is 00:56:29 Yeah. And these new sort of social media TikTok S sites as like a maybe a means to, to monetizing the technology, right? And all these other potential maybe insidified ways of monetizing the experience in the short term. if you work on this stuff right now, you're somebody in the industry, do you feel this sort of financial pressure
Starting point is 00:56:54 of the bubble at the moment? Like a lot of people, as an example, a lot of people talk about how Boeing changed a lot when the culture of executives came in with a very different outlook on how money was spent at the company rather than being run by engineers, right? Yes, very famous article on that one.
Starting point is 00:57:13 How much pressure there is from the amount of money involved here. How does that affect the average programmer working on these things and how they feel about their work right now? So this is such an interesting topic. And this is the unfortunate I'd call like the black pill side of things right now is what I'm seeing is a lot of people are taking on more responsibility. But they're not actually, they don't feel like they're learning because they're constantly just deferring to the AIs to try to make all these things. They're more just reading code instead of writing code. They're constantly trying to prompt their way into stuff. And I kind of
Starting point is 00:57:44 foresee this like stepping stone between now and AGI, if we will. I don't know if or when AGI will happen. I make no predictions on that. But I see this kind of zone where everyone feels like they need to do more because we constantly keep saying that it's the greatest thing ever, but people don't feel as much success on this specific topic. And they're not able to quite generate all the things that they keep getting promised. And so I just foresee a lot of burnout and tiredness because no people aren't learning as much anymore. It's really hard to learn something if you're not like in the weeds doing the thing. Yeah.
Starting point is 00:58:13 You know, I can watch a thousand Bellatro streams, but I will not be good at Bellatro until I like learn all the jokers. I just have to do the work myself, even if it's fun. And so I kind of see a lot of this happening where there's a lot of obviously money going into this.
Starting point is 00:58:25 It's hard to say if it's in a bubble or not because what is a bubble? The hard part about a bubble is that even if everything inflates in price and a whole bunch of money comes in, but if it grows to that expectation over the course the next five years, was that a bubble?
Starting point is 00:58:38 Or was that just the, was that actually just, It was just sick as hell. Yeah, it's just sick as hell. It's the future, it's the future value being realized now. Oh, Doug, do you feel that there's that kind of pressure of the ever-increasing amount of work, a demand to be using AI for all these things, but a kind of lack of fulfillment in these things? Because that's where I truly think burnout exists is when you have the lack of learning and growth
Starting point is 00:59:00 mixed with harder and harder deadlines and more and more work. And you just don't get that joy anymore. And you're just a yes man. Yeah, I, so I've talked to programmer friends who are like, good, good programmers, like lead tech folks at companies. And they're basically saying it's like you, I use AI every day, but they don't particularly like it. And they talk about it as a, like having a team of junior engineers who don't learn. Like they're not. So it's not. So I think I guess programming.
Starting point is 00:59:29 Me and you. It's like having me. It's like chat. GBT is like a bunch of me and you. Yeah. It's like you have a bunch of A. Is that useful or helpful? And not say if you have enough of them. It could be. You throw enough of a problem. At some point. I give you massage while you work through the code. That would be useful. And so I think there's like two angles.
Starting point is 00:59:48 One is if you're the person who's trying to learn, in which case, yeah, it's weird if you, if the AI does all the groundwork that allows you to feel like you actually made a thing or learned skills and you're just telling somebody what to do. If you're only ever a manager and you never get the low level experience, that feels like you're losing a key moment of it, you know, of development and growth. And then when you get to the higher levels, and I'm sure you've talked to, folks like this as well who now feel like they do have the experience at the low level, but they're basically just directing a bunch of low level employees, which are AIs, but they
Starting point is 01:00:18 aren't getting better. They also don't have the satisfaction of their team leveling up because they aren't leveling up because it's just their AI is just doing the same thing and the development only ever happens from you, the human, telling it what to do better. So it sounds at a professional level, not that fun, to be honest. And it doesn't sound like most people are stoked about it, But of course, every company is trying to cram AI into absolutely everything. And then again, the caveat that's important to acknowledge is that for me and part of the area I do think is going to love this is in the let's say hobbyist intermediate role where I don't have to make stuff that I don't have to plan a city. Right. I get to go make a funny like bounce house.
Starting point is 01:00:56 Right. And then I pop it at the end of the day and move on to the next thing the next week. And also for your use case, if it is a little bit jank, that is funny. It's better. Yeah, yeah. increases that you serve. So I think about something, like one of the things I've thought about Chatsuby 5 is let's say you have a parent at home who wants to organize their kids chores, right? And something that is, it's all this time of like managing your household. And you right now
Starting point is 01:01:20 can go to Chachabahee and I know because I've done this and say, make me an app right now that can track here are my kids, here's how they use it, make it into an iPad form that we can touch and put on the kitchen counter and it's going to track all these things. It'll have points. It'll have scores. It'll have game. You get out all these cool things. And just some mom could just through normal English, have this entire custom app made. And it doesn't matter if there's a bunch of bugs if it were to scale up. It doesn't matter if other people can use it perfectly. It doesn't matter.
Starting point is 01:01:47 It doesn't matter if there's no security. It's just an average person who gets to use technology in a way that wasn't accessible to them before. And that I think absolutely is happening. That's definitely right there. We'll continue to happen and will be a huge use case. And the question, though, is on the professional side, does this help? Does it, I mean, it probably helps, but I think people are,
Starting point is 01:02:06 unhappy with it is my read on it. And again, you probably have more direct. This is the part that's surprising to me because from talking to people over the years, I think this is the group of people that I would have expected to remain the most positive and optimistic. The people who still have jobs in the tech sector working at companies, working on these sorts of projects. It seems like you'd be the most likely to have a very optimistic view of where this is going or what you get to work on every day. And to hear that it's a little more complex or a little more disjointed than I thought,
Starting point is 01:02:45 whereas three years ago, I feel like everybody working on this stuff was super, super pumped. That's kind of shocking to me. I would even say partially why I thought it'd be fun to talk to you about this, is I think you are one of the, I think Prime is one of the most notable people
Starting point is 01:02:59 not bought into the AI, hype with programming specifically, who is not going every week and going, holy shit, the new Claude model is amazing. I just did this. And you get 90% of tech Twitter is that. That's what you see on social media. Is people going, the new model is crazy. Look at these graphs. And then you're there making funny tweets like, it's been six months since it's supposed to have taken all of our jobs. And, you know, it's like, it's not that sick. It's not, it's not God. Like, okay, speaking of six months. I want to, I want to show this clip from Sam Alvin six months ago. There's a lot of short-term stuff we could do that would like really like juice growth.
Starting point is 01:03:31 growth of revenue or whatever and be very misaligned with that long-term goal. And I'm proud of the company and how little we get distracted by that, but sometimes we do get tempted. Are there specific examples that come to mind? Any like decisions? This was six months ago. Oh, I'm so happy right now. He's thinking of erotica right now.
Starting point is 01:03:49 Yes. Exactly. So six months ago, he goes, our long-term vision is so good. We don't need to focus on this short-term juice revenue crap like a sex bot. Six months later, he announces basically a sex body. Erotica is Chad GPD. So I am making the case here that I think
Starting point is 01:04:08 they increasingly look desperate for revenue. Not like they need revenue. They are desperate for it. Whether it's SORA, whether it's this, it looks like Chad GBT, our Open AI, has made commitments. Like they're going to break ground on so many data centers in 2026
Starting point is 01:04:23 with Broadcom and Oracle and Nvidia that they have to have money for it. They don't have now. And they're getting more desperate for revenue. and I'm trying to, you know, ask people who know more than me, is there anywhere this revenue's going to come from, or is it we headed towards a cliff here? Like, what is the, because this looks to me like a complete about faith.
Starting point is 01:04:41 Why is this so upsetting to you? You have fragile Victorian ideals. We can't have a sex bot on Chad Gebtee. It's his words. I have felt like when Chad Jibati is giving me Python code that I prefer it to be more sexualized. Yeah, yeah, I don't have an anime. Anime shows.
Starting point is 01:04:56 I'm pretty upset about it. I was tweeting every day. is, yeah. Get coding advice from a hot anime girl. So to be fair, like, I'm gonna, I'm gonna steal man Sam there. Okay, okay. Okay, he's do. Sam hates Elon.
Starting point is 01:05:08 That's been no surprise. So I'm pretty sure when that came out, Elon just got done releasing that. And so that's probably more of a means to dunk on him and saying, oh, Elon's shallow, but we're like so good over here. More than about revenue and all that. But at the end of the day, they do need to make revenue. He's even talked about it. That's why they're releasing these things.
Starting point is 01:05:26 But you got to think about it maybe in a slightly different concept that they make a lot of money. They are making, they're in the billions upon billions. They'll probably be crossing 10, 15 billion a year coming up here next year. I mean, they make revenue, but they're losing money. They're losing money, but they're probably, you know, Project Stargate or whatever it is. They're going to get a lot of money from the government. It's like all growth stories ever. Um, startups are or I can call them this thing a startup even though it's like six years old. Their goal is to maximize users. It's not to maximize money. A great example of this is Docker. If you're familiar Docker, Docker allows you to have whatever computer you're working on, you get a different kind of virtual environment that you could launch
Starting point is 01:06:02 your little application in. So it's like, oh, I'm actually on Linux. I'm on Ubuntu on my Mac because this is what our servers are in, right? So you get to have that kind of experience. Docker, they had this product in which made zero dollars and cost a lot, a lot of money, millions upon millions of dollars. And they got so many people using it that the year they decided to make money, they made $500 million in like a month, right? It just was like, oh, I now make a lot of money. Right. And so this is kind of them starting to turn on those gears of we've been acquiring users through a freemium model, and now we're going to start turning on gears to make money.
Starting point is 01:06:31 And that's just how I look at is they're just going to start turning on things to make more and more money. I don't look at it as a full failure, but they, 500 billion is a lot of dollars. And so are they going to be able to make that? Yeah, I would go to the government invests. Even if they had no expenses at all, they're not close now in terms of what they got. I don't think it's that far off, though. I think it's their spending something. I think they made $5 billion last year.
Starting point is 01:06:53 Yeah, it's like $5 billion and then they're spending like $15 billion. So, I mean, it's, you know, operating expenses, something... But no, no, they're losing billions. They're losing billions for sure of a year, but... Well, they're promising hundreds of billions right now. They haven't spent that yet. Yeah, if they promise, they say AMD,
Starting point is 01:07:11 we're going to give you $100 billion to build something. They need to have the cash eventually. They have to give them the money. Hey, do you think Amazon makes money? They don't, they do now. They didn't for a while. Yeah, you know, Amazon shopping still doesn't make money. Right, but you know, like you can acquire users.
Starting point is 01:07:25 You can acquire a lot of stuff to be able to build other things that make money. But in the dot-com bubble, Amazon lost 98% of his value. So, like, in a short term, if it doesn't make money, Pest.com doesn't make, a lot of these companies will go to zero.
Starting point is 01:07:36 Yeah, books a million would be a good one. Yeah, I mean, I'm not saying eventually, of course, clearly AI is something new that is like going to be a big factor. But it just seems to me like that we've gotten way ahead of our skis in terms of what everybody's promising each other. And none of this is making anywhere close
Starting point is 01:07:51 to the amount of money that it would, I think a big thing people don't realize is that spending a bunch of money like these $200 a month, $500 a month coding assistant kind of programs, you got to remember that most of the world, that is a kind of a hefty bill to be able to have as a coding assistant, because they don't make a lot of money coding. Right. Like if you're in the EU right now, and you're just like a mid-level person, you're making $50,000, $60,000 a year. Like, that's not a great amount of money to also be spending thousands of dollars on AI. And so there's
Starting point is 01:08:17 a whole world that exists in which is kind of priced out of this AI. And I think we have a bit of a goofy mindset when it comes to this here in America comparatively to other places. And so I do think that there's going to be a lot of, it's a long-term revenue thing, but the government's going to keep giving the money. The government's going to help this project because I think it's more of a national need
Starting point is 01:08:38 to have good AI because of just like geopolitics than it is because they're trying to make. And you know what? I'd rather have them say that than give me erotic text because it's just like, yeah, okay, I understand that argument much, much better than anime titties. Like when it comes to making a way,
Starting point is 01:08:52 money. It's like one makes way more sense. I get the purpose of this as opposed to the other. But I don't think we're ever going to get that answer. It's going to be the love of the game and I'd never do that. Also anime today is. Well, so I'm curious what you think. Because we never actually talked about this, but I think you did on your clips channel. But funny quote from the CEO of Anthropic, which is basically saying, well, yeah, we were not profitable as a company. But, you know, when we trained our first AI, it costs, let's say, $10 million. And then it actually made us $15 million. So we did make a profit. But by the time it had made $15 million, we had spent a billion dollars on the next model.
Starting point is 01:09:28 So technically we didn't make money. But then that model, the following year, made $2 billion. But that following year, we were spending $20 billion. So it's a bit of a scheme, if you will. It's like a schematic. All right. So here's the question, right, that I pause it. So if the ideas that every year, one of these AI companies, let's say Open AI,
Starting point is 01:09:49 makes the new model and they spend a, you know, shitload of money to make it. And then the following year, they can make a profit as long as they don't keep blowing money on training and making new stuff. In theory, right now, OpenAI could stop making new AI models and could get close to making a profit next year or get a lot closer to it. Yes. And so that feels like there's at least a exit strategy that doesn't ruin the entire thing. How can you ever stop? Because the second you stop, it seems like, and again, you guys are more technical with me, but it seems like whether it's Deep Seek or anyone else, people can catch up rather quickly. And then within six months to a year, you have that model running locally.
Starting point is 01:10:26 Like, it's like, you know, I do. It's like running the profit per unit to the ground. The foundational models, I think, are are really unsteady financially for that exact reason. I do think the government angle makes it. Like, you know, maybe it's just so nationally security important that we can throw collectively our tax dollars into this, whether or not. But I don't see like as a business how this make sense in any direction. I don't, I don't, it doesn't math out to me. I don't get it.
Starting point is 01:10:51 But I think that, that is a good point. There's a lot of ancillary companies or second, like second order companies that do make a lot of money. Curser makes a lot of money from, from chat GPT
Starting point is 01:11:00 and all the other models. Like there is a lot of money to be made. And at the end of the day, all these companies that are making money, a part of that money is also going to these parent models. So like all the derivative programs that are going to crop up over the next five years, which is going to be an enormous amount,
Starting point is 01:11:15 are all going to be, You know, that doctor thing we talked about. That doctor thing pops off. That is revenue going to these companies, right? And so when they say they're not making that much, you just got to remember, like, we haven't even begun the infiltration. People always do this thing where they're just like,
Starting point is 01:11:27 oh, look at this new technology. Next year, it's going to be crazy. It's like, no, society's move slow. It'll be like 10, 15 years before everything's chat chippity. But when that does happen, then it's going to be like, okay, yeah, that's a lot of money they're bringing in. Like, that's going to be a lot, like tokens. Just everybody's going to get tokens.
Starting point is 01:11:41 Overwin free tokens for everybody. Living kids tokens for allowance. Exactly. So I wouldn't worry, I don't worry as much about the profit side in that kind of sense. Because even if Open AI goes down, the tech's there, infrastructure's there. Like something is going to take that place. That's the Jeff Bezos's argument. Jeff Bezos made that argument recently.
Starting point is 01:11:59 And I can see that. But it just sound, you know, that part in the middle, the part where it's like everything goes down, but we still have all these GPUs and we built something cool. That part in the middle is like everyone's 401K going to fucking 50%. You know, it's like it's like, it's like, yeah. economic problems that I that I feel like we're barreling towards. But I think that's a fair argument. I wanted to ask, because you guys met with Newsom
Starting point is 01:12:24 and Newsom recently signed, I think, is the first piece of AI regulation in America. SB 53. SB 53. And I wanted to know more about that and hear about what's going on because this is like, you know, California has done regulations in fields like EVs and other things that kind of led the nation
Starting point is 01:12:41 because they've did it first. And if this is going to be something that's going to be broader adopted in America, What are the odds that you would talk about this? Well, as long as we are. So the first bit is SB 1047, which is last year there was a big AI bill that went all that was approved by the California legislature and then went to Governor Newsom and he vetoed it. It was very controversial because it was basically a lot of requirements that it would have put on AI developers and given that California hosts almost all of the big AI developers and it would have meant anybody who's even trying to like use their business in California essentially a California. California AI bill is a world AI bill. So it's much, much... Outside of China. Yes, outside of China.
Starting point is 01:13:22 It's much, much more consequential than just California. So this bill came out last year that went all the way to the governor to sign, and it had things like if you're making large AI models, you have to plan out safety and security. You have to have a kill switch. This is genuinely, I do not think is a good idea, which is the idea that if something is deemed to be a problematic, you have the ability to shut it all down.
Starting point is 01:13:45 That makes sense on paper, except that's not really how AI models work. You can distribute them to anybody on any computer. And so that only works if you only ever keep your AI model. The evidence means a big button on his desk that can stop the Terminator. Yeah, again, the only way that that would work in practice is every single person's computer shuts down. Right. If he has a button that turns off the electricity, he could do that. And otherwise, you cannot do that.
Starting point is 01:14:09 Statements of compliance, third party audits from the government, a new agency that's overseeing anything, huge civil penalties. if you go against all this. So Newsom said, while well-intentioned, it doesn't take into account whether an AI system is deployed in high-risk environments. To be frank, he said a lot of political stuff. I think the tech industry was just very, very upset. And the core criticism is you are putting in a ton of regulation
Starting point is 01:14:31 upon a ton of like sort of bureaucratic work that AI companies have to do, a ton of penalties in case things go wrong. This is too much for an industry that we really still have no idea what's going on. Everybody is trying to figure out what this is, how to make it. You want to leave the opportunity for a company like Deke-Seek to come in and create something that's totally new and not have them be throttled by having to go through all of these layers of California bureaucracy.
Starting point is 01:14:55 That was the criticism. Tech companies were very happy. It got vetoed. Other people, not so much. So this year, there's a new one. And so when we were talking to our great friend Gavin Newsom, he did mention this specifically. And somebody brought up, oh, fear around AI and how that's making people feel like just the world is a little more scary and unknowable. and there's too much misinformation.
Starting point is 01:15:14 And he said with a lot of pride how they just signed SB 53. This is about half a month ago, September 29th. So this is again, it's applying to large models. And basically what it does this time is you have to submit a report one time a year to the government. So it's chill as fuck now.
Starting point is 01:15:31 There's also some other computing stuff, but the core thing for a company... I want to talk about the report for a quick second. Okay. It's a lot of paperwork. It's going to be a very in-depth thing. And if you don't... But if you don't, you get to pay a million-dollar
Starting point is 01:15:42 fine. So those multi-billion-dollar companies are going to be like, brutal. Do I hire millions of dollars with the staff to be able to create this port? Or do I just simply take the million-dollar head? Dude, Atriott could pay that fine. That part I thought was very hilarious because what I see there is that this uncompetitive advantage for people that are in like this $500 million to a billion-dollar range. Because that's a million dollars is a much larger amount of money to these smaller companies. And you have to hire, like it's going to be a pretty full-time multi-person. role to produce very good document like due to all the things that they have to do it's going to it's it doesn't feel like greatly competitive that singular point because it hurts big small yeah hurts the small
Starting point is 01:16:24 more than the big yeah like the small like the zero to 500 million they don't have to do the reporting or there's some small amount of reporting they have to do oh the medium yeah yeah so it's like the medium ones that a million dollar hit actually does mean something yeah they don't want that yeah but it's it's just like it's kind of like it's a weird place to be like I understand the idea but it kind of, it's kind of a little bit of emotional, painful. It's also there's no, there's no enforcement. There's nothing, nothing happens. Oh, yeah, and the AG has to first go and sue them.
Starting point is 01:16:51 So before they can do the million dollar thing, like, there has to be the AG being like, Oh, interesting. And that anthropic, son of a bitch did not have my report about that's by Monday. That's it, right? That's our AG's talking California. Yeah, yeah. He has to sue himself.
Starting point is 01:17:05 Famous California AG accent right there. That damn son of a bitch. Y'all making a shot out there. need to give us reports. Okay, I didn't think through the accent. They have to evaluate. I thought it was interesting. What a catastrophic risk,
Starting point is 01:17:22 which is any outcome of a model update or an entirely new project that would be released, anything that would result in the death or serious entry of more than 50 people. And they have to, and they have to evaluate that. Or a billion dollars. Or a billion dollars.
Starting point is 01:17:40 But my new update's going to kill 40. people and lose us 900 million. That's chill. That's chill. No report on that one. That's chill. And let's just look at how much a human life is worth according to that.
Starting point is 01:17:51 It is about $20 million dollars of human life. It's kind of when I read that I was just like, oh, that's kind of funny. It has to be 50 or more. Yeah. I thought the one standout really clear cut good thing to me seemed like the whistleblower protections.
Starting point is 01:18:06 Yeah. Which is that someone can come out and say, hey, this company I'm working for is doing these things that are potentially going to damage a lot of people and they don't have to deal with the fear of retaliation
Starting point is 01:18:17 for coming out with that information. The rest of it struck me as well, I could just evaluate and spend a bunch of time saying that even if I'm not willing to pay the fine, right? I could make the documentation argument for this isn't that risky.
Starting point is 01:18:34 Like it's not that big of a deal. Or you're like, yeah, we had a team go through and read team this and we think it's really safe and to be fair, they do. The companies do actually do this to varying degrees. Anthropic is great at this. And they do a ton of work. They put a ton of effort into just trying to figure out how to make these things safer and understand them. Earlier what we talked about, the whole thing about finding that you can poison pill it. Like, that's not to their advantage to tell people about that or to research. That is interesting that they did that research and published it.
Starting point is 01:19:01 No, they have a great track record of safety. And that's like a big thing for them. And they're unsure if it's going to affect frontier models because maybe there is like a scale that's like so big you can't do $250. They're not sure. I can't yell the slurs if there's 50 million people. Yeah, yeah, yeah. There might be a amount of people. It could overpower these machines. With this in mind, with this,
Starting point is 01:19:21 I'm not going to overpower the machine. You might. With this in mind, in contrast to what the reaction was like to the previous bill that was vetoed, what is the tech world reaction to this right now that you guys understand? Because just from our evaluation,
Starting point is 01:19:37 even reading the differences between these two things, right? this seems a lot more agreeable or looser, but at the same time, I'm sure to some people, any amount of regulation is going to be too much. Yeah. Yeah, essentially that, this is,
Starting point is 01:19:51 so just to be clear, what actually got signed and California has a legitimate AI legislation, regulation bill now is super mellow. It's like you have to report to the government, what you're doing, how to hopefully make it safer, you have to report if there's a horrible accident
Starting point is 01:20:06 and you have to protect whistleblowers. It is something, it's better than nothing. Is it, but, Is it mellow enough that the tech executives are like, this is chill? So most are yes. Most still are like, this doesn't feel great. And then there's the concerns from you about medium-sized companies being like,
Starting point is 01:20:21 come on, like, what is this even doing? You've got like a good spirit here. To me and the sentiment I read, it like checks off enough boxes to be like, we did make regulation. And for frankly, Gavin Newsom in this room to say, we talked with Faye Lee and we made this thing that teeters on the, line and he does a lot of the hand motion. He literally, you know, he's like, he did do teetering on life.
Starting point is 01:20:43 He said teetering on the line and he said, this is, this, this bill is really a collaboration between all the companies. I would say it's a win for the AI companies while being enough that technically there's something. And it's, it's not nothing. It's just, there's just much less. And so you compare with the, you said with with the VC. So there are some people who are really critical. I'll just come in with the, with the opposite take. I think it's just a, um, governmental masturbation in the sense that a, let's say I am a company and I produce a report.
Starting point is 01:21:09 who's verifying these. Who, the government masturbation? Who's, like, verifies, I'm trying to do the hand gestures here. Who's the expert? Who actually validates that these reports are real? Who's going to prosecute the things that are faking? Who knows what the things are lying? Like Enron exists, and we created something called XBRL,
Starting point is 01:21:24 which prevents companies, at least largely lying through, what, 2007, 2008 to do all this. Like, there's nothing here that actually puts teeth into it that's going to be effective enough for big companies. I know we don't have really time to talk about the whole Anthropic being sued thing, but they got, they took the world's, books and got charged $1.6 billion and they're like, cool.
Starting point is 01:21:44 It's a pretty not a bad price for the world's books. So they can, they can, or stealing every book in the world. I mean, I would make that deal. They would close that deal. They can skip the next 1,600 reports for the same cost. Yeah. Like that's, they could kill 50 people a lot of times and been like,
Starting point is 01:22:01 I didn't file a report either. My bad. Right. Like, and no one would like the government, they'll get civil lawsuits from the people, but, you know, the non-dead part of the people, but, you know, but nonetheless, it's like, okay, so there's no teeth here. This just feels like regulation for the sake of regulation because there's a loud contingent of people, which rightly so, I think, do not like AI.
Starting point is 01:22:19 Right. And once some. Or when I say rightly so, I mean, they're in the right ballpark, though they're angry for reasons. I think they're mostly found out of ignorance and all this kind of stuff, but they're still angry about it. And it's just like, okay, you're trying to appease a crowd, but you're not providing any sort of teeth or real regulation.
Starting point is 01:22:32 You're just like, safety, reports. One million dollars. And you're just like, but what the hell is the point? the one thing you brought up though, I love that part. Like we should definitely have whistleblowers and we should make that like super awesome. Yeah,
Starting point is 01:22:45 every company has to have a way for people to anonymously report. Like they actually have to have an ability for a whistleblower. Because I want to know if like Sam Altman's going to make like the biggest animas out there. Like we need to have someone reporting that immediately. That's important.
Starting point is 01:22:59 We need somebody to get ahead of that. I need that to be leaked. How does that compare with Europe and China? Like how, what are they doing in regulation? As far as I know, the rest of America, none. California, this bill, which is very light, Europe and China.
Starting point is 01:23:12 Well, can I, can I just, can I just jump in here really quickly? Just it's very, very important. Well, first off, when we say AI, we're talking about LLMs. Okay, this is very important. And so obviously there's, uh, there's LLMs from the minstrel reason, uh, region of France. And then there's just sparkling LOMs everywhere else. Okay. But you can actually see the real difference is because what, what is Europe producing?
Starting point is 01:23:34 Minstrel. Like that's their only one. Yeah. What is it? What is China producing? Lots. What is America producing? Lots. You can see the effects of regulation. Like it's it, you just use your eyeballs and look at
Starting point is 01:23:44 company count and you just watch it happen. Yeah. So there's four main bodies, I think, that are relevant. There's California and then the US federal government, which weirdly are kind of different. Again, California, if they make really strict regulation, would in some ways override the federal one in weird ways. But our federal government right now, under David Sachs and Trump, are trying to do as little regulation as possible, essentially zero. California now has this bill that we just talked about. Something, it's very minimal. The two other big players, Europe and China.
Starting point is 01:24:12 China actually does have some regulation, but it's almost entirely around generative AI. So it's basically just like if you generate AI images, video text, whatever, it has to be labeled. They also have to, shocker, submit their algorithms to the government for review. So it's like they need to be clear with users when stuff is AI generated and the government gets to come in
Starting point is 01:24:33 and look at it, not a shocker. That first rule sounds really good. You can't make like Xi Jinping smoking weed with Mario. I hate to say I'm on team China here for a second, but I like that labeling. Yeah. Yeah. No. So that rule specifically is what a lot of people are clamoring for because everyone's scrubbing the watermark off of a sore of videos and claiming someone committed a crime.
Starting point is 01:24:53 You know, it's like there's like there's consequences without if it's labeled, it's goofy. But if it's not labeled, it's a problem. Correct. Yeah. So that's good. Then I want to see Gavin Newsom and Trump dancing. Yeah. I don't know that.
Starting point is 01:25:04 I think it's funny. It's funny. I hate wondering if that's real. I know. I keep thinking their best friends and I keep getting duped every time. So, and then there's the EU, which is the polar fucking opposite.
Starting point is 01:25:15 And as much as it's easy, I think, you know, certainly for folks of their audience who are like, well, of course there should be regulation on AI. It's too dangerous and whatnot. Again, the real challenge is, if you believe this is going to be
Starting point is 01:25:24 really impactful for a lot of industries and make a huge difference, if you make it obscenely difficult to build a thing or to experiment or research and try new stuff and have all of these rules, all this bureaucracy, all these punishments financially, then people aren't going to make stuff in your area. And that is
Starting point is 01:25:39 what has happened with the EU. So they enabled the or signed the AI Act in 2024. It's currently being rolled out so companies like this year are starting to follow along with it. What it quickly does breaks AI companies into three tiers. One is these are prohibited. These cannot be in the EU. It's basically anything that does like dystopian social credit system type stuff or allows authorities to in real time do biometric identification of people. So that stuff is just banned. But then there's high risk systems and general purpose AI. The definition of high risk is confusing, which is part of the criticism. It's like critical infrastructure, education, employment or business, essential public and private services, law enforcement, migration control, and justice or democracy.
Starting point is 01:26:22 Oh, everything. That could mean fucking everything. Yeah, that's everything. Yeah. And so for that category, you have to establish and maintain a risk management system. You have to validate and test all of your data and make all of that public with the government, do tons of documentation and record keeping, transparency to all users about everything going on. There has to be humans that come in and audit all of your stuff. And there are massive fines for not doing this, including up to 7% of your global revenue gets fined if you don't do this. And this isn't just companies who are headquartered in the EU. This is like Open AI, Chat, Chabit. T, if they they have chat GPT running in the EU and they break these rules,
Starting point is 01:27:00 that you can go to them and say, we are finding you 7% of your year's profit. Not even profit, revenue. Yeah, revenue. Revenue. Revenue. Revenue. They'd be free.
Starting point is 01:27:08 Yeah. Oh, you lost money. That's a negative number, but. And then the last category is general purpose AI models. Basically everything else. There's still a lot of documentation, public summaries of what's going on. These laws also have a lot of definition around copyright law. And this, I think, is good.
Starting point is 01:27:25 very clearly defining that you can't train data on stuff you don't have access to. If it's behind a subscription or a paywall, then you can't use it. And you're still on the hook if you end up taking a bunch of data from websites where those websites stole it, right? So if there's, yeah, so this is the anthropic thing. If there's a company out there that stole every book, and they have 500,000 books, and I go and they tell me, oh, yeah, these are all chill. And then I go there and I make an AI model off of it. If it's clear that that website has, illegal books. I'm now on the hook and the EU can charge me 7%. So
Starting point is 01:27:59 it's not clear always. Well, it's weird is there's just no way that not every single AI company's in violation of those rules. Correct. They are. Absolutely. And there's no way they're going to be able to actually charge 7% of revenue on every major country. It won't. Yeah. I'm more
Starting point is 01:28:15 worried that first I got to say this again before the comments just explode this whole YouTuber problem is that the EU loves regulation when it comes to the internet, right? This is very well known. And there are some good ones. Like I love right to forget.
Starting point is 01:28:28 Like that is a beautiful thing that I can go to any company to say, hey, you have to delete my data. Like I love that. I think that that we should all have that. But this is going to cause like I can foresee one day that there's like the EU black zone. It's just like in here there's no AI allowed. We don't do AI.
Starting point is 01:28:42 All AI companies just bail out and say, sorry, we know we stole and you are going to sue us. Therefore you don't get it. And like what is that going to do to the average person there? And so that's like my more bigger worry is these kind of overreaching things. I'm moving a year above that. That sounds great. But I do want to say, you know, based on the positive outlook here,
Starting point is 01:28:58 if this is the next industrial revolution or something, that would put Europe in such a backwards position. It'd be tough. So a couple of notable quotes here. So one is from Emmanuel Macron, president of France. We can decide to regulate much faster and much stronger than our major competitors. But we will regulate things that we no longer produce or invent. This is never a good idea.
Starting point is 01:29:17 There was one from a Berlin AI agency that's like 60% of what we're building using AI for clients, never leave because they, the potential clients are like, we don't know what's going to be allowed under this AI Act. We're just not even going to risk using AI, let alone making AI. And then Sam Altman from OpenAI says,
Starting point is 01:29:35 we're going to try to comply. We have a lot of criticisms on the way the act is currently worded. And then what's funny is, I didn't know this. EU also then has codes they released, which is like a pregame for the law. So they released this set of codes
Starting point is 01:29:48 that they want all the companies to sign. This is in a few months ago that they're like, hey, in preparation for our big AI act being enacted soon. We want you to also sign this code, which says you're going to follow all these other rules, which apparently are not even the same
Starting point is 01:30:01 as the original AI act. And so meta, Facebook just said, no. They said, we're not signing your thing. And then they might just not be allowed in the EU to do their AI stuff in a few months when this starts out. So there's a lot of companies. It lose vibes.
Starting point is 01:30:18 Yeah, it was like. But threads is going to go so bad. I can't get on threads and vibes And, but yeah, there's a bunch of companies that are basically like, this feels so excessive. It feels, and again, it's not just about the concept of regulation. It's also the implementation. What the actual wording, because I look through a bunch of it, is very broad. And a lot of people like, we don't even know what we're supposed to do here.
Starting point is 01:30:39 There are so many different regulations and steps you're talking about Europeans, that it's just like prohibitively expensive. And people are just not, there just isn't AI there. There's minstrel. And that's, that's, they have the chat. That's mission. They have the chat. And so it's like there is real genuine harm to this strategy of like, well, let's just
Starting point is 01:30:57 really over aggressively account for everything possible in this very broad way is that people are just going to leave because they don't want to risk this. Yeah. I'm on your team. Yeah. I mean, it's, you know, ideally somewhere in the middle. Like, yeah. I think most people fall in that camp, which is it there should be some kind of regulation,
Starting point is 01:31:15 probably more thorough than what California just passed and probably less thorough than what the EU is doing. Yeah. I mean, everybody's making the guess with uncertainty. in mind, right? Nobody knows what this actually translates into. Like, how much value and meaning does this have to the average person 10 years from now, 20 years from now, 30 years from now? And we're all going to make our best guess as a country or as a society of laying the foundation for the direction we want to go in. And we won't know who's really right until it's, you know,
Starting point is 01:31:44 20, 30 years from now. Wild to live through this, you know? The launch of Chad GBT into now is such a wild, interesting time. And we're all figuring it out live. And it, yeah. I had the exact thought this morning, which was, oh, this is, this is a similar transition to something like the Industrial Revolution or if you were just looking at something basic like, like the automobile or your country deciding to invest really heavily into train infrastructure instead of building a bunch of car infrastructure, right?
Starting point is 01:32:14 How those gambles pay out and translate into life impacts for the average person takes 10, and 20, you know, it could be a hundred years. And also these things cycle too, right? Because there's periods of time where certain countries that were ahead of the game leaned really, really heavily into automobile production and making a more car-based society like the US, right? We leaned into that really heavily to maybe some benefit for a while. And then other countries come around and then build out a bunch of public transportation infrastructure and build their cities in different ways decades later that actually benefits them in the long run. There's some, wave to ride here in each place that you happen to be in. And this is the historic technological
Starting point is 01:32:57 moment of our time that we'll see play out by the time, presumably by the time we die, we'll have an idea of how good or how bad it was. Brian Johnson over here. So I'm going to go with the opposite take of you at the very end. I thought I was on your team, but I realized I'm not on your team. I actually am for significantly less safety in AI models, like massively less, almost zero. Here's the reason why. Hold it. You mean that they are less safe? No, like the safety regulation around it. Like I actually think there should be almost no regulation. Like I hate the copyright side of things.
Starting point is 01:33:27 When I say safety, I mean like controlling of output, auditing, these reports, all that. You think I should be able to get all the images of Mario smoking weed I want. So, well, let me, let me throw it this way. Well, that's the copyright thing. I'm actually not too sure about it. I'm still in the process of really coming to conclusion of how I think about the copyright side of things.
Starting point is 01:33:45 I think there will be more damage done to people distributively about replacing their friendships and their close relationships with chat GPT, like both emotionally and in their life, then being allowed to like build a pipe bomb based on things you found on chat GPT. Like I don't think those things are going to harm many people. I fully agree with you. Like I think the safety we're approaching in these regulations that these internal companies are doing are actually meaningless comparatively to the damage they're doing to people psychologically. Like that's much more things I'm worried about.
Starting point is 01:34:14 And those are like, oh, God, don't worry about that. Get a friend. Friend.com. You can just wear it. And that's going to, like, kill people. Like, that's going to kill people. 100%. I agree with that.
Starting point is 01:34:24 I agree with that. It's going to do way, way more harm than, yeah. I love how they're like, dude, we can't let them know how to build a nuclear reactor. I'm like, brother. Like, that's not, like, no, this is not a thing, man. I'm more, worried about the lonely 16 year old who can only talk to Chad GBT, you know what he's, yeah, like that's going to cause people to interact, like, speaking of this weekend and Twitch, like how many women felt on.
Starting point is 01:34:50 Like this isn't going to help that category. If there's a category, this does not help that category. People are going to be more isolated, more awkward around people. And due to your, which by the way, we had no wacky segments in this. And I'm very upset about that. I'm sorry. But in one of your wacky segments, you had an official eye monitor person that would have to make sure that people are doing enough eye monitoring.
Starting point is 01:35:10 We like, that's what we need. If you need more eye contact for people, more personal interaction. That's the regulation. Yeah, that's the regulation we need. On all humans. Okay. one thing I wanted to touch on is data centers specifically
Starting point is 01:35:23 because it's something that is talked about all the time like these companies are building massive data centers this is something that they have to invest a ton of money into this is where so much of the focus and is and the energy required can you explain as somebody who worked at Netflix like I imagine companies like Netflix companies like YouTube that have existed before this
Starting point is 01:35:46 have massive centers of servers and ways to distribute, you know, the video that I consume all the time, right? And there is clearly a difference in scale here in what these companies require. Can you explain the difference to a normal person like me of why these things demand so much more power, so much more space, and what actually, what is actually happening in these facilities that's different than the big places that are providing me like Netflix video. Yeah. So they're two really different operations.
Starting point is 01:36:23 So to kind of really understand the scene, understand the request response model, HTTP. So right now on the screen is still the Paul, Paul Graham tweet. How I got that is that I went on my computer, went to address, and I made a request that gets sent across the wire. That goes to some sort of server. Am I logged in?
Starting point is 01:36:38 You know, they get all the information out. They go and check a database. They get all this information. Then at the end of the day, they return out some amount of HTML, text, JSON, some data back for you to be able to look at it and peruse that data. And that requires a CPU. Everyone's familiar with the CPU. That just simply processes instructions one at a time.
Starting point is 01:36:56 Now, the amount of power it takes to run one of those machines is still a lot. Like, it's still like if you were to compare you to riding a bicycle, it's, you know, you can go pretty far on it, I'm sure, like a days worth of serving Netflix on a single machine is like you biking a huge amount of distance. So power is kind of goofy to think about in that kind of sense. But it takes power. but AI does not run on a CPU. CPU is what they're really good at is they're like the Hussein Bolt. They're like just, oh, I'm so fast.
Starting point is 01:37:22 But if you had to ask Hussein Bolt to say move a million stones, he would be slow compared to a million people, right? A million people would be able to just crush Hussein Bolt every single time because they can just move so much faster together. And so that's kind of more like a GPU. GPUs use a lot more kind of power. You have these machines that are just all GPUs. They generate a lot of heat.
Starting point is 01:37:43 and they use a lot of power to kind of process all these instructions because what you're doing is doing flops, floating point operations, a lot of just mathematics. It's doing linear algebra across gigantic amounts of data, millions upon millions of operations for you to be able to produce wholesome photos that make your heart happy and all that, right? And that's what's happening on GROC currently right now. And so that's like, sure. That's what's happening. And so that just requires much, much more because for me to say, no, you're logged in is going to be a search on a database, which is going to be a technical terms now, a logarithmic search probably across data,
Starting point is 01:38:17 if not like a constant search, a very fast, just single value lookup. And that can go, okay, hey, this person's logged in versus generating something
Starting point is 01:38:26 is going to require a huge amount of operations doing the Gavin News on. Like a huge amount of them. And like that's why this is so much more power intensive is because one request makes a lot of operations. Like even the most crappy written software, which by the way, software is really crappily written, lots, like tremendous waste in computing cycles is just
Starting point is 01:38:48 like not the same order as it is in computing a bunch of linear operations. And it's just like, they're just vastly different. And so that's why they tend to have this much larger amount of power consumption. And we're only just beginning right now with AI. So all the figures I found about 20% of data center, power and everything, goes to AI. So it's not a huge amount of the data centers and all that. But still, that's a big commanding amount. considering how long it's been going on.
Starting point is 01:39:15 So by 2030, that can be 10 times more. We'll be 98% of all data centers will be that. And then comparatively, the world is actually still pretty small. Comparatively, maybe. I have no doubt. I don't even know if those numbers are to be trusted the ones that I found, but I've just asked GROC, chat GPT, and found some papers on it. And so I'm just like, I think this is writer GROC's telling me the paper that's lying to me.
Starting point is 01:39:34 I don't, you know, I never know the actual answer. This might be silly, but who, like in the actual facilities, who is there? Is it engineers? Is it, like, is it programmers? Is it people that are just making sure that the, the GPUs are cold enough? Like, who is in this giant facility with all these GPU racks? Have you seen Silicon Valley? Yeah.
Starting point is 01:39:58 You know that one guy? That's who, that's who's in the place. No, like, cis admins, if that's probably not the right term. But there's, A, there's going to be a lot of different people in these kind of places. Yeah. There's going to be a whole, like, ranging from every single job, from security all the way up to somebody, you know, a logician going in there and making sure that everyone's having the right logistics and things are being transferred. Because as these things run, computers just break.
Starting point is 01:40:19 So there's people that are, you know, root causing, finding more things out. There's the physical movement of going to a place, pulling out a wrap, changing out the parts, putting something back in to all the identification systems being built that are probably being built maybe in the Silicon Valley for a data center that's running in Godforsaken Ohio, right? Like there's like all these kind of, that's, by the way, that's U.S. Middle East one. Hey, there's two people in the chat. Dude, that's a funny joke right now. That's a good joke.
Starting point is 01:40:43 It's the only one running today. But there's like, that's happening. So it's like who's running this thing? It would be such a complex question to actually answer because there's so much different things going into it because I guarantee you there are millions of lines of software that have been written for Amazon, US, you know, US East or US West to run the way it does
Starting point is 01:41:02 because they have, you know, they have to be such intense monitoring, such intense, all this stuff. There's people overseeing it. So there's no simple question there. Yeah. And that's all conjecture. I'm just guessing based off my software experience
Starting point is 01:41:13 because I've never ran a data center. Yeah. I've ran a, I used a crypto mine in 2013, so I know what it takes to run a few GPUs, my friend. But I, by the way, I sold them all for like $100 each. Still, I'm in a little bit brain today.
Starting point is 01:41:27 Also have 12 walking a wallet. Can't think about it. Got to move on. Getting to CSGO knives like this guy. Yeah. I was thinking about picking up a leisurely activity to help me forget, like, League of Legends, to help me forget the pain of,
Starting point is 01:41:38 crypto and legal legends. No, I don't. I mean, it will have replaced your pain with a different type. Yeah. But I did. We should talk about the water because this is super hot right now. Yeah. Just got brought up.
Starting point is 01:41:48 I know we preceded this one, but we said this is super, super important, which is, I don't know, have you guys heard of the whole water argument going on right now? People say, if I do a Google search,
Starting point is 01:41:55 10 gallons of water going. Yeah, it's just like all this water is going on. Let me put it into perspective. I think Sergey Brin drinks it over at Google. Yeah, he is waterlogged. He's the most hydrated. He's the most hydrated.
Starting point is 01:42:06 He's wet at this point. So every time, like the whole, arguments right now AI is destroying all the water and that's kind of like a big thing people are hearing and you will see this BBC just made some big thing about like in Scotland they have all this water problems because of AI and all this but it turns out pretty much that is just more fear mongering going on right now the amount that the total total global AI usage is is the same amount of water usage as 2008 Google though not very much effectively in the United States it's like eight towns of
Starting point is 01:42:38 16,000 people worth of water. In other words, one golf course uses more water than like globally all the AI. Interesting. So in the United States, it's 8%? It's 7 through 9% I can't remember the exact number. Let's just go for 7, for example. 7% of water is used on golf courses. It's like 0.03% is used on data centers.
Starting point is 01:43:02 Data centers, not even just AI, just data centers. So do those two numbers, you're like, ah, so if we used 1,000. percent or a thousand X more, we'd be as bad as golf. So if we stop using Chad GBT, we could have even more pristine. Golf. We'd be able to make, we haven't framed the threat properly, actually. If we keep expanding AI, we'll have less lush grass on that on the back nine, which I can't have.
Starting point is 01:43:28 Which on the back nine? Because it's more important than the front nine. It's kind of set the tone for the day. That's where I have my nice times. Yeah. Jesus Christ did not know how much water golf uses. Dude, it's so much. It's an insane.
Starting point is 01:43:38 insane. Yeah, like having a hamburger is... Or just people's lawns in general. It's any type of... Hey, well, okay, come on, guys. Let's all be friends here. Burgers or lawns, you might. Just burn the American flag.
Starting point is 01:43:51 Why don't you, huh? Damn, we burn golf courses. I thought we were friends. No, but it's... I wanted to bring that up because while we were in that meeting, someone brought up like, oh, and the water usage. And so I was like, and the water usage. I never, like, I've heard of that.
Starting point is 01:44:03 I always thought it was a lot of water, so I started reading papers. And I was like, oh, we're just wrong. The water usage is not the problem. They're fear mongering with the water usage by comparing it to what a person uses at home. Yeah. And like if you compare it to that, then yes, it sounds like a lot of water. You compare it to any other industry. It's it is not the current concern.
Starting point is 01:44:22 And like I think energy broadly is more concerning. Yes. Water is not. Yeah. Um, one. So I, some of these questions already are kind of fusions of people's suggestions from our fans and community. And a really, probably,
Starting point is 01:44:38 The most recurring question I saw was, hi, I'm a young 20s or I'm going into college. I am a programmer of some kind with how I feel about the industry right now and my trajectory for the future or this industry's trajectory in general, should I change my career path right now? Should I have a sense of optimism of where or how I can work in this space right now because my options feel so limited? So can you speak to that mid to low 20s person who's struggling with that right now? I have a lot to say on it, but Doug, I want to hear yours first.
Starting point is 01:45:14 It is interesting and personally why I wanted to chat about this is because at this Newsom thing, genuinely, there's maybe 12 streamers there. And at one point, people are saying how another streamer brought up the general sense of sort of pessimism and worry about the state of the world. And Gavin just said, is that real? Not to be put, not to put you down. I'm genuinely asking that sense of doom. Like, do you all feel that?
Starting point is 01:45:35 And everybody kind of nodded and said, yeah, things just feel worse nowadays. Things just feel on edge. Feels like we're moving towards civil war. And then Prime was like, no, I think it's great. And then I was like, yeah, I'm kind of with him. And so I am optimistic. I mean, doing this show and fucking, you know, drinking up firehose of horrible news every week. It does, it does make things a little bit worse.
Starting point is 01:45:58 But I'm depressing. Me, I know. Doug, Doug, here's the Sudan Civil War. Yeah, Doug, you don't have been paying attention to the Sudan. 500,000 children have died of famine, Doug. How do you feel now, dogs? I mean, I mean, even, I understand that the broader context of people feeling the doom, but I, so. Right, right.
Starting point is 01:46:18 No, no, no, to specifically get to your question, it's just, it was interesting in that context being like, damn, I, doesn't feel like there's that much optimism right now. For me, the reason I'm optimistic is because I think that somebody who is driven and or creative has more tools to enable their, output in the world and to do something than ever before. And I compare that to myself and my friends 20 years ago to now. And I see people who are able to go make things and not just because of AI, but just all the tools that are available, what the internet has, what YouTube offers with education, what chat Chb-T can do the average person. And I say this for random people. My sister, who's a nurse finding that tech is like making her life way better. My brother-in-law who's fixing his truck now because you can point Chatsub-T at a thing who says, oh, well, that's the
Starting point is 01:47:02 blah, blah, blah piece. And you can do that. this. My cousin who's now able to start a band, even though he's an accountant because these online tools have enabled to work way faster. Me, who's able to learn all this programming at a rate and start to expand my creative repertoire, which has allowed me to hire more people than I would have otherwise and have more output and contribute more to society. So I think that the way society is moving is going to allow, at least for people who want to put themselves out there, have far more ability to do so and to make an impact and to learn, to learn, to keep going to try to make a lot of mistakes.
Starting point is 01:47:33 And that is very inspiring to me. And I think somebody who is creative and driven now has a much, much, there's so much potential. Oh my God, compared to what it was 20 years ago and I think that will keep accelerating. That I find optimistic. What do you think? And there's also a sense which we talked about,
Starting point is 01:47:51 which is that with my type of content, people keep coming up to me and saying, you inspired me to get into programming and I just got a job here. You inspired me to check out contact creation. I was able to pull it off. And I think like I feel incredibly gratified getting that response.
Starting point is 01:48:06 And I keep hearing that from people over and over. I see every single week and I get emails or talk to people in person who say, this did make a difference. I was able to do a thing. I have changed my life in some way. And so I'm like, I know it's possible. Not for every single person, caveat,
Starting point is 01:48:21 comments, commenters, I'm sure are writing things. But that is my broad attitude. And even with all the things we talk about, I'm like, there's so much good. yeah so i got i got a chance to talk a lot with uh michael from cursor he's the CEO and honestly i have such respect for them and what they're doing because a part of their whole mission is that sorry real quick cursor is an a i coding tool so yeah yeah sorry i cursor yeah yeah i coding you can just type in what you want and don't generate code and it can use your project
Starting point is 01:48:49 as a means to generate things more accurately than say going to a website and putting in chat chippity and so uh i got a chance to meet with him talk with him about a bunch of like just stuff they're doing a cursor and a huge part of it that I just have so much respect for them for is that they think the programmer is important. When they look at the world and where they're going, some people would probably see them being like, oh, they're trying to take jobs from people. Instead, they're saying, no, we're enabling people to do anything. And we think that the human element to programming and being a part of it is so important. We're trying to build an editor that makes it easy so you don't have to go somewhere else to use it, but for you to be able to program and do stuff.
Starting point is 01:49:23 Like, it's super important for you to learn these skills because that is going to make you go from okay to great and we can help you get over the hurdles by having ease with AI. And so when I hear these things, I look at the world because, you know, it's super easy to see the Paul Graham's and the other people being like 10,000 lines a day. They're going to build everything. You're going to do nothing, right? Like, um, he also doesn't have that accent. That's my accent for everybody. I'm loving your accent. Thank you. Thanks are great. Thank you. I'll start getting some Irish ones coming out here soon. But when I see all these things, it makes me so hopeful because what I, like, through my experience, through the community, what I see is that,
Starting point is 01:49:57 people just need like positive voices and then they're going to go and they're going to go learn stuff right like it motivates them to go learn stuff and then they realize they can take control of their life when i was young how did i get programming information i either had to look at the only code i could find and guess what it does or buy a book from barns and noble if they even had a book now you can just like ask questions in your super stupid way and it knows what you're trying to ask and say hey you need this this is how it said this is what it means you get like so you get like so much more access to stuff and the people who are taking advantage of that I get so many messages being like you were right this is great programming is fun I'm learning and I actually got a job I'm taking control of my life like I actually get to have my own kind of like freedom and responsibility for my own life as opposed to feeling kind of like a you know like a leaf in the current it's like there's a lot of opportunity so when I see that and I see AI I get happy because at the end of the day it's not taking our jobs it's going to take some level jobs things are going to change yeah the paralegal probably is going to have
Starting point is 01:50:57 have a very hard time in the next little bit, but those that know how to use a, I know everyone says that phrase, I'm not even convinced it's even real. Those that are willing to learn, regardless of how easy or hard it is, those are gonna be the people that gonna have a really awesome potential future.
Starting point is 01:51:12 And I don't think it's just gonna evaporate tomorrow. And so I'm like super hopeful because I think in two years, there's gonna be so many more people that have access to the ability to get that education, to get that life changing stuff than there will be today. And so for me, I look at it like,
Starting point is 01:51:26 as a super, positive future, despite all the potential negative sides. How do you, how do you think that, because I think that I mostly agree with that outlook, and it's a good long-term sentiment. How do you think that contrasts with the guy who just graduated with his CS degree, or if he had graduated eight years ago or 10 years ago, that guy was pretty much guaranteed a job, about a school. And now he's entering a job market that is much, much more challenging where that degree doesn't feel like it translates into anything right now. And I totally agree where the
Starting point is 01:52:09 most capable and willing to learn people who can make the best of whatever circumstance there is, there's always a person who will rise to the top and become successful. Those are also the people who are most inclined to share their rewarding stories with people that they've learned from. but to all the people that are kind of stuck in the glut of the middle right now, what do you say to those people? Like it's, and it's not to be discouraging because at large I do agree with you. And I think the positive trend over the longer term, I just think something we've talked about a lot is there's an unfortunate thing happening right now
Starting point is 01:52:46 where I've said openly, you could be me, the exact same skill set, the exact willingness to work. And, but if you graduated five years after me, you would be in a totally different position that is much, much more difficult. So how do you kind of reconcile that with what you're saying now? So I first want to preface one thing. I'm not talking about all positions or all graduates. Okay. So I know, I don't, I don't know about business. I don't know anything of what they do. I'm not even sure if those degrees were ever real to begin with. But there they are, right? I'm not going to talk about that. My business degree is fake. Or civil engineers or mechanical engineers or even electrical engineers. Like those, I'm just going to
Starting point is 01:53:24 talk about programming because that's the thing I do know. I will say it this way. I graduated, what, 15 years ago? Yeah, 15 years ago. So 15 years ago, I graduated, and I'll tell you this much, that there were a group of people in my class that tried really, really hard. And all of those people were hired. Then there was a group of people in my class that didn't try. None of them got jobs. Like 40% of my class did not get jobs when they graduated. That's a very large percentage. and I'm under the personal belief that the only difference between now and then is that the people who were trying really, really hard had a, it was a requirement of pretty much having a four years of trying really, really hard, whereas now it's like, oh, I did a summer boot camp,
Starting point is 01:54:07 why don't I have a job? I'm trying super, super, super hard. And it's like, yes, you are trying super, super, super hard, but your time scale is, like, vastly different than me. Like, where I was at by the time I was applying for internships versus where you're at applying for internships, like I was significantly more capable than you. I had so much more work. I had so much more of these things.
Starting point is 01:54:26 And so I do think that there's a whole time component that has been shifted on its head that we just are not accounting for at all. Like no one, nobody's being like, oh yeah, but this person's only been learning for three months. It's why don't they have a job? Right? Like there's a whole time scale going on there. And I do, I don't know how much it's actually been affected for those that are like the tryhards because I have, I have so many people that I know that are the
Starting point is 01:54:46 tryhards and they are getting jobs. They are getting good jobs and they're completely junior, 19 year olds getting everything that they need because they've been trying since they've been 12 years old. Yeah. They've taken the long, long road of making a craft as opposed to just trying to get the job. And I know that could be very defeating,
Starting point is 01:55:03 but the problem is that so much of life and so much of expertise is not one on a 100 meter dash. It's one on a marathon and being able to push through that for a long years. Like I had to live in an apartment where the guy below me to threaten to kill me and he was always smoking meth and all that. And it's just crazy down there, right? But that's like that's part of my story, is having to live through that situation, working 80 hours a week, trying to figure out how to get a job.
Starting point is 01:55:25 And so I spent multiple years 80 hours a week trying to get as good as I can to get a job in this industry. And so that's kind of how I look at is that I do think we have, we got a bit, we got a bit messed up in like the ZERP era, the zero interest rate era. Yeah. And that, like, I do think that that really, pardon my language, like that fucked up everything. Like that's actually where people are like, oh, well, why don't I get a job? I've been doing this for six months.
Starting point is 01:55:48 Like they used to pay people $100,000. I'm like, no, that was actually a broken moment. Like that was the bubble. That was the true bubble. And now we're returning, I think, more towards regularness where it's like the people who are trying, the people who are really invested are going to find something still good
Starting point is 01:56:02 at the end of this rainbow. Now in 10 years it will be the same. It will be different, but to what level different, I have no idea. That's my hopeful thing. Hopefully that white pills people in the sense that you get the control. It's up to you to say no.
Starting point is 01:56:15 It's not up to somebody else. I've always had this thing. So being from Montana, being from kind of on the outsider coming into Netflix, one of the big things was everybody else was like these Stanford graduates, these Harvard graduates. And I will tell you this much, you get, you get looked down on quite a bit from being from the South, having a southern accent or being from Montana, being from these places that are considered backwards. Like, you get a lot of discrimination back in those days. I had a lot of hurdles that I had to get over. And what I realize is that, you know, we used to talk about diversity and inclusion. Like, I realized that inclusion, they used to
Starting point is 01:56:47 say is like or diversity is bunch people at the dance inclusion is asking someone to dance and so that's kind of what they said is like everyone gets to dance and I kind of always hated that because I realized I never got to dance and the real thing is that you have to make your own thing and so I would I would go to people and be like you're dancing with me because I'm going to make this thing work because like I want to be here and so I think there's a whole level of control that people still have in their life and especially just around technology that's just super magical that I don't know if it exists anywhere else. So I encourage everyone to don't just go to the dance,
Starting point is 01:57:23 ask people to dance, right? Get in there, be a part of things, and you will find that there's a lot more out there. So that was my passionate. That was great. That was awesome. Thanks so much, Brian, for coming on. I appreciate it.
Starting point is 01:57:33 Thanks, everybody for coming on. Watching this episode, Lemonade Stand. I hope you're motivated and terrified at the same time. Yeah. See all next week. Bye, everybody. Thank you.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.