All-In with Chamath, Jason, Sacks & Friedberg - E122: Is AI the next great computing platform? ChatGPT vs. Google, containing AGI & RESTRICT Act

Episode Date: March 31, 2023

(0:00) Bestie intros! (1:31) Joe Manchin calls out Biden on IRA flip-flop (7:40) Sacks writes GPT-4-powered blog post, OpenAI launches ChatGPT plugins (26:31) Will generative AI be more important than... mobile and the internet itself? Making the case for both Google and OpenAI to win generative AI (50:19) Reaching and containing AGI, AI's impact on job destruction (1:16:35) RESTRICT Act's bait and switch Follow the besties: https://twitter.com/chamath https://linktr.ee/calacanis https://twitter.com/DavidSacks https://twitter.com/friedberg Follow the pod: https://twitter.com/theallinpod https://linktr.ee/allinpodcast Intro Music Credit: https://rb.gy/tppkzl https://twitter.com/yung_spielburg Intro Video Credit: https://twitter.com/TheZachEffect Referenced in the show: https://www.wsj.com/articles/biden-inflation-reduction-act-betrayal-joe-manchin-debt-ceiling-budget-fossil-fuels-green-energy-dc37738e https://sacks.substack.com/p/the-give-to-get-model-for-ai-startups https://sharegpt.com/c/jGKq34x https://openai.com/blog/chatgpt-plugins https://www.theinformation.com/articles/alphabets-google-and-deepmind-pause-grudges-join-forces-to-chase-openai https://commons.wikimedia.org/wiki/File:Noogler_Hat.jpg https://futureoflife.org/open-letter/pause-giant-ai-experiments https://twitter.com/peakcooper/status/1639716822680236032 https://www.reddit.com/r/blender/comments/121lhfq/i_lost_everything_that_made_me_love_my_job https://reason.com/2023/03/29/could-the-restrict-act-criminalize-the-use-of-vpns

Transcript
Discussion (0)
Starting point is 00:00:00 Oh, Jake has here. Hello, Jake. Hey, Harry. Thanks for showing up. I've been here the whole time. I was just having some of these beautiful salted roasted sessions. And we promised when I went to the store, I kid you not. There was a shelf of these. All flavors available except one flavor. Salt and vinegar. See, salt and vinegar.
Starting point is 00:00:20 Entire. We move the market. We move the market. I am not kidding. I go to the fancy you know bespoke the railings went to the railings and trucky I went to the railings and trucky they are seasonal and they have you know all these over price it's called artisanal that's what I said the art stuff the artistic food the artisanal row where they had this, I kid you not, spicy, salty, no salt, every shelf packed. Then there's one shelf, I can see straight through to the ice cream. But not sea salt and vinegar. And I look at the tiny little sign, salt and vinegar, shallots, sea salt and vinegar, sea salt and vinegar, schematics, shallots, salt,
Starting point is 00:01:04 out across the country. You know, I cannot recommend these more highly. They're incredible. You can't recommend your salty nuts more. They are delicious. My salty nuts are delicious. What? For like your winner's ride.
Starting point is 00:01:18 Rainman David's side. I'm going home. And it said we open source it to to the fans and they just go crazy. Love you, West. I'm Queen of King. I'm going crazy. Did you see Joe Manchin's high heater op-ed in the Wall Street Journal? Oh, oh my god.
Starting point is 00:01:37 Yep, Joe Manchin went for it. But Joe Manchin's running for president. He is. I think, okay, so let me ask Sax right there. Sax, Joe Manchin, Nikki Haley, and who's the guy from Florida? That's your question. By the way, there's a big defection that was leaked this week. Ron Latter flipped from Trump to to Santis. That's a big one, because Latter is good for a lot of money, five to 10 million at least. Joe Manchin, what impact
Starting point is 00:02:01 would he have coming to the race? I'm not throwing it. Look for your honest opinion. Well, depends how he comes in. What did you say in the op-ed? He was talking about the insincereity of the Biden administration to control costs and how everybody was incompetent. And it's certainly there's some waste and we can control some spending and everybody needs to grow up and get in a room and just manage the budget for the American people and stop playing politics. Yeah, I think the headline of the article actually to your point, Jakau, was much worse than the substance of the article, Sachs. But if you think the headline of the article actually to your point, Jekyll was much worse than the substance of the article. Sax, but if you see the headline, I don't know, Nick, if you can just throw it up there,
Starting point is 00:02:28 it was brutal. The headline and the byline of the article, I think was more damaging than the substance of the article. Biden's inflation reduction acts betrayal. Instead of implementing the law as intended, his administration subverts it for ideological, ideological ends. I have to think that Joe was responsible for that, for the titling of that article.
Starting point is 00:02:47 You know, he would get permission to approve it. Right. In a bio-level. And by the way, I think if you guys remember, we talked about this when that act was first published, and if you guys remember, I think I pulled up the CBO data, the CBO model, and it showed for the first five years this thing burns a couple hundred billion dollars,
Starting point is 00:03:04 and then there's some expectation that there'll be some sudden boom in revenue in the out years and then you make the money back in the out years. So it's total like accounting shenanigans for him to have made the claim in the first place that the IRA was actually going to be like a net deficit reduction or debt reduction. In fact, it's all just accounting shenanigans and it's just a massive spend package, particularly in the near term when it matters most. I think I told you guys this, but I think this was like, when was the last time I was in Washington? Probably, what is it March now? So maybe it was January I was there. And I saw Schumer and Mark Warner, and I spent about two hours with Manchin. He is really impressive. And I spent about two hours with Manchin. He is really impressive. He's cool, he's interesting, he's thoughtful,
Starting point is 00:03:48 he's moderate. Manchin's like a formidable guy. So this will be really interesting if he steps in there and tries to take a look. So between Mickey Haley and Manchin, where do you write your check? I've probably right to check to both, to be honest. Feels like a good ticket to me.
Starting point is 00:04:02 I've always wanted to see the cross-conference. Could you imagine a Democrat and Republican merging somehow and like running together? It would be the greatest. Oh my God. I've been pitching that for years. I think that's like a my God clear path. David Freiberg may have just come up with one of the most disruptive ideas in American politics that's ever been floated. Oh my God. Imagine how I imagine how I imagine how I imagine how I imagine how I'm doing. Imagine how I, yeah. Just my comment on this. So first of all, I remember when, you know,
Starting point is 00:04:28 I mentioned did a good job stopping Biden's three and a half trillion dollar build back better. Remember it was him and cinema that were the whole doubts. But then, Manchin compromised and gave Biden a $750 billion version of it. And I guess now he's complaining that Biden didn't live up to his end of the bargain in doing the deficit reduction. But quite frankly, many commentators said at the time that the Bill's claims deficit
Starting point is 00:04:50 reduction were preposterous and that would never happen. So quite frankly, you know, Manchin shouldn't have been eukered or hoodwinked by Biden. Everyone was basically saying, there'll never be any deficit reduction out of this Bill. It's just more spending. So I don't really feel bad for mansion here saying that somehow he was betrayed by by the shenanone better now in terms of him running
Starting point is 00:05:12 yeah i think as a democrat who's figured out how to get himself elected west virginia which is a plus twenty red state he obviously knows how to appeal to the center of the problem for him is just how do you get the democratic party nomination because he's far to the right of the problem for him is just how do you get the Democratic Party nomination? Because he's far to the right of your average Democratic Party voter. If he wants to run as an independent, that's a different story.
Starting point is 00:05:31 That would really throw a curveball into the race, but I don't see him doing that. I think it's kind of a stretch. This is the problem with a lot of these fantasy candidates is that, you know, centrist or moderate voters might like them, but they can't get the nomination. They're party. And let's get... You mean my Trump and Obama, those who are fantasy candidates. I don't think so. I mean... Trump was not a fantasy candidate. He's the ultimate. Well, he was an outsider, but he appealed to the party.
Starting point is 00:05:55 He appealed to the base of the party. What I'm saying is in order to get the nomination of a major party, who have to appeal to its base. And I don't think Manchin appeals to the base of the Democratic Party. He's out of step with it. He's out of step with it in ways that I like. Don't get me wrong. But I just, I don't see how he's going to get an nomination. Chris Christie, what do you think of him? He seems like he's about to come in the race too, David.
Starting point is 00:06:16 Pointless. He's viable. Pointless. He's just clutter. Okay, pointless. All right, listen, everybody. Welcome to the all-in podcast. It's like episode 100
Starting point is 00:06:25 something with me again today. The Rain Man himself. Yeah, David Sacks is here. Friedberg is in his garden at his home in Paris. Spring has sprung. The Queen of Quinoa. And of course, the dictator himself, Chimoth, Polly Hoppatiya, the silver fox. Look at that little tough of silver hair. So distinguished. I got a haircut from somebody recently who said that people go to her and ask her to put the silver thing in their hair. Really? I don't have to worry about that. Yeah, for a first guy, it looks like he's in smurf village there. What is that background? That is a scene from I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out.
Starting point is 00:07:07 I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out.
Starting point is 00:07:15 I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out.
Starting point is 00:07:23 I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure out. I don't know if I can figure literally, I did a reverse image search and then I used a chat GPT plugin to automatically figure out. I didn't know that was a game. It's a background each week. Oh, okay. All right, well, let's get started. Come on.
Starting point is 00:07:33 Let's get started. Okay, listen. I look at sex. I got to get out of here. I got to get to the office. The office spoke. Sex feels like he's in a good mood. I like this.
Starting point is 00:07:41 Welcome to the World's greatest podcast. Open AI launched a bunch of chat GPT plugins and I don't know if you saw it, but David Sacks wrote a blog post with chat GPT. It's an amazing back and forth. I've read this back and forth, explain what you did, Sacks. This was really like one of the best conversations I've seen with chat GPT, you know, pop it up here on the screen, but it's needed. Well, I had an idea for a blog post about the use of a, I guess, tactic you could call gift to get. I thought it would be an interesting tactic for AI startups to use if they're trying
Starting point is 00:08:21 to get a hold of proprietary training data. So for example, if you wanted to create an architect AI, you need a lot of plans. Or if you're going to create like a doctor AI, you need a lot of lab results or medical reports to train the AI on. And those are hard to get. Open AI doesn't necessarily have them yet.
Starting point is 00:08:38 So there is an opportunity, I think, for startups to create these AI's and different, you call them professional verticals. So the gift to get technique would be you give points to your users for uploading that data and then they can spend those points by using the AI. And anyway, the company that came up with this gift to get tactic was a company called Jigsaw almost 20 years ago.
Starting point is 00:09:02 No one remembers this company. I'm kind of dating myself because I remembered it. But I just had this idea. Yeah, I wonder if the jigsaw approach could be used for AI startups. So I started by going into chat GPT and I said, hey, have you heard of jigsaw? And then it had.
Starting point is 00:09:16 And then I said, tell me about its gift to get approach. And then I said, would this approach work for AI startups that won proprietary training data sets? And I I said yes, this is a good idea. And then I gave the architect example and I said can you give me more examples like this and it gave me like 20 more examples. And then I asked it just to flesh out various kinds of details. I went down some cold attacks that didn't use. And then at the end I said can you summarize everything we've just talked about in a blog post? And it gave me the first draft of a blog post.
Starting point is 00:09:48 I then did a substantial amount of editing on most of the blog posts, although some of it I just used verbatim. And then I had a couple of people in my firm look at it, they made some good suggestions, so it's not like the human's completely out of the loop. And then I copy and paste in my edited version back into chat GPT said, here's my edit. And then I asked for some suggestions edited version back into chat Gbt said here's my edit and then I asked for some suggestions and made a few small edits and I said okay great to incorporate the edits yourself gave me that final output and then I posted on subtract a blog that probably would have taken me a week to research and write if I don't it at all I was able to do and a day. And I can't see myself going back now I I think this is just how I'm gonna write
Starting point is 00:10:26 all my blog posts is use chat GPT as my researcher, as a writing partner. Some cases an editor, but I'm definitely gonna run it through. The thing that I was struck by was just how kind and generous and thoughtful this conversation was. And I just thought I've never seen Sacks have a conversation where you was so kind to the other person and thoughtful right about now.
Starting point is 00:10:50 Well, your friends and family are like, how do we get Sacks to have this conversation with us? You were super kind to the AI because it's not a person, it was a robot. Oh, no. Well, just in case it takes over the world, Jake, how you can't be too careful. But no, I think listen
Starting point is 00:11:05 it's important to give the AI He's so perfect Perfect, perfect I've never once gotten a thanks from that So when have you ever used an explanation bar? Scroll up and show that example. The AI actually gave me some information about Jigsaw's point system again, the rewards that they used Yeah, and it was just in text.
Starting point is 00:11:25 So I said down below, hey, can you spit that out as a table? And it did instantly. It's like a day's work, right? Like you would have to have an analyst or research and do a day's work. It's incredible. And then I just screenshot of that and I made it an exhibit. You also said, thank you. And then it was like delightful back to you.
Starting point is 00:11:40 I mean, this is a, this is a literal road to you being a fine human being, like all the money that you've spent on therapy and just trying coaching to be nice to people. You're just nice, naturally. This is me. I'm not a good mood today. I don't know why you're instigating him. He's laughing. Come on. It's like, I think it's what is sexing back you to the AI. Perfect. This is confirmatory. What we know, David wants to pay it's money. This is, it's saying, thank you to the AI. Oh, perfect. This is confirmatory of what we know.
Starting point is 00:12:07 David wants to live in a set of highly transactional relationships, ideally with a machine. Who can then eventually help make him money? Can I ask you a question of security, Saks? Did you, what did you enjoy more? Working with your team of humans on this or working with chat GPT, which one was more enjoyable for you, just personal?
Starting point is 00:12:29 Well, I think they're both where I would say that the human contributions were essential. So basically, I'm more. It's not about enjoyment. It's about, this is a job to get done, but it definitely spent things up enormously. I personally find the hardest part of writing a blog is when you're staring at that blank sheet of paper and just having to like spit out the first thousand words. Yes.
Starting point is 00:12:54 It's just so time consuming to do that. But again, if you start with the first draft, even if it's not very good, then you can just edit it and it's species of blog. Yeah. It's great for ideation. But the country is a people in my car were important. Yeah.
Starting point is 00:13:08 I actually trusted it. I know that you probably should fact check it in a way because it can't hallucinate. But the things that we're saying made so much sense to me that I didn't think it was hallucinating. Well, this is a great moment to pivot into what open and I did with plugins. These came fast and furious this week. A bunch of folks who had started verticalized, chat GPT-based projects, MVPs were like, oh, maybe my project MVP is now dead,
Starting point is 00:13:35 because Instacart OpenTable Shopify Slack's Appier, and Zapier obviously, if this then that is a very wide-raging tool that allows you to connect APIs from a multitude of sources. What this all lets you do at the end of the day is have chat GPT ping one of these sources, just like an app might do or some custom software might do, ping the API and return data. So hey, what tables are open on open table, maybe Shopify, um, find me, uh, things to buy in this category, et cetera. And so people have started building little scripts.
Starting point is 00:14:16 We used to call these, uh, when magic leap was out, uh, internet agents and the concept of a software agent, that's existed for a long time actually in computer science I'm sure free-book it will give us some examples of that but also chat GPT can now use a browser so that means you can get around the dated nature of the content in the corpus somebody did things like hey build me a meal plan book me a reservation for Friday night in open tables source other ingredients and buy it for Saturday night on an Insta, cart and then use something like Wolfram Alpha to calculate the calories, et cetera. So when you saw all this drop, Sachs, what did you think in terms of the opportunity for
Starting point is 00:14:59 startups and to build these intelligent agents, things that will do if this, then that, or just background tasks over time, and you could actually leave them running. Yeah, I mean, I think this is the most important developer platform since the iPhone and the launch of iOS in the App Store, and I would argue maybe ever in our industry, certainly since the beginning of the internet.
Starting point is 00:15:24 I think there was a question when ChatGPT launched on November 30th and people start playing within December, what exactly OpenAI's product strategy was going to be? Was this just like a proof of concept or a demo? And they even kind of called it like a demo. And initially it looked like what their business model was going to be was providing an intelligence API that other websites, other applications could incorporate. And we saw some really cool demos like that notion demo of other applications incorporating AI capabilities. And so initially it looked like what OpenAI was going to be was more like Stripe where in the same way that Stripe made payments functionality available very easily through developer platform.
Starting point is 00:16:09 They were going to make AI capabilities available through their developer platform. And then I think a funny thing happened on the way to this announcement, which is they became the fastest growing application of all time. I'm talking about chat GBT over Over 100 million users in two months. Nobody else has ever done that before. I think it took the iPhone two years plus Gmail, Google, those products all took, I think, well over a year. So this became the fastest growing site of all time. And I think with plugins, what they're indicating
Starting point is 00:16:41 is that they will become a destination site. This is not just a developer platform, this is a destination site. And through plugins, they are now incorporating the ability to basically, you know, anything you could do through an application, you will now be able to do through a plugin. You'll just tell chat GPT what you want done. If you say, hey, book me a plane ticket on this date, it will go into Chi-Aats plugin and do that. You say book me a plane ticket, and then an Airbnb for this trip.
Starting point is 00:17:08 So the problem of Siri and Alexa realized, because those were very rigid, they had no intelligence, right? Friedberg, if you wanted Siri to do something specific like useways, or to go get you an open table, it needed to be pretty specific and it didn't have any kind of natural language model behind it. So this is taking existing APIs and putting a natural language layer in front of it, which makes it, you know, perform a little more naturally. Is that what we're seeing here, Fribert? I think it provides access to a corpus of data and a suite of services that are not well integrated into a search or chat interface anywhere today.
Starting point is 00:17:50 So knowing what restaurants have, what seats available is in a closed service. It's in a data warehouse operated by an open table. And now what open table can do is provide an API into that data via an interface and make an allow chat GPT to make a request to figure that data out to give a response to a user. Where they can ultimately benefit from transacting and allowing a service. This closes the loop between search and commerce in a way that Google cannot and does not do today. And I think that's what makes it very powerful. We've seen this attempted in a number of important ways in the last couple of years with Alexa and Apple Home and Google Home kind of integration via the chat services that they offer, you know, where you speak to the device. But the deep integration that's possible now and the natural language way that you can go from the request all the way through to the device. But the deep integration that's possible now,
Starting point is 00:18:45 and the natural language way that you can go from the request all the way through to the transaction, is what makes this so extremely powerful. And I think, you know, the points I made a few weeks ago, when we first talked about, you know, search, having so many searches that are done, where the human computer interface presents a table or presents a chart or presents a shopping list in a matrix, that's what makes search such a defensible product.
Starting point is 00:19:12 I think could theoretically be completely obviated or destroyed with an interface like this, where you can write the ability for chat GPT or whatever the core centralized services to actually present results in a table, in a matrix, in an interface, in a shopping list, and actually close the transaction loop. It's really disruptive to things like commerce providers, it's really disruptive, some of these commerce platforms, it's really disruptive to a lot of different industries, but also introduces a lot of real opportunity to build on top of that capability and that functionality to rewrite and ultimately make things easier and better for consumers on the internet.
Starting point is 00:19:49 What do you think, Tremoth, you're looking at this, and it seems to be moving at a very fast pace over 100 million users. They put a business model on it already, 20 bucks a month. They have a secondary business model of, hey, use the API and we'll charge you for usage. And then you layer on what Zapier and if this then that had already sort of established in the world, which is APIs, but nobody ever really wanted to write scripts. So that seemed to be the blocker. You go into Zapier if this isn't that.
Starting point is 00:20:16 It's where 5% of the audience, people want to customize stuff, people who want to tinker. But this seems to now with the chat GPT chat interface, open it up to a lot of people. So is this super significant or is this a commodity product that you know 10 people will have for sitting here next year on all in episode 220? I think you are asking the exact right question and you use the a great term like in poker if there are three hearts on the board and you have the ace of hearts. You have what's called the nut blocker, right? Which means that nobody else, even if anybody else has a flush, they never have the best flush. And if flush is the best hand, there's a lot of ways that you can manipulate the
Starting point is 00:20:56 pot and eventually win the pot because you have that ace of hearts and nobody else has it. The concept of blocker, I think, is very important to understand here, which is what are the real blockers for this capability to not be broadly available? So I think you have to segregate. You have the end user destination, you have the language model, and then you have the third party services. And so if you ask the question, what is the incentive of the third party service? Well, the shareholders of a travel site, right? They're not interested in doing an exclusive deal with any distribution endpoint.
Starting point is 00:21:37 They want their services integrated as broadly as possible, right? So I think the answer for the service providers is just like they build an app for iOS, and for Google, and you know, if they could have justified it, they would have built an app for a gaming console. They can. They should. They would. They do. Right? So that's going to get commoditized and broadly available. I think on the LLM side, I think we've talked about this. Everybody's converging on each other.
Starting point is 00:22:05 In fact, there was an interesting article that was released that said that there was a handful of Google engineers that quit because apparently Bard was actually learning on top of chat GPT, which they felt was either legal or unethical or something. So the point is, I think we've talked about this for a while, but all of these models will converge in the absence of highly unique data, what I've been calling these white truffles. So if you can hoard white truffles, your model will be better. Otherwise, your model will be the same as everybody else's model.
Starting point is 00:22:43 And then you have the distribution endpoints of which there are many whose economic incentives are very high, right? So Facebook doesn't want to just sit around and have all this traffic go to chat GPT. They want to be able to enable Instagram users and WhatsApp users and Facebook users to interact through Messenger, what have you. Obviously Google has many hundreds of billions of reasons to defend their territory. So I think all of this to me just means that these are really important use cases. As an investor, I think it's important to just stay a little patient because it's
Starting point is 00:23:19 not clear to me that there are any natural blockers. But I do think that David's right, that it's demonstrating a use case that's important. But it's still so early, we are six weeks in. Yeah, I tell you, I think there's a couple of great blockers here, or there's going to be an M&A Bonanza for Silicon Valley. If you look at certain data sets, Reddit, Stack Overflow for programming, and Cora, these things are gonna be worth a fortune and to be able to buy those or get exclusive licenses to those, if you're Google BARD or if you're a chat GPT,
Starting point is 00:23:53 that could be a major difference make or Twitter's data set, obviously. And then you look at certain tools like Zapier and if this and that, they've spent a decade building this sort of meta API, that would be an incredible blocker. I think this is gonna be like a b building the sort of meta API. That would be an incredible blocker. I think this is gonna be like a blockalization of so many all sorts of things.
Starting point is 00:24:10 So we're right into it for free. They didn't plug into it for free. Exactly. I was just gonna say, I don't think these are not blockers. I don't think this is the ace of hearts of a flush board. I don't think so. I think that these things are really interesting assets. They are definitely,
Starting point is 00:24:23 truffly in nature, but they may not be the 10 pound white trouble these things are really interesting assets. They are definitely, truffly in nature, but they may not be the 10 pound white trouble from all of them that we're looking for. But on the M&A side, don't you think? This would be like incredible. But the only reason I say that again is it is just so early. In the text, I mentioned this to you guys. I remember, and Saks and I were in the middle of this.
Starting point is 00:24:42 We were both right at the beginning of social networking. Saks started genie, I was in the middle of this. We were both right at the beginning of social networking. Saks started Genie. I was in the middle of aim. And all of a sudden we saw Reed start social net. Then we saw. Forensic or get started. Then we saw my space get started.
Starting point is 00:24:56 And you have to remember when you look back now 20 years later, the winner was the seventh company, which was Facebook, not the first, not the second. It was the seventh, which started two and a half years properly after the entire Web Point 2.0 phenomenon started. Yeah. Same with search, by the way, where Google was probably 20, to the scene. Yep. Excite like a...
Starting point is 00:25:18 If you want to be a real student of business history, I'll just say something that's more meta, which is, if there's something that I've learned on the heels of this SVB fiasco, is that there is an enormous amount of negative perception of Silicon Valley and frankly a lot of disdain for VCs and prognosticating technologists, right? And I think that we have to be very careful. Yeah, and I do think that we are to be very careful. Yeah, and I do think that we are an example of that because we are the bright, shiny object
Starting point is 00:25:49 of the people that were successful. And the broad makeup of America thinks that we're not nearly as smart as we all think we are. And after all of this money that's been burned in crypto land and NFTs and all of this web three nonsense, to yet again whip up the next hype cycle, I think doesn't serve us well.
Starting point is 00:26:08 So I do think there's something very important here, but I think if we want to maintain reputational capital through this cycle, because government will get involved much faster in this cycle, I think it's important to just be methodical and thoughtful, iterate, experiment, but it's too early to call it, I guess is what I would say. Yeah, it's definitely too early to call it, but, SAC, you're saying explicitly, you think this is bigger than the internet itself.
Starting point is 00:26:36 Bigger than mobile has a platform shift. It's definitely top three, and I think it might be the biggest ever. I think, look, I think things could certainly play out the way that Jamoth is saying. However, I actually think that OpenAI has demonstrated now with these platform features that it has a lead, a substantial lead, and I actually think that lead is likely to grow in the next year. And let me tell you why.
Starting point is 00:26:59 I think it's got a couple of assets here that are hard to replicate. So number one, user attention. I think they've now got, I would guess hundreds of millions of users. And this thing is caught on like wildfire. Must have been beyond their wildest dream. I think I'd even surprised them how much this has taken off. It's really captured the public's imagination. And people are discovering new use cases for it every day. If you are sort of the number two or number three, the seventh, large
Starting point is 00:27:26 language model to basically get deployed behind a chatbot, I just don't think you're going to get that kind of distribution because the novelty factor will have worn off and people will have already kind of learned to use chat GBT. So number one is the hundreds of millions of eyeballs. Number two is with this developer platform, I think we should describe a couple of other features of it. One of the problems with ChatGPT, if you've used it, is that the training data ends in 2021. And so you very rapidly, for many questions, get to a stopping point where it says, like, I don't, I don't know the answer to that because I don't have any information about the last two years. Well, one of the plugins that OpenAI is introduced to itself is called
Starting point is 00:28:05 the browsing plugin, and it allows ChadGPT to go search the internet. And not just run internet searches, but to run an internet search as if it were a human. So you ask ChadGPT a question, and it runs a search, and then it scours through the list of 20 20 links and it doesn't stop until it finds a good answer And then it comes back to you with just the answer so it actually saves you the time of clicking through all those loops And it'll give you the browsing history to show you what it did. That's mind blowing They also have a thing called a retrieval API Which allows developers to share proprietary knowledge bases with chat GPT So if you have a company knowledge base or some other kind of content,
Starting point is 00:28:47 you can share with chat GPT so that chat GPT can be aware of that. And there are some privacy concerns, but the company is said they're gonna sandbox that data and protect it. As an example, I'm planning on writing a book on SaaS using chat GPT and I'm gonna put together all the previous articles and talks I've done as a database, so I can then
Starting point is 00:29:05 work with that in ChatGPT. So you're going to have more and more developers sharing information with ChatGPT. You're going to have ChatGPT able to update its training based on sort of the last two years, be able to search the internet. And I think that as those hundreds of millions of users use the product, and as developers keep
Starting point is 00:29:26 sharing more and more of these data sets, the AI is going to get smarter and smarter. And then what's going to happen is both consumers and developers are going to want to use or build on the smartest API. Yeah, so this is where it feeds on itself. I mean, I think there might be a, I agree with much of what you're saying, but I do think somebody like Facebook, when they release their language model, which they're about to, is not going to allow chat GPT to have any access to the Facebook Corpus of data. And then LinkedIn will do the same.
Starting point is 00:29:54 They'll block any access to chat GPT to their data. And so then you might say, you know what? I'm doing something related to business and business contacts. I need to use the LinkedIn one. And they're just going to block other people's usage. I'm going to tell you, contacts, I need to use the LinkedIn one. And they're just gonna block other people's usage I'm gonna tell you, hey, you have to come to our interface and have a pro account on LinkedIn. And this all becomes little islands of data. And so I'm not sure that. Maybe you're right, Jake.
Starting point is 00:30:13 I was too early to have a definitive opinion, but I would say- You have to believe plugins are gonna be promiscuous. Yes, exactly. Plugins are the refutation of your idea. Facebook does not have an API. Twitter turned off their API. People who are smart with data says, Cora doesn't let people use its data. So I just picked three. Those are
Starting point is 00:30:29 three incredible data sets that don't allow people and Craigslist doesn't. So people who are smart do not allow APIs into their data. They keep it for themselves. I think there were a lot of people when the App Store rolled out that swore up and down. They never built a mobile app because they didn't want to give Apple that kind of power that the internet was open, whereas the App Store is closed and curated by Apple. And sure enough, they all, at the end of the day, had to roll out apps, even though in the case of Facebook,
Starting point is 00:30:54 it definitely has made them vulnerable because they're downstream of Apple. I mean, Apple now has enormous influence over Facebook's advertising revenue because users have to go through Apple. They never had to do that before the internet. Nonetheless, Facebook felt compelled to release a mobile app
Starting point is 00:31:10 because they knew it was existential for them if they didn't. And I believe that was happening is. I don't think it's right now as you, the right now as you would be Google search, does Facebook, does Craigslist allow their data to be indexed inside of Google search answers? No, right, they block that for a reason.
Starting point is 00:31:24 And they will write a cease and disease letter. But what? Fine. So, so you know what? Those guys will stay out of it, but look how much content Google search already has. And I think that chat GPT will start by eating a substantial portion of search because again, you don't have to go through the 20 links. It just gives you the answer. It's going to eat a substantial portion of browser usage and app usage because you're just going to tell chat GPT what you want to do. It will go book your plane ticket, it will go book your hotel room.
Starting point is 00:31:50 Yeah, so this is an option. And the apps that want to play in this, hold on, the apps that want to play in this, will benefit. So there will be a powerful incentive for applications to get an advantage by participating. Let me finish my point. And then eventually, they will be forced to to do it not because they get an advantage but because they're so competitively disadvantaged if they don't participate in that ecosystem I agree that they'll participate in it, but here's the thing What's gonna happen is Google's gonna turn on Bard and I've been playing with Bard? It is 80% of chat GPT already and then when they make Bard a default You know little snippet on your Google search return page
Starting point is 00:32:26 or Bard is built into YouTube or Chrome or Android, all the Play Store, they are gonna roll right over ChatGPT because they have billions of users already. So this advantage that you see today, I see that getting rolled real quick because you'll be on YouTube and on the top right-hand side will be Bard and when you do a search, it's gonna say, here are other sententies you could do.
Starting point is 00:32:45 Oh, you want to search Mr. Beast, when he's helped people, or Mr. Beast, when he's given away more money, or people who've copied and been inspired by Mr. Beast, all that's going to occur inside of YouTube. And chat GPT is not going to have access to the YouTube corpus of data. And then when you do a search,
Starting point is 00:32:58 it's going to be the same thing. It's going to be on the right-hand side, and it's going to be playing just like it isn't being. If you turn on your Android phone, they're going to make Google Assistant go right into BART. And Google Assistant is already used by hundreds of millions of people. So I think that Google will roll.
Starting point is 00:33:12 I think they're going to roll chat GPT. I don't know who's going to win, but I'm looking at this saxipo more reductively as a capitalist, which is what are people's incentives, because that's what they'll do. Google's incentive is to use Serp chat GPD's usage by inserting something inside of their existing distribution channels to suppress the ability for you to want to go to the app. No one is bundling. I think Facebook has that same incentive. Oddly, even though Microsoft is such a deep partner,
Starting point is 00:33:47 I think certain assets of Microsoft have that incentive. You're talking collectively about $5 or $6 trillion of market cap, then when you add in Alexa and Amazon and Siri and Apple, what is their incentive? I don't think their incentive is to let this happen. And I think if you look at the Slack Microsoft Teams example of even a better engineer product who's excellent and widely deployed, even at hundreds of millions of users doesn't much matter when it's more cleverly distributed and priced. And so those things again, you may still be right. All I'm saying is it's just so early to know.
Starting point is 00:34:26 And as slow and lumbering as some of these big companies are, they are not so stupid as to kill their own golden goose and or defend it when threatened. So I think you just have to let it see what happens. I want to first the point on Google and then we can move on to the bundling thing. Let me just make the counter argument, which is that I think Google has caught completely flat footed here, even though they should have been because they published
Starting point is 00:34:47 the original paper on Transformers in 2017. They should have seen where all of this was going, but they didn't. Open AI used that paper and commercialized it. And the proof of that is there was just a lawsuit a couple of days ago, or at least a claim by a former employee of Google who quit, because he said that they were using chat GPT to train their AI. So their AI is so far behind. They were violating the terms of use. Hold on, they were violating the terms of use
Starting point is 00:35:19 of open AI to train their own AI on chat GPT. That's not a good sign. That's not a good sign. That's not a good sign. I always think it's- Hold on, I'm just being the counter-argument here. I mean, don't dismiss it out of hand. Give me a chance to explain it. Moreover, chat GPT-4, which was just released a few weeks ago,
Starting point is 00:35:39 we know that OpenAI had that, they were using it internally for seven months. So the state of the art is not what we're using, it's what OpenAI has internally. They're obviously working now on ChatGPT5. And so if you're saying that Bard is 80% of ChatGPT4, well, I got news for you, it's probably 50% or 20% of ChatGPT5. And who knows what the product roadmap is inside of OpenAI? I am sure that they've got 200 ideas for things they could do to make it better and
Starting point is 00:36:12 low-wing fruit. But look, regardless, I think the pace of innovation here in development is going to speed up massively. I mean, there is going to be a flurry of activity. I agree, it's hard to know exactly how it's going to play out. But I think this idea that it's a foregone conclusion these big companies are just going to catch up with open AI. I think that there's a strong counter argument. That's not the case. I'm making a very specific argument. It's not a foregone conclusion where all the value will get captured. Just like in any of these major title waves, if you make the bets too early, you typically don't make all the money. And it tends to be the case, and it has been in the past, at least, with these transformative
Starting point is 00:36:50 moves. It's sort of in the early third of the cycle is where the real opportunities to make the tons of money emerge. And there's a lot of folks that show you a path and then just don't necessarily capture the value. I'm not saying that that's going to be the case here. All I'm saying is if history is a guide, all of these other big waves have shown that fact pattern. And so I'm very excited and I'm paying attention,
Starting point is 00:37:14 but I'm just being circumspect with this idea that having been in the middle of these couple of waves before it, I made all the money by waiting a couple years. I don't know if that's going to be true this time around, but that's sort of my posture right now. Jamal, you obviously have a point because we're only four months since, how can we know where this is going to be in five years? So you could be right. To your point, Sacks, I think it's clear, and this is big ups to the OpenAI team, that they will be one of the top two or three players.
Starting point is 00:37:39 Absolutely. We all agree on that, which is extraordinary in itself. And the top four players, Freeberg, are obviously gonna be Microsoft Open AI. We'll call that like whatever, that little, you know, pairing. And then Google, Facebook. And then we haven't talked about Apple, but obviously Apple is not gonna take this sitting down. And hopefully they'll get in gear
Starting point is 00:38:00 and have Siri, you know, make it to the next level or they'll just put her out to pasture. If you were to look at those four, and we're sitting here a year from now, who has the best product offering, who has the biggest user base? Just take a minute to think about that because you were at Google and we all know,
Starting point is 00:38:18 the word on the street is, it's the return of the kings. Larry and Sergey are super engaged by all reports. Every back channel everybody I talk to is saying that they're every day, they're obsessed with Google's legacy now and making this happen. So what can you tell us in terms of who you think a year or two from now will have the biggest user base
Starting point is 00:38:39 and be the most innovative amongst that quartet or maybe you think there's other players who will emerge. The advantage that OpenAI has, which is the advantage that any call it emerging, you know, advantage competitor has is, yeah, outsider is that the incumbents are handicapped by their current scale. Much of the considerations set that Google has had in deciding what features and tools to launch with respect to AI over the last couple of years
Starting point is 00:39:11 has been driven fundamentally by a concern about public policy and public reaction. And I know this from speaking to folks there that are close enough to kind of indicate, like Google has been so targeted, has been such the point of attack by governments around the world with respect to their scale and monopolegian monopolistic kind of behavior some people have framed it privacy concerns, you know, et cetera, et cetera, the fines and the EU are extraordinary
Starting point is 00:39:42 that so much of what goes on at Google today is, can I get approval to do this? And so many people have felt so frustrated that they can't actually unleash the toolkit that Google has built. And so they've been harnessed and focused on these internal capabilities. I think I mentioned this in the past, but things like, what's the right video to show on YouTube to keep people engaged? What's the right ad to show to increase click-through rates, et cetera, et cetera, versus building great consumer products for fear of the backlash that would arise and governments
Starting point is 00:40:11 coming down on that. And ultimately attacking the revenue and the core revenue stream. And this is no different than any other kind of innovator's dilemma. Any other business of scale in any other industry historically ultimately gets disrupted because their job at that point is to protect their cash flow and their revenue stream and their balance and assets Not to disrupt themselves Especially as a public company, especially under the scrutiny and the watchful-eye of governments and regulators. So I think Google has In aggregate probably good competitive talent if not better talent than OpenAI and others. Google has arguably the best corpus of data upon which to print the best capabilities,
Starting point is 00:40:52 the best tool kit, the best hardware, the lowest cost for running these sorts of models, the lowest cost for serving them, et cetera, et cetera. So frankly, they're way behind. The battle is theirs to lose if they are willing to disrupt themselves. And this is the moment that Larry and Sergei should wield those founders' shares that they have. And they should wield the comments that they wrote in that founders' letter that they will always make the right decision for the long term for this company, even if it means taking a cost in the short term and disrupting themselves. This is the
Starting point is 00:41:21 moment to prove that those founders' shares were worth, you know, the negotiation to get there. And I think that it is going to require a real degree of scrutiny, a real degree of regulatory uncertainty, a real degree of challenge by governments and public policy people, and perhaps even a revenue hit in the near term to realize the opportunity. But I do think that they're better equipped to win if they chose to. Well said. Well really well said. I think the founder sure insight is particularly interesting, Sachs, the fact that they
Starting point is 00:41:51 far for those. It did nothing with them. Yeah, I know. I was just going to say the exact same thing. It's like if they don't use it now, what would it take and when? Yeah, it's just yet another yet another case of the emperor has no clothes just a power grab by Silicon Valley execs which was meaningless because if in this moment you don't wheel that power and break that company into bits as you need to what was the point of having it if they need to come in
Starting point is 00:42:16 and say we're going to give barred results to 10% of users and ask them to get feedback on it because who has more queries than just one point I want to make that for Riverberg. Who has more reinforcement learning than Google. That search box is everywhere and people write question after question and Gmail and Google docs, et cetera, et cetera. I mean, they have so many people asking questions and YouTube might be the transcripts of YouTube all along. The transcript of every video and the image of every video. Banana. And the comments under it, you know the comments under the video, you have the transcript of what happened in this video and then what was the question and answer underneath it? Let me make the counterpoint.
Starting point is 00:42:55 Please. To my own point, like look at how Gerstner came after Zuck. So Zuck had his point of view, his strongly held belief that AR or VR was the future of the platform. That's what he wanted to bet into. That's what he wanted to bet into. That's what he wanted to lean into. It's what he wanted to build the company against. He did it.
Starting point is 00:43:09 And then the financial analysts and the investors came at him and said, this is a waste of money, focus on making money. You have a responsibility to shareholders. F those founders shares, you don't deserve that 10x voting right. Or whatever the framing might have been to get him to say, you know what, I act, yes, I'm giving it up. And I think that we should also think about what's going to happen on the other side. Google is a trillion plus dollar market cap company.
Starting point is 00:43:31 Their shares are owned by every public endowment, public pension fund, institutional investor owns Google in their portfolio. So the backlash against Google making a hard bet like this and potentially destroying billions of dollars of cash flow in the process every year will not be easy to do that the same sorts of letters that Gersner at all and obviously we love Gersner and you know we can all defend him all day long at Zuck is what might may end up happening with with alphabet if they did choose to go this path. Saks, what do you think here about the founder shares specifically in Google's chances
Starting point is 00:44:02 of disrupting themselves and, you know, just putting this into every product and shoving it down users' throats and catching up. Well, I mean, with all due respect, Larry and Sergey, I mean, they've been on the beach a long time. This reminds me of Apollo Creed coming out of retirement in rock and four. Little out of shape. Little out of shape. A lot of a lot of fans. They could be a little out of shape. Sam, I mean, it may not look like Ivan Drago, but this is one shrewd character. This is one shrewd character. I mean, Altman is fit. He's fit. He's been in the arena. Yeah, he's a multi-time founder who sat
Starting point is 00:44:42 at the top of YC and got to see everything that worked. Yep, and got to see all the research and he's been plugging away at this for What like the years? So there's a there's a big I just think there's a big gap to catch up on now Google has all the resources in the world and They've got a lot of proprietary assets too, and they've got all the incentive in the world So do I think that google be one of the top four players in a i absolutely
Starting point is 00:45:08 but this idea is going to come in steamroll open a i i i have a prediction i got a prediction within next year larian surge take the title of co-CEOs and then they do a demo day where the two of them get on stage and they actually do the demo to these products. It just happens. That's fictional. Punification. That's it. Listen, and Bayes also gone for president. Those are my two predictions. Stop.
Starting point is 00:45:31 I'm taking a love predictions. Can you imagine a free break where are the chances of Larry and Sergey taking Koseo's lots? That's prediction one and then prediction two. Where are the chances of them running the next Google I.O. where they get on stage and they walk people through all the products that they shepherded and that they have invested interested in that they want to demo. There is an institutional problem at Google at the top level which does need to be solved,
Starting point is 00:45:56 which is this position of constantly being in defense against the scrutiny, again, of regulators and public policy folks and you know all these different groups that are against Google. And so as a result the kind of cultural seasoning particularly at the executive and the board level has been one of like you know protect the nest, don't overreach, don't overstep and it's a real you know I think one for the business school books or whatever, ultimately is what they end up doing about it. Because now is, you know, the time when that defensive posture is really kind of putting up the entire business at risk.
Starting point is 00:46:34 The same thing happened to Microsoft, remember in the late 90s? That's right. When they got crushed by that antitrust lawsuit, it made them very defensive. Well, that can go, but that consent decree, they put it, they had a wartime CEO come in bomber came in and You know followed by kind of an innovative guy who could kind of continue to build And I think that there may be a moment here. I look I love Sundar He's a great guy great CEO because Sundar and I don't know if I guys if I ever told you this you and I started at Google in the same day We're both in the same new glor class. we were the freaking hat on the TGIF day
Starting point is 00:47:05 and on stage, he was a product manager, and now he runs the company. But I think the question is, whether it's the CEO or the broader whole kind of executive org or the board, a degree of disruption necessary to shift that cultural seasoning is so necessary right now for them to have a shot at this. And similar to what you just said, SACS,
Starting point is 00:47:23 like you're gonna need a bomber type moment to kind of reinvigorate that business. And by the way, I'll tell you- Or a Satcha moment, I think, then. I'll tell you that. Well, yeah, because it's an important point when bomber took over during that period after Gates, when they were on their heels,
Starting point is 00:47:38 he basically just focused on revenue and paying dividends and stock buybacks and the stock went sideways. He missed mobile. Now, you're forgetting one big thing, which is that that was also because he had to operate under a consent decree to the DOJ. Exactly. The product managers of Microsoft were placed with low hairs from the Department of Justice and you had to get their sign off before you could chip anything. We have to remember that those things probably slowed Microsoft down as well.
Starting point is 00:48:08 And the great thing that Satya had was a blank slate and the removal of that consent decree. So he was able to do everything that just made a lot of sense. And he's executed flawlessly. I think the problem at Google is not Sundar or Larry or Sergey. I think it's more in the deep bowels of middle management of that company, which is that there's just far too many people that probably have an opinion. And their opinion is not shrouded in survival. Their opinion is shrouded in elite language around what is the moral and ethical implications of this
Starting point is 00:48:45 and where has it been properly tested on the diaspora of 19 different ethnic tribes of the Amazon. That's the kind of decision making that is a nice to have when you are the second or third most valuable technology company in the world. But you have to be able to pause that kind of thinking and instead get into wartime survival mode and it's very hard. So it doesn't almost matter at this point what Sundar wants. The real question is what is the capability of middle management to either do it or get out of the way and I think
Starting point is 00:49:21 that in all of these big companies that struggle what you really see is an inability for middle management to get out of the way. And I think that in all of these big companies that struggle, what you really see is an inability for middle management to get out of the way, or frankly, just you need somebody to then fire them. And if you look at folks who get their groove back, let's see what Facebook does, what are they targeting? They're targeting middle management. If you look at what Elon does in the companies that he owns, there is virtually no middle management. It's like, get out of the way. Build product, build product and ship it.
Starting point is 00:49:53 And what is the core truth? And so if failure is there in front of you, and if David is right, that you have 200 million users come out of nowhere who are voting every day with their time and attention to use an app. And that doesn't create a fiber-lum fire where you get middle management out of the way. And you are the senior most people talking to the people doing the work and shipping things every day. You are toast.
Starting point is 00:50:19 You are toast. A lot of people are starting to think we're moving a little bit too fast when it comes to open AI's incredible performance, which had GPT-4, the plugins and all this. And so the future of life institute, which was formed in 2015, it's a nonprofit that's focused on de-risking major technology like AI. They did a petition titled Pause Giant AI Experiments and and open letter a bunch of computer scientists assigned this letter. And the letter quote says we must ask ourselves should we let machines flood our information
Starting point is 00:50:54 channels with propaganda and untruth should we automate away all the jobs, including the fulfilling ones should we develop non human minds that might eventually outnumber at smart obsolete and replace us should we risk loss of control of our civilization? A number of notable tech leaders like Elon, Steve Wozniak, and a handful of deep-mind researchers have signed it. What do you guys think of the letter? Are we going to slow down or not? Then we could ask the question generally, how close are we getting to AGI, which is what everybody's scared of, is that these agents start working with each other in the background to do things that are against human interest.
Starting point is 00:51:28 I know it sounds like science fiction, but there is a very, that when these AIs start operating on their own, like we explained in the previous sort of segment here with plugins and they make agents that are operating based on feedback from each other, could they get out of control and be mischievous and then work against human interest? So what do you think, sex? I think there's a difference between what could happen in the short term and then what could happen in the long term.
Starting point is 00:51:55 I think in the short term, everything we're seeing right now is very positive. And let me just give you an example. There was a really interesting tweet storm about a guy who wrote about how Chad Gpt saved his dog. Do you guys see this? This is one of the really mind blowing ones to me, use cases. So his dog was sick, took him to a vet, vet prescribed some medication three days later, dog still sick, in fact, even worse.
Starting point is 00:52:21 So the owner of the pet just literally copied and pasted the lab result for the blood test for the dog with all the lab values into chat GPT and said, what could this be? Like what's your likely diagnosis? Chat GPT gave three possible answers to three illnesses. The first one was with the vet basically a diagnosed with, so that wasn't it. The second one was excluded by another test. So he then went to a second vet and said, listen, I think my dog has the third one. And vet prescribed something, and sure enough, dog is cured saved.
Starting point is 00:52:55 So that's really mind-blowing that even though chat GPT hasn't been specifically optimized, as far as we know, for lab results, it could figure this out. The reason I'm mentioning this is it gives you a sense of the potential here to cure disease, to, you know, like I could see major medical breakthroughs based on the AI in the next five or 10 years. Now, the question is like what happens in the long term,
Starting point is 00:53:21 you know, as the AI gets smarter and smarter and we are kind of getting into the wrong science fiction but here would be the scenario is you're on chat gpt 10 or 20 or whatever it is or maybe some other companies AI and the developers ask the AI how can you make yourself better now do it which is a question we ask chat gpt all the time in different contexts. So chat GPT will already have the ability to write perfect code by that point. I think code writing is one of the, I think, of its superpowers already. So it gives itself the ability to rewrite its code, to auto-update it, to recursively make itself better. I mean, at that point, isn't that, like, a speciation event?
Starting point is 00:54:03 It doesn't have very quickly lead to the singularity if the AI has the capability to rewrite its own code to make itself better and it won't it very quickly write billions of versions of itself? And it's very hard to predict what that future looks like. Now, I also don't know how far away we are from that. That could be 10 years, 20 years, 30 years, whatever. But I think it's a question worth asking for sure. Is it worth slowing down, though, Saks? Should we be pausing because based on what you've said, I think you've framed it properly, when these things hit a certain point and they start reinforcing their own learning with each other, they can go at infinite speed, right? This is not comparable to human speed. They
Starting point is 00:54:43 could be firing off millions, billions of different scenarios. We're definitely now on this fuck around find out curve. And so there is only one way to really find out, which is somebody's going to push the boundaries. The competitive dynamics will get the better of some startup. They'll do something that people will look back on and say, whoa,, that was a little that was a bridge too far So yeah, we're just just a matter of time Yeah, I think we're not gonna slow down. I actually think it's going the other way I think things are gonna speed up and and the reason they're gonna speed up is
Starting point is 00:55:19 Because the one thing Silicon Valley is really good at is taking advantage of a platform shift And so when you think about like all the VCs and all the founders, you know because the one thing Silicon Valley is really good at is taking advantage of a platform shift. And so when you think about all the VCs and all the founders, everyone accuses us of being lemmings. And so when there's a kind of fake platform shift for people kind of glomons, something that ends up not being real, everyone's kind of got egg on their faces. But the flip side of that is that when the platform shift is real,
Starting point is 00:55:45 Silicon Valley is really good at throwing money at it. The talent knows how to go after it and they keep making it better and better. And so that's the dynamic we're in right now. If you look at 70% of the last YC class was ready, all AI startups, sure the next one will probably be 95%. So I think that we're on a path here where the pace of innovation is actually going to speed up. Companies are going to compete with each other. They're going to seek to invent new capabilities.
Starting point is 00:56:11 And I think the results are going to all be incredibly positive for some period of time. Like, you know, the vet example, we're going to cure illnesses. We're going to solve major problems. So if they're positive, then we invest more, we trust more. But the paradox of that is, Chimalt is pointing out, freeberg, is if we trust it more, we invest more, then some person in a free market is going to say, you know what? I need to be chat GPT. Therefore, I'm going to take the rails off this thing. I'm going to let it go faster and take off some constraints because I need to win. And I'm so far behind, how do you
Starting point is 00:56:44 feel about that scenario, that sort of traumatic and sacks teed up, Friedberg? I think there's like, GPT-3, I think, ran on 700 gigs. Is that right? Does anyone know what GPT-4 runs on? It's gotta be on some number that's, you know, not too, not many multiples of that. Look, someone could make a copy of this thing and fork it and develop an entirely new model.
Starting point is 00:57:15 I think that's what's incredible about software and digital technology and also means that it's very hard to contain. Similar to like what we've seen in biology, ever since biology got digitized through DNA sequencing, and the ability to kind of express molecules through gene editing, you know, you can't control or contain the ability to do gene editing work at all
Starting point is 00:57:42 because everyone knows the code, everyone can make CRISPR cast molecules, everyone can make gene editing work at all, because everyone knows the code, everyone can make CRISPR cast molecules, everyone can make gene editing systems in any lab anywhere. Once it was out, it was out. And now there's hundreds of variants for doing gene editing, many of which are much improved over CRISPR cast 9. I use that as an analogy, because it was the breakthrough technology that allowed us to precisely specifically edit genomes and that allowed us to engine your biology and do these incredible things where biology
Starting point is 00:58:08 effectively became software. And remember, CRISPR-Cast9 gave us effectively a word processing type tool, find and replace. And the tooling that's evolved from that is much better. So whatever is underlying, whatever the parameters are for GPT-4, whatever that model is, if a close enough replicant of that model exists or a copy of that model is made, and then new training data, new evolutions can be done separately,
Starting point is 00:58:36 you could see many, many variants that kind of emerged from here and I think this is a good echoing of Chimoff's point, we don't know what's ultimately going to win. Is there enough of a network effect in the plugin model, as SACS pointed out, to really give OpenAI the sustaining competitive advantage? I'm not sure. The model runs on 700 gigs. That's less data than, you know, fits on my iPhone. So, you know, I could take that model, I could take the parameters of that model, and I could create an entirely new version, I could fork it, and I could do something entirely new with it.
Starting point is 00:59:05 So I don't think you can contain it. I don't think that this idea that we can put in place some regulatory constraints and say it's illegal to do this or try and create IP around it or protections around it is realistic at this state. The power of the tool is so extraordinary, the extendability of the tools are so extraordinary. So the economic and the various incentives are there for other models to emerge and whether they're directly copied
Starting point is 00:59:34 from someone hacking into open AI servers and making a copy of that model or whether they're open source or whether that someone generates something that's 95% is good and then it forks in a whole new class of models emerge. I think this is like, as SACs pointed out, highlighting the kind of economic market uprooting, social uprooting potential, and many models will start to kind of come to market.
Starting point is 00:59:58 What do we think the impact of Y-Color jobs getting annihilated by this technology, if that in fact comes to pass? I want to say one thing on this. Yeah, look, let me just share, and I just did one example here. So here's a Reddit post that I was made aware of earlier this week. I lost everything that made me love my job
Starting point is 01:00:13 through mid-journey overnight. I am employed as a 3D artist in a small games company of 10 people. Our team is two people, we basically explain. He says since mid-journey version five came out, he's not an artist anymore, nor a 3D artist. All they do is prompting, photoshopping, and implementing good looking pictures.
Starting point is 01:00:30 And he basically says, this happened overnight, and he had no choice. His boss also had no choice. He says, I am now able to create rig an animated character that's spit out from MJ mid-Journey in two to three days. Before it took us several weeks and 3D, the difference
Starting point is 01:00:45 is that he cares about his job and for his boss it's just a huge time. Money saver, he's no longer making art. And the person who was number two in the organization who didn't make us good content as him is now embracing this technology because it carries favor with his boss. And he ends basically saying, getting a job in the game industry is already hard, but leaving a company and a nice team because AI took my job, feels very dystopian. I doubt it would be better in a different company. Also, I am between grief and anger and I'm sorry for using your art fellow artists. This is yet another reason that Figma really needs to close this acquisition from Adobe.
Starting point is 01:01:25 I mean, let's like, the value of these apps are just getting gutted. If you take a workflow management tool for things like design and imagery, and you reduce it by an order of 90%, it's like, what is that app experience worth? And how could you replicate it if you were a big company that already has distribution? That's one comment. But what I would tell you Jason to answer the white collar question is, I think there are a handful of companies you need to look at exclusively because they will be the first ones to really figure out how to displace human labor. And that is TCS, so Tata Consulting Services, Accenture, Cognizant.
Starting point is 01:02:06 These are all the folks that do coding for higher work at scale. I think Accenture has something like 750,000 employees. So, the incentive to sort of squeeze off acts to create better utilization rates to increase profitability is quite obvious it always has been. They will be the first people to figure out how to use these tools at scale. Before the law firms or the accounting firms or any of those folks even sort of try to figure out how to displace what color labor I think is going to be the coding jobs and it's going to be the coding for higher jobs
Starting point is 01:02:37 that companies like Accenture and TCS. So those business processing do for other people. Developer, kind of folks, they're going to need half as many people, 25% as many people, we're going to find out the efficient frontier. Yeah. I see it a different way. I mean, this argument that productivity leads to job loss has been made for hundreds of years, and it's always been refuted. When you make human beings more productive, it leads to more prosperity, more wealth, more growth. And so yeah, it's easy to think about in a narrow way that jobs are going to be displaced, but why would that be?
Starting point is 01:03:11 It's because you're giving leverage to other human beings to get more done. And some of those human beings, really anybody with a good idea, is now going to be able to create a startup much more easily. So you're going to see a huge explosion in creativity, in-start creation, new companies, new jobs. Imagine, think about the case of Zuckerberg founding Facebook at Harvard. He wrote the first version himself, maybe with a couple of friends. That project happened and turned into a giant company because he was able to self-execute his idea without needing to raise venture capital
Starting point is 01:03:45 or even recruit employees, even really before forming a company. Anyone with a good idea is going to do that soon. You're going to be able to use these AI tools. They truly will be no code. You'll be able to create an app or a website just by speaking to some AI program in a natural language way.
Starting point is 01:04:01 So more flowers will bloom. More stars. Absolutely more projects. Now, no, no, no, no, we'll create Now, we'll create, I think a lot of dislocation, but for every testimonial that is like the one that you showed, which I think is, I'd say a little bit overly dramatic, I have seen 10 or 100 testimonials from coders on Twitter or other blogs talking about the power that these new tools give them, they are like, this makes me a 10X engineer.
Starting point is 01:04:27 And especially these like junior engineers or write out a school who don't have 20 years of coding history, they get superpowers right away. Like it makes them so much better. So the proper response. Jake, hell, Jake, hell, but wait, hold on, let me give you a response to that guy. So, and using Saxx's point, that guy saying,
Starting point is 01:04:44 what used to take me weeks I can now do in two to three days. And I feel like my work is gone. And that's because he's thinking in terms of his output being static. And if he thinks about his output being dynamic, he can now, in the matter of three weeks instead of making one character, he can now make a character every two days. So he can make 30 characters in three weeks. That's an alternative way for him to think about what this tooling does for him and his
Starting point is 01:05:10 business. The number of video games will go up by 10X or 100X or 1000X. The number of movies and videos that can be rendered in computers can go up by 10X or 100X or 1000X. This is why I really believe strongly that in some period of time, we will all have our own movie or our own video game ultimately generated for us on the fly based on our particular interests. There will certainly be shared culture, shared themes, shared morality, shared things that tie all these things together, and that will become the shared experience.
Starting point is 01:05:41 But in terms of like us all consuming the same content, it will really, you with YouTube and TikTok, we're all consuming different stuff all the time. And this will enable an acceleration of that evolution and personalization. I'll also highlight, you know, back in the day, one human had to farm a farm by hand. And we eventually got the tool of a hoe and we could put in the ground and make, you know, make stuff faster. And then we, we got a plow and then we got a tractor. And today, agricultural farm equipment allows one farmer to farm over 10,000 acres. You go to Western Australia, it's incredible. These guys have 24-row planters and harvesters and it's completely changed the game. So the unit of output per farmer is now literally millions of times what it was just a hundred and fifty
Starting point is 01:06:25 years ago. Right. And in that case, freeberg, nobody wants to do back breaking labor in the fields and everybody wants that shit but in this case, let me just read you one quote that I didn't read in the original reading of this. He says, I want to make art that isn't the result of scraped internet content from artists that were not asked. And so I think that's part of this is that it's bespoke art. But the one question I have for SACS was SACS, you, we started this conversation
Starting point is 01:06:51 saying, Hey, this is different than anything in terms of efficiency that came before it. This is, I'm going to put some words here, but this is like a step function more efficient. So to the argument of, Hey, efficiency has always resulted in, you know, more ideas and we found something to do with people's time. Is this time different potentially because this is so much more powerful? This isn't just like a spell checker. I would say differently. I think, and I agree with what Jake Al is saying because I think that the thing that technology
Starting point is 01:07:21 has never done is try to displace human judgment. It's allowed us to replace physical exertion of energy, but it has always preserved humans injecting our judgment. And I think this is the first time where we are being challenged with autonomous systems that has some level of judgment. Now, we can say, and it's true, again, reform on sin, that that judgment isn't so great. But eventually, and because of the pace of innovation, eventually it's probably not that far away, the judgment will become perfect.
Starting point is 01:08:00 I'll give you a totally different example, you know, how many pilots are there in the world? Will we, at some point in the next 10 years, want folks to actually manually take off and land, or will we want precision guided instrumentation and computers and sensors that can guarantee a pitch-perfect landing every single time in all kinds of weather conditions so that now planes can even have 50X the number of sensors with a computer that can then process it and act accordingly. Just a random example that isn't even thought of when we talk about sort of where AI is going to rear its head. I think that this judgment idea is an important one to figure out because
Starting point is 01:08:40 this is the first time I've seen something that is bumping up against our ability to have judgment. And what this person was talking about in this mid-journey example is his judgment has been usurped. Yes. Yeah, I would disagree. Oh, I don't know. Yeah, let me just make one point on this. So, you know, an image is a matrix of, you know,
Starting point is 01:09:01 data that's rendered on a screen and as pixels and those pixels are different colors. And that's what an image is. Is it the judgment of the creator? Well, no, I'm just saying an image in general. So when Adobe Photoshop and Digital Photography arose, photographers were like, this is BS, why you digitizing photography with analog and beautiful before. And then what Digital Photography allowed is the photographer to do editing
Starting point is 01:09:25 and to do work that was creative beyond what was possible with just a natural photograph taken through a camera. And there are arguably different art forms, but it was a new kind of art form that emerged through digital photography. And then in the early 90s, there was a plug-in suite called Kai's Power Tools that came out in Adobe Photoshop. And it was a third party plug-in that said, would buy it, and then it would work on Photoshop.
Starting point is 01:09:48 And it did things like motion blur, sharpening, pixelation, all these interesting kind of like features. And prior to those tools coming out, the judgment of the digital artist, the digital photographer was to go in and do pixel by pixel changes on the image to make that pixel, to make that image look blurry or to make it look image, to make that image look blurry, or to make it look sharper, or to make it look like it had some really interesting motion feature.
Starting point is 01:10:09 And the Kai's Power Tools created this instant toolkit where in a few seconds you created a blur on the image. And that was an incredible toolkit, but a lot of digital artists said, this is automating my work. What is my point now? Why am I here? And the same happened in animation
Starting point is 01:10:24 when CGI came around, and animators were no longer animating cells by hand. And in every point in this evolution, there was a feeling of loss initially, but then the evolution of a whole new art form emerged and an evolution of a whole new area of human creative expression emerged. And I think we don't yet know what that's going to look like. But do you think the level of judgment that AI offers you is the same as the level of judgment
Starting point is 01:10:49 that Kai Power Tools offered? Yeah, look, I mean, I think that the person making the judgment or the decision about which pixel to change into what color felt like, you know, I have control. And I think it's ultimately like, I just totally disagree with you. I mean, I think that this is... Yeah, it's a magnitude different.
Starting point is 01:11:02 I'm going to be saying it's more of a than a magnitude difference. Yeah, it's a high-level tool. It's still love, it's on you. I mean, I think that this is a magnitude different. I remember it's it's more of a than a magnitude difference. Yeah, it's a lot of tools. It's still love. It's on you. You don't lose you and I have sat in spreadsheets. I'm generally happy with this idea. So I'll give you a different example. Today, we use radiologists and pathologists to identify cancers. Yep. There are closed loop systems. We have one right now that's in front of the FDA. That is a total closed-loop system that will not need any human input. So I don't know what those folks do. Except what I can tell you is that we can get cancer detection basically down to a 0% error rate.
Starting point is 01:11:41 That is not possible with human intervention. That is judgment. Right. So I just think it's important to really acknowledge that this is happening at a level that it's never happened before. You may be right that there's some amazing job for that radiologist or pathologist to do in the future. I don't know offhand what that is, but these are closed loop systems now that think for themselves and self-improve. I get it, but I think that there is an unfathomable set of things that emerge.
Starting point is 01:12:11 We did not have the concept of Instagram influencers. We did not have the concept of personal trainers. We did not have the concept of like all these new jobs that have emerged in the past couple of decades that people enjoy doing, that they can make money doing, that is a greater kind of experience and level of fulfillment for those that choose and have the freedom to do it, than what they were having to do before when they had to work just to make money. And there's going to be. And there's going to be.
Starting point is 01:12:38 And there's going to be that radiologist or pathologist wants to do. Be a trainer or a Pilates instructor? No, I think we don't know what that's going to look like. All right, so having the team, yeah. You have any thoughts on this as we wrap this topic? It's obviously a lot of passion coming out. Yeah, I look at the elimination of white college jobs in a massive way.
Starting point is 01:12:52 I think that this is a short term versus long term thing. In the short term, I see the benefits of AI being very positive, because I don't think it's, in most cases, wiping out human jobs, this is making them way more productive. You still need the developer. It's just that there are jobs is making them way more productive. You still need the developer. It's just that there are five times or 10X more productive. But I don't think we're at the point in the short term where you're going to be able to eliminate
Starting point is 01:13:13 that role entirely. What I've seen in basically every start of it or been an appartive is that the limiting factor on progress is always engineering bandwidth. That is always the thing that you wish you had more of. Totally. It's the product roadmap is always the most competed on thing inside the organization. Everyone's trying to get their project prioritized because there's never enough engineering bandwidth. It's really the lifeblood of the company. If you make the developers more productive,
Starting point is 01:13:41 it may be just accelerating to product roadmap. I don't think in the short term that what's going to happen is these companies are going to look to cut all their developers because one or two of them can do 10 times the work. I think that they're going to try and accelerate their product road maps. Now, again, you have this long-term concern that maybe you don't need developers at all at some point, but I think that the benefits of developing this technology are so great in the short to midterm that we're going down that path no matter what. And we're just going to find out what that long term really looks like. And maybe the long term will look very different. I mean, what's the get past the short term? We may have a different long term view.
Starting point is 01:14:19 I think in this narrow vertical, I 100% agree with you. Look, I think that AI is going to eliminate unit testing. It has already done so that AI is going to eliminate unit testing. It is already done so. It's going to eliminate most forms of coding. The engineers that you have, all of them will now become 10X engineers. So with fewer of them or with the same number, you'll be able to do as much or more than you could have before. That's a wonderful thing. And all I'm saying on that specific narrow vertical is you'll see it first rear its head and companies like Accenture and TCS because and Cognizant because they have an immediate incentive to use this tooling to drive efficiency and profitability that's rewarded by shareholders. It'll be less visible in other companies.
Starting point is 01:14:58 So, but what I am saying though is that you have to think about the impact on the end markets for a second. And I think that AI does something that other technology layers have never done before, which is supplant human judgment in a closed loop manner. And I just think it's worth appreciating that there are many systems and many jobs that reply that rely on human judgment where we deal with error bars and an error rate that a computer will just destroy and blow out of the water and we will have to ask ourselves, should this class of job exist with its inherent error rate or should it get replaced fully by a computer which has no error rate?
Starting point is 01:15:42 And I think that's an important question that's worth putting on the table. Okay, so let's wrap here. I just have my final thought on it. It was like, you're going to see entire jobs, categories of jobs go away. We've seen this before, phone operators, travel agents, copy editors, illustrators, logo designers, accountants, sales development reps. I'm seeing a lot of these job functions in the modern world like phone operators previously. I think these could
Starting point is 01:16:05 wholesale just go away. And they would just be done by AI. And I think it's going to happen in a very short period of time. And so it's going to be about who can transition. And some people might not be able to make the transition. And that's going to be pain and suffering. And it's going to be in the white collar rines. And those people have more influence. So I think this could be to some societal disturbance. I'm going to learn Pilates and be an influencer. That's it. But I do agree with SACs that the software development backlog of this is what you're saying is so great that I don't think we'll see it in software development for a decade or two. There's just so
Starting point is 01:16:33 much software that still needs to be made. All right. Last week we talked about TikTok and this first bipartisan hearing. We've seen it in a long time and people actually I think framing correctly exactly how dangerous it is in my opinion to have TikTok in the United States. And of course, then we get the great disappointment of the actual bill. The Restrict Act was proposed by Senator Mark Warner, Democrat Virginia on March 7th. The problem with it is, as it seems like it's poorly worded that there will be civil penalties and criminal penalties to Americans for breaking the law and using software that's been banned. And many people said, you know,
Starting point is 01:17:14 this probably is just bad language. I have a question. Yeah, go ahead. Does it does it supply to incognito mode? Because if it does not need a mode is not's not, yes. There's what it means. They're saying that you can get, you know, you can get fined or 20 years in jail, whatever it is for using a VPN to VPN to, to tick, to tick talk. Freeberg, what are your thoughts on it? Look, I think this is a real threat to the open internet. I'm really concerned about the language that's been used that basically speaks to protecting
Starting point is 01:17:44 the safety and security of the American people by actively monitoring network traffic and making decisions about what network traffic is and isn't allowed to be transmitted across the open internet. It's the first time that I think in the United States, we are seeing like a real threat and a real set of behaviors from our government that looks and feels a lot like what goes on in China
Starting point is 01:18:04 and elsewhere where they operate with a closed internet and internet that's controlled, monitored, observed, tracked, and gates are decided by some set of administrators on what is and isn't appropriate. And the language is always the same. It's for safety and security of the people. The entire purpose of the internet is that it did not have bounds, that it did not have governments, that it did not have controls, that it did not have systems that are politically and economically influenced, that the architecture of the internet wasn't always would be open. The protocols
Starting point is 01:18:34 are open, the transmission of data on that network would be open. And as a result, all people around the world would have access to information of their choosing and it allowed ultimate freedom of choice. You know, this kind of is the first of what I'm concerned creates a precedent that ultimately leads to a very slippery slope. Saying that TikTok cannot make money in the U.S. by charging advertisers or managing commerce flows is one thing. That's where the government can and should and could if they chose to have a role. But I think going in and observing, tracking, internet traffic and making decisions about what is and isn't appropriate for people, I think is one of
Starting point is 01:19:10 the things that we all should be most concerned about what's going on right now. There is no end in sight to this. If you allow this to happen in the first time, you know, VPNs, virtual private networks allow you to anonymously access internet traffic and access internet traffic via remote destinations. So that the ultimate consumption of content that you're using can't be tracked and monitored by local agencies or ISPs. And I think that saying that that can now be restricted takes away all ability to have true privacy and all rights to privacy on the open internet. So I'd love to talk about this more. Unfortunately, I got to run.
Starting point is 01:19:51 But this is a super threat to me. And I think this is something we should be super, super concerned about. And that the entire community of technology internet and anyone that wants to have, you know, freedom of choice steps up and says, this is totally inappropriate and overreached. Yeah. There are other ways to manage stuff like this. Feels like complete overreach, sex. Yeah, I agree with this. intentional overreach or poorly written or somewhere in between. What do you think? Both, I think both. I think this is the biggest bait and switch that a Washington, the central government has ever tried to pull on us.
Starting point is 01:20:23 Everybody thinks that they're just trying to ban TikTok from operating the US. And if that's all they did, then I think the bill would be supported by most Americans. But that's not what they're doing. They're not restricting TikTok. They're restricting us. That's not the goal here.
Starting point is 01:20:36 Yeah. What a bait switch. It's a huge bait and switch. And so just so you know, what the act provides is that a US citizen using a VPN toiktok could theoretically be subject to a maximum penalty of one million in fines or 20 years in prison or both. Now, you know, they'll say, you know, Mark Warner, the sponsored legislation will swear up and down that's not the intent. But the problem is the language of the bill is so vague that some
Starting point is 01:21:02 clever prosecutor may want to pursue this theory one day, and that needs to be stopped. Also, there's another problem with the bill, which is you think this is just about TikTok. It's not. What they do is, it says here, I guess they don't want to mention TikTok by name, so they're trying to create a category of threatening application, but because it is a category, it's very, very broad. So the bill states that it covers any transaction, transaction, not just an app, in which an entity described in some paragraph B has any interest, and then entity described in some paragraph
Starting point is 01:21:38 B are quote, a foreign adversary, an entity subject to the jurisdiction of an organizer of the laws of a foreign adversary and entity own director control by either of these. And then it gives the executive branch the power to name a foreign adversary any foreign government regime that one of the cabinet secretaries defines without any vote of Congress. So this is giving sweeping powers to the executive branch to declare you know foreign companies to be enemies like the plot of the uh... prequels it's all for some of the power to go
Starting point is 01:22:13 with you know we criticize uh... china for having a great firewall what do you think this is yeah i mean this this should obviously have nothing to do with the american consumer and everything to do with the foreign adversary collecting data of Americans at scale. This could be written in a much simpler way. You know what it should be? It should be one sentence, which is that app stores are prohibited from allowing TikTok
Starting point is 01:22:36 to be an app in their store. That's what they do in India. That's it. Case closed game over. I think India is doing okay, right? They block like 100 Chinese apps, and I think their society is still functioning. So, you know, I'll do respect to AOC, you know, like the idea that 150 Americans,
Starting point is 01:22:50 million Americans are gonna suffer because they can't be tracked by the CCP is kind of nuts. This is gonna give sweeping powers to the security state to surveil us, to prosecute us, to limit our internet usageneighbessage. This is basically the biggest power grab in Beat and Switch. They've ever tried to pull on us. And again, if they really were concerned about TikTok,
Starting point is 01:23:12 it's one sentence. Yeah, we were done. All right, everybody, it's been an amazing episode for the Sultan of Science, David Freiburg, the Rain Man of South David Sacks, and the dictator, Shamath Polly Hoppatea, I am the world's greatest moderator
Starting point is 01:23:26 and we'll see you next time, bye bye. I just got crazy with it. Lumbi West, I squee-na-kin-wa- I'm going all in! What, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, what, We should all just get a room and just have one big hug or two because they're all just like this like sexual tension But we just need to release that out What your feet, what your feet What your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your feet, what your I'm doing all it.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.