Invest Like the Best with Patrick O'Shaughnessy - Ben Thompson on Big Tech, China, and the AI Boom Running Out of Money - [Invest Like the Best, EP.487]

Episode Date: August 18, 2026

My guest today is Ben Thompson, the founder and author of Stratechery. Ben is one of my favorite business thinkers and I love talking to him about everything happening in markets and technology. ... We go through every important company, including OpenAI, Nvidia, Intel, Apple, Microsoft, Google, and Amazon. We also discuss why he thinks it would be dangerous for the United States to win the AI race outright, what container shipping and the railroads of the 1870s tell us about the buildout, and why the binding constraint on all of this may be capital rather than compute.  Please enjoy my conversation with Ben Thompson. For the full show notes, transcript, and links to mentioned content, check out the episode page ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠here⁠⁠⁠⁠⁠.  ----- Become a Colossus member to get our quarterly print magazine and private audio experience, including exclusive profiles and early access to select episodes. Subscribe at ⁠colossus.com/subscribe⁠. ----- ⁠Ramp’s⁠ mission is to help companies manage their spend in a way that reduces expenses and frees up time for teams to work on more valuable projects. Go to⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ ⁠ramp.com/invest⁠⁠ to sign up for free and get a $250 welcome bonus. ----- Trusted by thousands of businesses, ⁠Vanta⁠ continuously monitors your security posture and streamlines audits so you can win enterprise deals and build customer trust without the traditional overhead. Invest Like the Best listeners get a special offer of $1,000 off Vanta when you go to ⁠vanta.com/invest⁠.  ----- WorkOS⁠ is the infrastructure B2B and AI-native companies use to sell to enterprise. It covers everything enterprise security requires: SSO, SCIM, RBAC, Audit Logs, AI governance, and more. Trusted by 2,000+ fast-growing companies, including OpenAI, Anthropic, Cursor, and Vercel. ----- Rogo is the AI platform for finance. They're building agents for Wall Street that are trained to understand how bankers and investors actually do work: from diligence and modeling, to turning analysis into deliverables. To learn more, visit rogo.ai/invest. ----- ⁠Ridgeline⁠ has built a complete, real-time, modern operating system for investment managers. It handles trading, portfolio management, compliance, customer reporting, and much more through an all-in-one real-time cloud platform. Visit⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ridgeline.ai⁠. ----- Editing and post-production work for this episode was provided by The Podcast Consultant. Timestamps: (00:00:00) Welcome to Invest Like The Best (00:02:16) Winning the AI Race With China (00:08:28) Timing, Capital, and the Railroads (00:11:34) Berkshire, Google, and Absolute Profits (00:14:23) Verifiable and Unverifiable Domains (00:20:20) Aggregation Theory in the AI Era (00:22:06) The Real Cost of Inference (00:25:40) Why Consumer AI Needs Advertising (00:30:08) Compute Shortages and Commodity Markets (00:35:46) Memory Cycles and Boom Bust Dynamics (00:42:08) TSMC, Intel, and Where Risk Goes (00:44:51) The Best Setups in Big Tech (00:52:14) The Frontier Model Contenders (00:54:27) Microsoft's IBM Playbook (01:00:45) Meta, Attention, and Advertising (01:07:29) NVIDIA, Commodities, and Power

Transcript
Discussion (0)
Starting point is 00:00:00 RAMP is the only platform built to make your finance team leaner, faster, and better, saving businesses 5% annually on average so you can stay focused on growth. RAMP customers grow revenue 3.2 times faster than the average American business. Visa, Versel, Cursor, Stripe, Notion, 11Lab, Shopify, and 70,000 other businesses all now run on Ramp. Mine does too, and so should yours. Learn more at ramp.com slash invest. OpenAI, cursor, Anthropic, Perplexity, and Vercell all have something in common. They all use WorkOS. To achieve enterprise adoption at scale, you have to deliver on core capabilities like SSO,
Starting point is 00:00:36 SCIM, Rback, and audit logs. Instead of spending months building these mission-critical capabilities yourself, you can just use WorkOS APIs to gain all of them on day zero. That's why so many of the top AI teams you hear about already run on WorkOS. WorkOS is the fastest way to become enterprise-ready and stay focused on what matters most your product. Visit WorkOS.com to get started. Felix by Rogo is a personal finance agent that turns a single prompt into finished client-ready work using your firm's own templates, context, and standards. Send Felix an email like, take these comments and turn them for me.
Starting point is 00:01:09 Or update my tracker with the context of these emails. And Felix sends back finished PowerPoint decks, Excel models, and sourced research. Felix works the way your team already does, delivering work quickly and accurately around the clock. Learn more at rogo.a.ai slash Felix. Hello and welcome everyone. I'm Patrick O'Shaughnessy, and this is Invest Like the Best. This show is an open-ended exploration of markets, ideas, stories, and strategies that will help you better invest both your time and your money. If you enjoy these conversations and want to go deeper, check out Colossus, our quarterly publication with in-depth profiles of the people shaping business and investing. You can find Colossus along with all of our podcasts at colossus.com. Patrick O'Shaughnessy is the CEO of Positive Sum. All opinions expressed by Patrick and podcast guests,
Starting point is 00:01:58 are solely their own opinions and do not reflect the opinion of positive sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of positive sum may maintain positions in the securities discussed in this podcast. To learn more, visit psum.vc. So Ben, if you can believe it, how long it's been since we last did this. The world was very different, no AI at the time. We talked about aggregation theory mostly. I thought a fun place to begin since the world has changed so much, is to hear what you think it would mean for the U.S. to win the AI race?
Starting point is 00:02:35 I think it would be very problematic for the U.S. to win. Let's say we take the most sort of fantastical scenario where if you control AI, you basically, your military is better than anyone else. Somehow it fixes our manufacturing, all these things that I don't think AI is necessarily going to do because they sort of deal with the real world. But in this world, what is the game? game theory optimal response of China to blow up to SMC. Game theory can get very sort of convoluted and complex.
Starting point is 00:03:05 To me, this one actually isn't that complicated. There is a fundamental disconnect that I have with a lot of the rhetoric coming out of Silicon Valley, coming out, I think, of one of the labs in particular, where if we get to a place where we have a meaningful superiority in terms of a military, national security perspective, I think that's very dangerous for the world. But in that state, how much does it exist? than beyond TSM being blown up because in that state, I would assume we figured out how to build fabs here in the U.S. to some degree and are less relying on that one choke point.
Starting point is 00:03:37 I think there's a little bit of magical thinking, which I just invoked in terms of manufacturing and whether it be fabs, whether that be actuators, all these precursors. I think the degree to which we are dependent on China is underappreciated and is not. something that is going to be fixed outside of a conflict. Just because fixing so many of these things is going to be dramatically dumb. If your competitor is sourcing from China and you're going to start sourcing or getting things from the U.S., you're going to be at such a disadvantage, relatively speaking, that you're just not going to do it. So you do it when you have literally no choice.
Starting point is 00:04:19 And that works for very big headline items. You can browbeat Apple to move some of their iPhone manufacturing to India, for example. that is a good example because Apple is not truly moving out of China. They're diversifying to an extent, but it would just cost so much. It's like paying an insurance policy that if you don't have to pay it and it's astronomically expensive, you're just not going to pay it. It's one of those sort of hypotheses that I just have a hard time even grocking because the only world I see where we truly pull out and have no dependency on China such that if they want to blow up Taiwan, who cares is no impact on us.
Starting point is 00:05:00 It seems pretty fantastical to me. And I think there's a bit of facing reality in this regard that is not present in these conversations. Put yourself in their shoes. What do you think the motivations are? Everyone can use a good bogeyman. I think from the AI trade perspective, nothing works better than we have to be China. And I do think we need to be China.
Starting point is 00:05:26 We need to be competitive. I despair at the extent to which over the last few years of particular, so many of our responses, particularly from a political perspective, has been to try to be like China. I think we should be going the other direction, more openness, more innovation, less top-down control,
Starting point is 00:05:43 less restrictions on speech and things along those lines. America succeeds by being on the leading edge and by leading into that. You said probably the U.S. being purely dominant in AI is not the right end state for the world. what is your ideal equilibrium for how this goes worldwide? There's a bit where AI right now is kind of like the Taiwan situation in that the current status quo actually doesn't seem so bad.
Starting point is 00:06:09 The question is how sustainable is it? But maybe it's sustainable for longer than we think. The way I think about it right now is I think Open AI and Anthropic are clearly on the frontier. Who knows what's happening with Google and then Grok and Meta are chasing them. Meanwhile, the Chinese are very capable, very smart, and also definitely distilling these models to sort of stay about six to nine months behind. And it feels like a pretty good equilibrium that I think is generally favorable to the U.S. Now, the question is how long can it stay this way? And there's lots of questions on there.
Starting point is 00:06:46 Like, can the Chinese actually pull ahead? I'm still a little skeptical for various reasons, whether we're from chips. getting to the waiting edge that last six to nine months is very difficult. It's going to be instructive how META and GROC do in terms of actually catching up,
Starting point is 00:07:01 especially as we get to the world of AI improving itself, using AI to make the AI better, which I think is definitely a real thing. I think you see a real acceleration from both Open AI and Anthropic recently, which was sort of theorized and it seems to be coming true.
Starting point is 00:07:14 And to the extent that's true, can you actually catch up? And I think the other question about this, by the way, is to what extent does that apply to cost to serve, to marginal costs. If you can apply AI to optimizing your stack, to figuring things out, to analyzing all the data,
Starting point is 00:07:30 is your cost to serve structurally lower than anyone else. This is the thing about the open source models. The talk about them being free is bizarre to me, because it's marginal costs. You still have to run inference like JLM or Kimmy. Kimi is very expensive to serve. The cost per answer is significantly higher. Everyone referring to these as free.
Starting point is 00:07:50 it feels like in the narrative it's in people's head that free is free now I can use AI for free no you can't use AI for free you're not paying necessarily the R&D to create the AI but you're definitely paying the inference to sort of run it so right now I kind of like where we are and the pushback would be that's right now it's not going to stay that way which I think is fair pushback but I don't know this way longer than we think if you could know anything about the future of how this will go to be more confident and like where the equal of room will end up what is it Is it like the length of the S curve, like how far up the S curve we are? At some point, these things presumably will level out, maybe not. What would be the thing you'd want to know that would give you a better sense of what the future might look like? I am concerned that with the scare around people freaking out about mythos and this hugging face incident, that the actual implication of that is not that we reduce these dangers, but we just stop releasing stuff. we on the outside start to lose any sense of like what's actually the frontier
Starting point is 00:08:56 what is actually the frontier and where it is. There becomes sort of a false sense of security because right now everyone's basing their understanding of mythos on Fable but how good is Fable actually relative to mythos? That sort of gap is only going to, I think, increase over time. So I think that's a real question that I'm not sure about. This question of the recursiveness and AI sort of making itself better, does that lead to some sort of takeoff? And at the end of the day, there's timing questions
Starting point is 00:09:27 in lots of different ways. I'm worried about the timing mismatch in terms of the actual return on investment, producing enough revenue to fuel investment. We're working our way down the capital curve. We started with free cash flow. The speed with which the tech companies blew through the debt markets is kind of incredible. It took like a year. And now Google's issuing equity. Invidius putting together these... This $500 billion thing. This $500 billion. our thing to tap into like pension funds and insurance floats and things like that. What's after that? Where's the money come after that?
Starting point is 00:09:57 Well, ideally, we actually flip back to free cash flow funding this. But if there's a gap there, if we don't get there soon enough, then we could have a big blowup. But at the same time, even if we have this blowup, the AI is not going away. It's not going to stop improving. It's going to keep sort of progressing in a way that we'll be. look back on the dot-com era or we look back on the railroad error or we look back on whatever bubbles through history ultimately immaterial in terms of the broad scope of humanity even if they were very devastating what can the railroads teach us to think it's not the last bigger buildout right
Starting point is 00:10:35 in terms of percentage of GDP or getting there i think we might be bigger at this point or it's like it was the biggest in the ballpark the railroads had a real duration mismatch to build a railroad and make money off it was a decade or more multiple decades-long endeavor, whereas you had to issue money to pay for it in the short term. And the world ran out of money, right? And I think that is probably the aspect. I think that's why people reach for the railroads because everyone talks about, are we going to have enough compute?
Starting point is 00:11:08 Are we going to have enough electricity? Maybe the nearest term questions, are we going to have enough money? Which is kind of a bizarre thing to think about. That's what happened in the 1870s. The world just ran out of money. The funny thing is the railroads kept operating and they expanded the West. Their contributions to GDP was astronomical. They're still contributing to GDP.
Starting point is 00:11:30 Railroad money is what's going into Google right now for Berkshire Hathaway. It's very funny. It's quite literal. Berkshire Hathaway has this problem. To me, this Invita deal is very much paired with the Google equity issuance, which I thought was shocking when it happened. Why was it shocking? Because it's Google.
Starting point is 00:11:49 They can't raise money. Like, why are they issuing equity? Why are they reducing their upside if they believe so strongly in this? But the Berkshire comparison is interesting because to a rough approximation, they make, they have seize candies famously, right? Tremendously high margin business. The problem with a lot of high margin businesses is the percentage profit you can make is very high, but the absolute profit you can make is cap.
Starting point is 00:12:11 There's no reinvestment runway. That's right. You're just accumulating cash. The brilliance of the BNSF railway thing was basically they took the Seas Candy profits and said, here's another industry whose margins are way worse. But the absolute dollar amounts are so large that those way worse margins result in absolute profits that are much larger. BNSF in 2025 or something, the amount of free cash they've threw off in one year was more than Seas candies that thrown off its entire lifetime. even though you're talking about a low margin business
Starting point is 00:12:44 compared to a very high margin business. I think there's an aspect from Berkshire Hathaway where once your capital gets so large, you start operating in a world of like absolute numbers as opposed to percentage numbers. And the reason why I thought that was so interesting that story is it seems to capture where Google itself might be going. And so there is very symbolic for them to invest in Google.
Starting point is 00:13:07 Google has this unbelievable high margin business of search, when the most perfect, beautiful business models of all time. And the purest aggregator of them all, like scales in every direction, doesn't have to invest in any money to do it. Everything's zero marginal cost. It's amazing. Meanwhile, there's this AI opportunity,
Starting point is 00:13:24 which requires just astronomical, it's just incinerating cash. But you can imagine if AI is intelligence and its TAM is basically all white collar work, and eventually with robotics, probably more, everything, potentially, the absolute profits available here. even if the margins are lower is so much larger that will we look back in Google search
Starting point is 00:13:48 what sees candies? It feels like that's what's happening. In that world, you use all your free cash flow. They've done that. You tap the debt markets to the tune of hundreds of billions of dollars. They've done that. You issue equity. What does an equity issue that to do?
Starting point is 00:14:04 It dilutes your interest and your interest of your shareholders. So you have a smaller percentage of the pie. Well, you have a smaller percentage of an astronomy. minimally larger pie, at the end of the day, no one's going to be complaining. It was very symbolic. Berkshire being the symbol of that equity issuance in that are they actually not just an investor in Google, but a model for Google and where they're going? I'm curious, setting aside the commercial and competitive components of this like you're describing, how AI pilled on the pure technology would you say you are relative to other people thinking about this space? I have a view that is both super bullish and less bullish in some respects. So I am not fully convinced about the generalizable argument. AI is clearly incredible at coding.
Starting point is 00:14:54 It kind of blows my mind that people were doing this a year ago, like actually writing out code. It's very good at math, obviously. But the obvious repost is that these are sort of verifiable domains. what is the evidence or where is the compelling evidence of being very good at verifiable domains queenly translates to being very good at sort of unverifiable domains or domains that take have a very long sort of verification loops. I think that's still a little bit to be determined. And it's interesting because I raised this question and there are some people of the labs that
Starting point is 00:15:28 were on a panel. And I was kind of annoyed at the answer because the answer took me for an AI I'd bear. Oh, well, people thought we couldn't solve chess or we couldn't solve goal and we solve those easy enough. And I'm like, I thought we could solve chess. I thought we could solve goal because they're knowable domains. Scale was the answer to both of those, but also both of those were bounded. What is the go-to example that's not chess, that's not go, that is genuinely in a new space, that's sort of an unknowable space where it's doing things that were not possible? that is sort of the, I'm not fully convinced sense. However, AI trained at a rough approximation,
Starting point is 00:16:09 trained on all the data of the internet. All the data of the internet, that's distillation. It distilled all of the end state of human thought. The actual typing on Reddit, it doesn't have the traces. It doesn't actually have the thought, the emotion, or whatever that went into typing that comment or typing writing that essay,
Starting point is 00:16:29 say neuralink, whatever. What if the actual payoff from Neurrelink is actually capturing the traces of human thought that actually dramatically expands the capabilities of these models? In this world, my concerns about verifiability is like, well, we solve verifiability by getting more data. My sense is that a huge number of jobs, a huge amount of economic activity does not exist in these domains that I'm not convinced that it is good at. Actually, there's a lot of people in the world who are kind of like sentient AI. to a certain extent. They operate very well in verifiable domains.
Starting point is 00:17:04 They're given jobs. They do them. And it's almost like a somewhat pessimistic view of humanity to a certain extent. But I think that market is so huge
Starting point is 00:17:13 and so large that if the models did not improve at all from where they are right now, the economic opportunity is actually massive. I wrote an article
Starting point is 00:17:21 a while ago. There's the whole like accelerationist movement. What I call myself was a reluctant accelerationist. I think we need to push forward
Starting point is 00:17:29 because We can't go back. And the worst thing we can do is get stuck where we are. So I'm very AI-pilled in terms of its impact on the economy. It's sort of upside in terms of monetization. I'm not sure about the timing. What would be like the gradient towards it? Imagine law or medicine where I don't know whether or not you would consider those verifiable.
Starting point is 00:17:53 Like law is like a code of some sort medicine. We have a certain state understanding of things. I mean, I think medicine is by far one of the biggest opportunities. It's both of the biggest opportunities and also one of the most challenging ones because of all the regulations and all the access. Like if you could turn an AI, turn machine learning onto all the medical records, I think the number of discoveries and improved treatments we could come up with in a very rapid amount of time would be unbelievable.
Starting point is 00:18:20 So that is a very optimistic view. On the flip side, like, when is that going to happen, right? I think the optimistic frame I put on humans is our capacity to create needs is sort of unlimited. So I think we'll do a very good job of creating new opportunities and jobs serving the fullness of time. The sort of more pessimistic way to put it is our ability to create red tape and muck is also fairly unlimited. How which of our economy is actually we've managed to create more and more jobs that is just make busy and make slow to a certain extent. automate security and compliance for over 16,000 fast-moving companies like Ramp, Cursor, and Harvey, keeping an audit ready around the clock. It's the number one agentic trust platform,
Starting point is 00:19:06 and it now helps companies like yours watch for the risks that show up between audits, across your vendors, your AI tools, and your whole environment. Every new tool your team signs up for, every vendor that turns on AI features is an opportunity for something to go wrong, and most security programs weren't built for AI's pace of growth. The Vanta agent works like a 24-7 GRC engineer in the background, finding issues, drafting fixes for you, and cutting vendor assessment time by up to 50%. Whether you're a fast-growing startup or a global enterprise, Vanta helps you earn and prove trust. Invest like the best listeners get a special offer for $1,000 off at vanta.com slash invest.
Starting point is 00:19:45 Ridgeline is the first end-to-end system of record with embedded AI for investment management firms, running portfolio accounting, reconciliation, reporting, trading, and compliance, on one unified platform. Firms are moving off legacy technology and onto Ridgeline because of how far ahead Ridgeline's AI features are compared to anything else in investment management software. Which is why I believe that firms that come out ahead in the AI era will be the ones running on Ridge Lines Unified Platform.
Starting point is 00:20:12 If you're serious about your firm's AI strategy, Ridgeline should be part of that conversation. You can request a demo at ridgeline.aI. If I go back to the early 2010s, maybe the aggregation theory is stewing in your brain and then you published it in 2015. I think it's fair to say like that theory, that idea, maybe you can just quickly remind people what it is,
Starting point is 00:20:35 defined the winners and losers of that era of technology. I'm really curious how you're thinking about what theory or principles will define this era of winners from like a financial perspective and market cap perspective. I go back and forth even just on the question of arreation theory itself. How much does that apply in the current era? Yeah, yeah. Yeah, because like a pushback that people have is. One of the key components of adulation theory
Starting point is 00:21:01 is zero marginal costs. And zero marginal cost shows in lots of ways. The one that I focused on the beginning was distribution. And people say, oh, I don't have distribution. I have Google for ads. Like, well, no, you have a website. Your problem isn't that you have distribution. Your problem is you don't have demand.
Starting point is 00:21:15 And you're paying for demand when you're paying for ads and things on those because the aerators control demand. And they control demand because in a world of abundance, the hard problem is not distribution, it's discovery. How do you actually find what you're interested in? So the companies that solve discovery in their domain come to dominate that market.
Starting point is 00:21:31 They get a virtuous feedback loop, that sort of aggregation theory in a nutshell. And the other thing is transaction costs. There's no transaction costs. Google can scale to the whole world. And they can scale to the whole world, not just on the user side, but also on the monetization side.
Starting point is 00:21:43 The vast, vast, vast majority of advertisers on Google or meta never talk to someone at Google or meta. They just go up and they buy ads. It's all done by computers. The perfect business. And those computers, from a business perspective, cost $0.
Starting point is 00:21:56 AI, obviously, that changes, significantly. Inference costs are real. But then again, how real are they? They're real right now. I don't know, are they? It depends on the company, but they're way more real than those prior examples. Well, we... Like if you look at gross margins, for sure, but you have this incredible spread. So you have people, I think the vast majority of people who are using ad today are using it as basically a Google substitute or like a recipe maker or whatever it might be. And my suspicion is that the cost to serve those people is extremely low and low indeed basically similar to serving them a web page.
Starting point is 00:22:33 I would imagine it's marginally higher, but not that much higher. Then you have on the other extreme people who are actually leveraging test time scaling. It used to be we just scaled by making the models bigger and bigger. Now you can scale as far as time. How long do you think about the answer? Well, you could think about the answer for days or weeks or months. that is directly marginal costs. Every second longer you're thinking is costing more money,
Starting point is 00:22:57 which speaks to like we think about AI and inference as this one question. That's why I was pushing back on you, but actually the marginal cost question for the different user, the user using free chat GPT and the user trying to solve a math theorem, they're not even remotely in the same universe. I think you see this challenge actually in the enterprise in a very interesting way. Microsoft recently, they are showing. shifting their enterprise plan. So they come out with like an E7 plan, $100 per user per month,
Starting point is 00:23:27 that includes some amount of usage. But then they also are charging for usage on top of that. I think this is kind of a fraught position for Microsoft to an extent, because the positive way to think about Microsoft is they do everything you need as a business. Every individual component might not be the best, but you get it all for one price. And they all mostly, work together. And if you're particularly a small, medium-sized business or even a large enterprise, there's real value in doubt. That's right. It makes life easy. The moment you start having to think about how much you're paying, it's not just that that's a new decision, number one, that is untethered from headcount. Microsoft got the benefit is when you were hiring a new employee,
Starting point is 00:24:13 you would think about the cost of that employee and baked in the cost of that employee is $100 a month or $50 a month for their license. It was kind of a thought. It was kind of a thought. Lawless revenue stream from Microsoft. Now, if you think about usage, you have to think every single month, how much do I want to spend? That introduces two problems. Number one, most companies aren't set up to do this. They make budgets like once a year, this idea we're going to be thinking about through our budgetary allotment on like a monthly basis doesn't compute. there's an aspect where they're used to thinking about
Starting point is 00:24:49 CAP-X decisions or one-time cost. And there's a bit where when I'm talking about this employee, like the loaded cost of employee, it's not CAP-X, but it's kind of like CAP-X. It's like you make the decision up front and you don't think about it anymore. The decision is sort of already made. But if you're thinking about usage, you have to do it again,
Starting point is 00:25:03 the final thing is if you're every month looking at your Microsoft bill and how much did I use, you start thinking about what am I paying for? How good is each of these products? Should I actually just start thinking about in spraying this out. And I think they had to do it because that extreme of user
Starting point is 00:25:21 who uses a ton of tokens who is actually leveraging AI costs way more to Microsoft than $100 a month. They can't support them. But they want to hold on to this set cost for the vast majority of employees
Starting point is 00:25:32 who can fit in that because they need to ask their customers to think a little bit for those extreme employees, but they don't want them to think too much because that breaks the model in very surprising ways.
Starting point is 00:25:44 Are you surprised at all? that the recipe builder user that is very low cost to serve, that there hasn't been a great business model that's emerged around them just yet, Google and Facebook are sort of business perfected in this prior era.
Starting point is 00:25:57 They haven't seemed to figure this out at all. I am frustrated but not surprised. This is obviously a market that should be supported by advertising. That is why advertising is always the consumer business model. Consumers don't want to pay. There's two things to understand about consumers
Starting point is 00:26:11 that Silicon Valley has to relearn about every 10 years. years. Number one, consumers do not want to pay for software, and number two, consumers do not care about being productive. We went through this in early SaaS. The canonical company for this, in my mind, is Dropbox. So Dropbox, unbelievable product, like, especially when it first came out. In business school, I was one of the first people used Dropbox, and that went off like crazy. I have so much storage still, like, my free Dropbox because I gave out my code to, like, so many people. So Drew Houston makes this amazing product so easy to use, just absolutely.
Starting point is 00:26:45 seamless. He was very clear about this. He wanted to build a consumer company. And there's that famous story of him meeting with Steve Jobs. Apple was interested in acquiring Dropbox and like, oh, we want to build a company and Steve's, you know, you're a feature, not a company, which that plain Jane just files sync. Apple did make a feature as far as like sort of ICloud drive. And what Dropbox, they grew very fast. And then they have like a two-year low. And in that to your low, what they had to do was basically completely rebuild the app from the bottoms up because not enough consumers are going to pay for it. Enterprises could see the value. They would pay, but if you want enterprise, you need permissions, you need control, you need someone else to be able
Starting point is 00:27:26 to set all these sorts of things. And their app wasn't created to do that at all. So they had to rebuild the whole thing and realize the only way we're going to make money is by selling to companies. Why do companies pay? Because companies are paying employees to the extent they can make their employees more productive, they're getting a greater return on their investment. It's the complete inverse of a consumer. A consumer's like, I spent all day working, why do I want to come home and be more productive? I want to sit on the couch and watch reels. But you see that with AI. And you also have this overarching just skepticism of advertising. I've gotten so much traction on trajectory by being an advertising appreciator. And I go back and read my early articles about advertising
Starting point is 00:28:09 that were kind of directionally correct, but also like we're not very good at all. But I got so much traction doing it because I was the only person writing about advertising. In a world of everyone who wanted to have a blog and Twitter, no one wants to talk about advertising. But even now there's in Silicon Valley this sort of embarrassment about the fact
Starting point is 00:28:29 that the valleys in many respects monetized by advertising. And particularly during the last sort of eight years, there was a Facebook's icky. The best engineers don't want to go work on this problem. And so you literally had Open AI replaying the Dropbox story, but at like 100 exercise, being like, no, we're going to sell subscriptions to consumers. They did. They sold a lot, but they didn't sell enough. If you're going to be in the consumer market, you have to be doing advertising. They're doing advertising now. It's a little weird. They finally pivoted to doing advertising
Starting point is 00:29:03 at the same time. They're like, oh, crap, we need to go off the enterprise because Anthropic is kicking or we're in. So I'm not quite sure what they're doing there. They have been rolling out ad features very rapidly. Things like Cappy and the connections with retailers, so you know if a purchase went through, so you can do all the tracking and things like that. I'm very interested to see how that goes. There's a bit where had they leaned into advertising immediately as soon as chat GPT was a hit, I think they would have a killer ad product right now. I think that Google would be in much bigger trouble. I think meta would be in much bigger trouble because if you have this flywheel. The thing about
Starting point is 00:29:39 advertising with consumers is your ability to monetize the consumer goes up as a volume goes out. Yeah. Because the advertiser is bearing the price increase. So there's zero elasticity issues. If you're charging consumers a price, if you want to raise the price like Netflix, this is their
Starting point is 00:29:55 problem with the subscription plan. How much can they raise prices before consumers rebel and drop a tier or give up the service entirely? Charging people money is hard. Giving people things for free is easy. And it's very frustrating that open AI did not pursue this sooner. I know you've been spending time with some of the big money firms and sources of capital.
Starting point is 00:30:17 What is your sense of their appetite right now and how they're thinking about the future? Because I think this year it's going to be $800 billion or something that we're going to spend in KAPX. Next year is supposed to be $1.3 trillion, I think, is the current estimate. It's going to keep going up from there. We're burning through all the compute that gets installed basically immediately. It's such a strange circumstance that we can use the capacity. right away as soon as it's online. Well, that's the thing, though.
Starting point is 00:30:40 So there's a few time you mismatches that are happening right now. We can't use it right away. All the bulls on Twitter is always like, we don't have enough compute. We don't have enough compute. Well, we don't have enough compute because there was insufficient investment made in 2023 in 2024, which, yes, absolutely. And by the way, if there's not enough compute, TSMC decreased their rate of growth in 2023 and 2024 and 2025.
Starting point is 00:31:04 our shortage of compute is going to get worse in the next few years. Because a fab, the lead time is even greater than a data center. Today, when we say there's not enough compute, it's not like all the money that the companies are putting in today, manifests in computers tomorrow. No, it all manifests in compute in 2028 and 29. On the calls, you have both Andy Jassy and Saidaela are out there saying, look, we're just building data centers. Like, these are the shells. We might not use them now.
Starting point is 00:31:33 maybe we'll use them in the future, and we only buy GPUs when we know there's demand for them. That is a great story to tell. I'm not sure that I think is a lot of BS because the reality is if you've built the shell, that money is sitting there. You're not going to let it just sit there. If you invested a fixed cost, and this is the whole logic of commodity markets, I think tech in general doesn't understand commodity markets. Tech is by and large focused on if I produce a highly,
Starting point is 00:32:03 differentiated product and that differentiation could be like software, it could be a network in terms of developers, it could be a social network sort of thing where peer to peer where I'm highly differentiated than my ability to charge higher prices provides sort of my profit margin. So the class example is like Apple. They have their ecosystem and they have their software and they have third party and all those sorts of things. And so they can charge 50% margins on their iPhone. Everyone looks at Apple as like the ideal business model. That's how you run a business. But in a commodity market, the price is set by the marginal supplier. Cost to serve is all that matter. That's right. I had a good friend in Taiwan who is in shipping.
Starting point is 00:32:40 Fascinating industry. It's kind of like the airlines too and other industry that I love to look at. You buy a ship and the cost of that ship is depreciation. Your marginal cost is actually quite low. It's the fuel to run the ship and the cost of the crew and like your port fees. Not that much. What that means is you are going to run that ship as full as you really possible. No, you're going to run no matter what. And you're going to bring down the price of a container as low as it needs to be to cover your marginal costs. Now, your paper losses in this situation might be very large because your accounting loss includes depreciation. But the depreciation is an accounting figment. You already paid the money.
Starting point is 00:33:18 You're going to run that ship at whatever the market will bear. In the container, the beauty of the container, it is a pure commodity. The cost of the market is going to be the marginal cost. Now, if it gets low enough, at some point, people, will exit because their marginal costs, they're actually losing money on a shipment, not just paper money, but like actual real money. They will exit, but then the supply is diminished, so then the price will go back up, and you get this interplay of sort of coming in and off, but then let's say the market's very high,
Starting point is 00:33:47 like it was during COVID, it's like, wow, we're making so much money right now because there's not enough supply. There wasn't enough supply of ships. So containers went from usually being like $3,000, $4,000 to $17,000, $18,000. The amount of money that the shipping companies made in a very short amount of time was insane. What happens, though? Well, imagine if we had more shifts, right? The problem is, it takes two years to build a ship.
Starting point is 00:34:12 If everyone makes this decision simultaneously, you suddenly have a lot of ships, price plummets, etc. Where we see this is in components, in memory in particular. Memory, very famous for boom and bus cycles, people entering the market late. But to what extent are data centers going to be memory makers? where right now everyone can see we don't have enough compute. So everyone's like, we absolutely have to be investing because there's so much money to make. And look at our payback period.
Starting point is 00:34:41 The problem is you're measuring your payback period in a time of scarcity. Is that payback period going to hold in a time of abundance? And the sort of the bulls will say, there's never going to be time of abundance. AI, test time scaling, we're going to be short forever, which maybe we will be. My concern is even if that's right,
Starting point is 00:34:56 we could still have an air gap in that there's so much money, going into it right now and not enough has come online to actually make sufficient revenues to handle the situation where we run out of capital. I believe in AI. I think it's a real thing. I think the economic impact is going to be astronomical. I think all the concerns about societal impact are very real and are going to come to bear in a major way. You can believe all that and still be worried about are we going to make the bridge to this actually generating the level of returns necessary to continue to feel this sort of going forward. Can you zoom on TSM and the component makers where fabs are involved. And so far, at least my understanding
Starting point is 00:35:35 is that they've been quite conservative in their willingness to expand capacity, build new fabs, meet the market's demand with similar growth, which they have not done. If that just rate limits this whole thing and prevents us from getting one of these giant overbuilds. We can talk about a few different ones. Like, we'll start with memory. Memory used to have tons and tons of memory makers. Every time there'd be a boom, memory makers would sort of reenter the market. New countries would come in. Like, Taiwan used to have like a memory market. But you'd get these exact dynamics.
Starting point is 00:36:06 If there's a shortage of memory, there's so much money to be made, you can't bring capacity on immediately. The same as shipping. It's the same as what we're seeing right now. That would spur people to come in the market. You get too much capacity. Prices would plunge. And people would just get blown out.
Starting point is 00:36:19 Because the issue is the upfront cost for these is so large. Just like buying a ship, like building a fab is even more so. And memory now, like the leading edges of memory are using things like EVV machine. So the costs are getting into. the billions of dollars for these lines. What happens is every time with these boom and bus cycles, some people would enter, more people get washed out. You go through these famous historical moments for these memory cycles.
Starting point is 00:36:40 Companies just get blown out. One of the most interesting actually memory stories is how Samsung sort of took over memory was they sought as an opportunity and they had studied history and they realized that actually the way to take over the market is to invest into downturns so that you're ready when the next cycle comes around, which requires a ton of guts and a ton of guts and a ton of, ton of discipline and a ton of money, but they did that and basically wiped out the Japanese. That's when the South Greens generally took over the market in a major way.
Starting point is 00:37:07 But it got down to three. And the problem is three, it's not a monopoly, but it's kind of an oligopoly. And they all got a lot more discipline about let's not make the mistakes of the past. And we're not colluding, but we all are on the same page about let's not do that. And I think that dynamic sort of ran head on to the current moment, where it's, It just took a while for them to realize, no, there is a secular shift in memory demand that didn't exist for a very long time. I think the memory solution will be solved eventually. The other risks they run is Apple's lobbying to get Chinese memory.
Starting point is 00:37:47 What is the number one focus of like arithmetic changes? How can we use less memory? I think the memory makers probably screw themselves in the long run by creating such a massive target on their back. I've analogous memory makers to Iran. The issue with the Strait of Ormuz is it's very effective. It's more effective if you don't use it because then it's always hanging out there as something you could do. Now they did it. Turns out it worked.
Starting point is 00:38:12 But the UAE and Saudi Arabia, they're going to build pipelines. They're going to build new ports. They're not going to let this happen again. It's very painful right now. But say Iran wants to close the Strait of Ramos in 2035, it's not going to have any effect because it will have been built around. My concern for the memory makers is they might have done the same thing. No one's going to let themselves get in this situation again as far as memory goes. TSM is arguably worse because there's only one.
Starting point is 00:38:36 There is one company on the leading edge. Obviously, Intel and Samsung are trying to get there. It's the same thing. All markets carry risk. And a lot of the question is who ends up holding the risk? What I think a lot of the tech companies didn't fully appreciate is the extent to which TSMC has offloaded risk onto the big tech company. And the way they've done that is the risk that TSM is worried about is overcapacity.
Starting point is 00:39:03 If we build too much, it's not just that we built too much and we have all these fixed costs that are not being fully utilized. But if we build a fab, we expect that FAB to run for 30 years. We've like baked in too much capacity into the system for years and years and years. So they are very biased towards being much more conservative. There's a little bit of a culture component to this too. One of the most interesting TSM stories. It's kind of an analysis that Samsung story. was Morris Chang retired in like the late 2000s.
Starting point is 00:39:32 New leadership took over. There was the Great Recession. And so they pulled back their plan spending. He comes in, fires everyone. And he's like, the iPhone just launched. This is the biggest opportunity we've ever seen. We need to be investing, not cutting. And they invested through the Great Recession and through that downturn.
Starting point is 00:39:52 That's what laid the foundation for them taking over sort of leading edge semi-conductors in that time. Morris Chang is a one of one. On the Mount Rushmore, in my mind, of the greatest and most impactful tech executives of all time, the entire fabulous model is so critical to what tech is and what it does. And also just the guts to do that at that time, particularly in someone who lived there, a culture that doesn't necessarily tend to make those sorts of bets. TSM, they were pretty conservative, to be totally honest. So what happens, though?
Starting point is 00:40:23 Where'd the risks go? TSM's like, we don't want to take the risk. risk doesn't disappear. It just moves. The risk is right now where you have every single big tech company realizes if we had more compute,
Starting point is 00:40:39 we could be making more money. So there's lots of foregone revenue and foregone profits that is the manifestation of the risk that TSMC handed off to them. Risk doesn't disappear. It just gets handed off. And sometimes that risk doesn't manifest
Starting point is 00:40:52 in losing money, it manifests in not making money. And there's a manifestation of money. And there's money not being made right now because what happened was they were very excited about 5G. They did a big wave of like investment expanding their fabs in around 2020, 2021, 22. And they're like, oh, yeah, we're good. Like I said, 2024, Chatshaputon is out 2022. Big thing in tech in 2023.
Starting point is 00:41:14 In 2024, their growth weight went down. In 25, their growth rate went down. In 2026, it's up now. It was very funny because I was writing about this a while ago. and then I think it was like one or two earnings calls to go. Suddenly, CCA, the CEO and chairman, is talking about like use cases for AI. The whole earnings call in a way he never had before. This is why the memory makers are scared.
Starting point is 00:41:36 Usually there's like a bullwip and they're worried about being at the end of the bullwhip where the demand happens and it works this way down the chain and they're at the end. And then they double down. It's already too late. They're wasting all their money. And I think the thing with AI is if it's a bullwhip, it's like the longest bullwhip of all time. There's still so much to be. built. And it just took a while for Asia to get the message where these sort of companies are.
Starting point is 00:41:59 I think they've, by and large gotten it, but them getting the message, it then takes several years for that to actually materialize. Do you have a sense for how long you think it will take, given the extreme shortage of compute? The interesting thing is what this means for Intel and Samsung's sort of logic business. I've been writing about the problem of this dependency on TSM for years. One of my first articles in 2013 was exhorting Intel, well, I say you have to build a fab business. You're not going to be a desire anymore. There's a huge business in manufacturing ships. I thought I was late writing it then. Their stock goes to the moon throughout the 2010s as they're riding the sort of cloud wave. And it wasn't until 2020, where they finally realized we fell behind.
Starting point is 00:42:43 By the way, there's this huge opportunity. We're totally unprepared for it. We don't have a customer service mindset or culture organization or all the IP building blocks and all these things that TSM has. And they need a customer. They need customers to help them actually build a real foundry business. So I would write about this as a problem. And I read about the China issue. Like you're dependent on a company that is 60 miles offshore of our greatest shoe biblical opponent who thinks it's there. So these are big problems. That's where I came to appreciate this insurance issue for a big tech company to go to Intel and say Intel, you make our chip. And by the way, the biggest benefactor of this is going to be you because you're going to learn how to work with a
Starting point is 00:43:25 partner. And the biggest pain is going to be us because we're going to have to figure out how to work with you. We could just go to TSMC. They are awesome. They are so great to work with. We know they're going to do a good job. It just never made rational sense for anyone to go work with Intel. That was their fundamental problem. In an unchanging world, TSM would just win forever. But this is where TSMC, and some restops made the same mistake as the money makers made the same mistakes as I ran, if I can continue the analogy. Because they didn't invest the last few years, the shortages are going to be so acute. Big Ten companies that were foregoing so much revenue and so many profits because we don't have enough compute, we will go through the pain of getting Intel up to speed,
Starting point is 00:44:09 of getting Samsung's logic up to speed. The scarcity is what ultimately save Intel. I expect at some point that they're going to announce some major partner for the first time. It's going to be a big deal. But ultimately, TSM brought it on themselves. It's the cure for high prices is high prices thing. We're going to route around them. There's all these things as like an analyst sitting on the side.
Starting point is 00:44:30 You can write these things. And one's what those things I've sort of warned, no one's going to pay insurance that they don't need to pay when that insurance expected value is negative. The way to solve the geopolitical problem of dependence on TSM is to come up with a compute use case that is so massive that everyone is economically incentivized to bring other people up to speed. And then we get the sort of geopolitical insurance for free. If you think about the, let's say, top 10 or 15 technology companies, which ones do you think have the most interesting setups today for their business? The answer is always Amazon.
Starting point is 00:45:04 The reason Amazon is so compelling is the extent to which they build for them. They are their first best customer. They provide the scale to get basically anything off the ground, which they then sell to other people. AWS is the most obvious example. AWS, contrary to sort of popular thought, was not spare Amazon capacity. Actually, it took a long time to get Amazon.com onto AWS. What it drove was the understanding that we can't be having so many meetings. Like, we need to have just compute that you can plug.
Starting point is 00:45:34 Again, purely API surface. You don't need to talk to anyone. It's just there. And oh, by the way, if we do that for our internal retail teams, we could do that for anyone. Turns out the retail is so big. We have to start with everyone else. AWS actually started serving external customers before it served internal ones, but
Starting point is 00:45:49 now it serves them all. You got other products like, say, the logistics where it was the opposite. Right now we're using external providers for our logistics, UPS and FedEx and USPS. We need to build this up ourselves. and now they built out themselves, they're offering it to third parties. Other people can use their delivery services. You see this in market after market.
Starting point is 00:46:10 They're talking about some of their AI products or their chip products. What's the beauty of the Graviton or the Traneum, particularly the early versions? Their own versions were terrible. But if you're on Amazon and you're using some of their managed services, like say the Redshift database service,
Starting point is 00:46:25 they don't tell you what the processor is underneath that. You're just buying a managed service. So they can put all their crap processors underneath the services they're selling, and that gives them the volume and the capacity to iterate them and get better. And they get to the point where they can actually sell them externally because they were the first best customer for Graviton, Graviton got better. Because they were the first best customer for Traneum, Trinium got better. And now Trinium is obviously running Anthropic and AI products. We'll see if any of them take off. They have
Starting point is 00:46:53 call center software. Their call center or their customer experience is going through AI. By the way, it's pretty good. I haven't tried it. Moving back. Back to America, I've been buying lots of stuff. Every summer I'd buy lots of stuff in a very brief amount of time. Sometime, like the last year or so, you can go on and you're clearly talking to a chat bot, but the chat bot does a great job. And it actually does take care of the problem. So you can see that actually starting to work in that regard.
Starting point is 00:47:16 But they're building up these AI services for their own business that they're going to make broadly available. And some of them will work. Some of them won't. It's such an elegant approach, given they have so many investments in the real world. their core business feels so impervious to AI for the model version of AI. It will benefit from AI, but their moat feels deeper than anyone as far as their core business.
Starting point is 00:47:42 And their ability to just sort of generate new business lines organically is very compelling. What about Apple? They've set this whole thing out, it seems. It feels like it might be a situation that better be lucky than good to a certain extent. Apple has their whole ecosystem. At the end of the day, they do own access to customers. So they can get suppliers. This is the classic aerator plate.
Starting point is 00:48:05 If you won't access to customers, suppliers come to you, not the other way around it. So they can get suppliers for their AI as needed. And by the way, to the extent it's true that people don't want to be productive, they just want to sort of a chat bot. Not only can they serve them a chatbot
Starting point is 00:48:23 and finally getting a Siri that works, but you can see a future where this absolutely can work on device and they actually don't even need to pay for inference costs either because they're using the customer's electricity. I don't think we're quite there. There's a reason they're using Google Cloud and Nvidia chips, but you can certainly imagine a future where that's the case. And they're in physical goods. Actually making phones is hard. Having retail, having distribution for physical goods, they're more insulated.
Starting point is 00:48:49 The smartphone is so perfect. It's small to fit in your pocket. It's big enough to watch basically anything on it. You can run your whole life on it. All your entertainment is there. when we talk about customers just want to be entertained, the TV is now an accessory. It's all on your phone.
Starting point is 00:49:03 I don't see anyone taking over the phone. The question is, is the phone always going to be the center? Or is there a bit where, particularly in the home, these are where opening eyes efforts here are very interesting, where you want sort of an ambient AI, where you just talk to the AI and it tells you what you need. Apple is the best position to provide that, but can they provide that without having,
Starting point is 00:49:27 leading edge models. Can they provide that if they're so phone-centric, or is it like a Microsoft situation? Microsoft didn't miss mobile. They were very early to mobile. The problem is their mobile was a small PC. They assumed the PC would always be the center and their phones were going to be something that was off that. Apple realized, no, we need to reset. The phone is not going to be accessory to the Mac. The phone is going to be the phone. The iPod helped them realize that and going with Windows and all that. But will they fall into a Microsoft like traffic, assuming the phone's good. It's always going to be the center and then let's figure out around it. Or is this five the time when actually ambient, the cloud, just in general, AI being everywhere, it can
Starting point is 00:50:07 manifest through your phone, it can manifest through a device, can manifest on your computer, is actually better and is actually disrupted to them. I think it's possible. I also think it's totally valid for Apple to double down on what they do. The other thing about the AI stuff is, on what basis should we expect Apple to be good at this? At the most crude level, AI is this probabilistic endeavor. Apple is the king of deterministic products. A physical product, you ship that iPhone, you ship it once, and it's got to be good. If it's bad, it costs you billions and billions and billions of dollars. Apple's never had an iPhone recall. It's amazing. That care and decision-making indiligence and fierceness in terms of your supply chain and making hard decisions is very, very
Starting point is 00:51:00 different than everything goes into like making great AI. I'm generally prefer companies to do what they're good at. So from my perspective, I'm fine with Apple not doing AI. I want them to keep making great devices. Of the five potential frontier AI winners, so Open AI Anthropic, Gemini, SpaceX AI, GROC, and Meta, which of those firms do you think has the most interesting setup? Open-A-Aid Anthropic obviously are the riskiest, but also have the biggest upside. Never discount, number one, the power of belief. They think they're creating God.
Starting point is 00:51:32 The most impactful things in history have usually been fueled by religion. The two religious organizations in Silicon Valley are, opening eyes kind of like mainline. They go to church every Sunday. They're sort of like evangelicals. That's anthropic. They're all in.
Starting point is 00:51:47 It is core of their belief. That goes a long way. The fact you need to make a business work for you to survive, goes a very long way. Google just needs search to not die too quickly. Meta has the huge advertising business in a world where meta was run by anyone other than Mark Zuckerberg. They would not be on the winning edge. That is one of the purest manifestations of founder energy for better or for worse. Their business is so amazing. You see them just easily doubling down on that. Google, there's a bit where they had Google Cloud, they have TPUs,
Starting point is 00:52:18 they've been doing research in this. It makes sense why they're pursuing this. Meta being, like actually we're going to hire a completely new team or going to start from scratch. This is all again is pretty insane. Credit to Mark Zuckerberg in that regard, again, you could decide whether that's a good idea or not. And then SpaceX AI, data centers in space, the theory is there. Do they have to own their own model, though, to do that? They get better margins if they do, then again, if we actually run out whether through political opposition or power or whatever might be, if we run out of data centers on Earth, they can run whatever model they want, as we're seeing with
Starting point is 00:52:50 selling their capacity to Anthropic right now. They're all pretty interesting. Probably the case for space X AI is probably the weakest because the data center in space play is so highly differentiated. If that plays out, I'm not sure to what extent they need to even have their own model. So why are you wasting billions and billions of dollars in the meantime? That's a fair question. From a tactical perspective, I love the cursor acquisition. That makes so much sense for both companies.
Starting point is 00:53:20 And so I've been intrigued to see what they do. Mehta is probably the most interesting. You've written a lot about this recently. I think there's a very good case to make that it is more reckless to not be on the frontier if you're a digital company. The counter to meta is actually Microsoft. Microsoft is not on the frontier. The reason why Microsoft has $40 million of free cash for the last quarter, Microsoft paid a $10 billion dividend last quarter. There's some money, but their play is, oh, we're going to play all these off each other.
Starting point is 00:53:48 We're going to provide middleware. We're going to provide the platform that enterprise will build on us, and we're going to and sort of disintermediate the models. I think it's a rational play. It's the IBM play of the 90s. History echoes. Everyone talks about Google, Google, like falling in Microsoft,
Starting point is 00:54:02 but also follows IBM. And you can see that to an extent. What did IBM do? What's the analogy? Well, so IBM had this dominant, we talked about in the 70s. And then you fast forward to the 90s, and IBM is this very distressed asset.
Starting point is 00:54:15 And the thought was IBM needed to break up and all these different pieces they had. So Lou Gersner comes in and takes it over. Gersner's real key insight to IBM is we're pretty mediocre at everything. It's kind of like when I talked with Microsoft before. And that's the price of monopoly. Once you've been a monopoly, you kind of lose your capacity to be good because you didn't need to compete anymore.
Starting point is 00:54:38 And I think a lot of tech incoming companies have this problem. It didn't matter what they did, they were going to rake in money. And if you don't have the pressure, if you don't have the incentive, if you don't have the fear of death or the fear of God. as we talk about these model companies, then you don't do your best work. And the problem is that once you lose that muscle, it's gone. You're just sort of fat and flabby.
Starting point is 00:54:59 So what Gersoner realizes, actually the worst thing IBM could do would be to break it up into component pieces because all those component pieces are actually not very good. Our biggest asset is that we're big. It's like, what? No, what does it mean we're big? It's the 90s, this internet thing's coming along.
Starting point is 00:55:15 There's all these companies that kind of know they have to figure out the internet and they don't know what to do. they need someone who can come in, understand their business, and help them get online. That's basically what IBM did. So they built out,
Starting point is 00:55:27 and this is an echo of what's happening now, huge consultant force, and they put all their time into building, basically it was middleware, where they would go in and they'd put this layer between a company's old school mainframe, which all these companies had,
Starting point is 00:55:42 and then modern web services. On the other hands, they could have websites and e-commerce sites and all this sorts of thing. And it gave IBM a 30-year lease on life. Yes, in theory, you can go get point solutions from all these hot Silicon Valley startups, but you don't understand that. You don't know how to do that.
Starting point is 00:55:56 You know us. We'll come in. We'll create all this middleware, build this big consulting force to help you implement it, and you'll get online. And IBM basically brought all of corporate America online. That's Microsoft's Playbook. Microsoft will help you figure out AI. It will help you figure out in a way where you're not giving away the crown jewels to these companies. We're going to build this platform, this harness, this sort of middle layer.
Starting point is 00:56:17 We're dependable. We're stable. You know us. We have backwards compatibility to the 80s. You can build on us and then we'll manage all the changing models
Starting point is 00:56:26 and what's updating and do all those sorts of things. And does that mean you'll get the absolute best experience? No, middleware saws off the sharp edges. You sort of get a lowest common denominator capacity. But if you value in this,
Starting point is 00:56:39 the oldest enterprise sales motion, how did Oracle go to market? Oracle went to market in 1980s, Larry Allison, with another technology taken from IBM, or just IBM didn't want it, relational databases. And they're like, you don't want to be locked into IBM. Relational database, you could run anywhere, come with us.
Starting point is 00:56:55 The reason this is a joke is because Oracle locks you in more than anyone, right? But all of enterprise sales is companies whose long-term goal is to lock you in, getting you on board by trying to make you scared of being locked into somebody else. All the cloud companies are like, oh, portability, whatever, you can be whatever. They're like, oh, just use our service that only runs in our cloud, and now you're locked in. That's Microsoft's playbook. It's a very rational playbook, and I think it makes sense. That's why they have extra money because they're not on the frontier.
Starting point is 00:57:24 They are building massive data centers, but they're building data centers for inference. They're not building it for training. And their story about investing in time and response to customer demand is more believable in that regard. They're not having to tell a fungibility story where we're building big data centers for training that will be used for inference down the road, maybe. Go back to this notion that it's reckless to not be in the front. The reason why that's concerning, though, is at the end of the day, why are we using Microsoft products again? because we did before.
Starting point is 00:57:49 Like, to what extent does it actually make sense to have all these artifacts, all these documents, all these email inboxes? Can't AI just do that? There's a real threat here where to Microsoft software business, the whole systems of record thing is funny because one reason why systems of records are so powerful is it's so hard to move them to somewhere else because it's a very tedious, repetitive job. Oh, AI is actually surprisingly good at that. I don't know how good the systems of record. Microsoft isn't so much systems of record. They do have some of the dynamics business. It's user interface.
Starting point is 00:58:23 It's like where you actually interact with the computer. That's the part when you see Codex, quad co-work or whatever, it is aimed like an arrow to the heart of what Microsoft has. In the one when all digital companies are, but Microsoft is very much. Their strategy is sound. It's also desperate in a existential way.
Starting point is 00:58:44 And also in a, they might pull it off because they're desperate sort of way. Meta is not threatened immediately, but this is where my bullish view of AI comes in. I think all digital companies are threatened. And meta is a digital company. They have software. Now, one worry is AI takes up more and more time. Time ultimately is meta's currency. We saw, opening, I tried the sort of thing, didn't really take off. Social networks actually pretty hard. Also, it cost a lot of money. It's kind of really interesting. So this came up with the creator payment stuff. So YouTube, very famously as paid creators, kind of from the beginning. And that's
Starting point is 00:59:19 a much bigger drag on the business than people appreciate because YouTube has marginal costs to their content. Now, unlike a Netflix, they don't have to pay that cost up front. They'll pay it after the fact. So they're sharing revenue is a better model than a Netflix model. Netflix is to pay up front for content and then ideally make more money. YouTube pays along the way. But Facebook or meta is nothing. They pay nothing. Instagram is this unbelievable product that generates all this money for which Facebook pays $0 for content. It's unbelievable. It's funny because you could see a world where for YouTube, AI generated content could theoretically be a positive because the inference cost of generating content could be less than what they're sharing with creators. For meta, AI generated content
Starting point is 01:00:04 to the extent they're the ones generating it is actually a worse margin profile than what they have today, because what they have today is free. So they have attention. There is a bowl. There's a world where meta is actually very well placed because in a world where we're interact with the AI all the time, the desire for a human connection becomes greater. And it's sort of like a meta going back to their roots. Meta, one of their biggest mistakes, actually, meta was always a social network company. They killed Snapchat or stop Snapchat's growth by realizing Snapchat as a great product. Let's layer it on to our network.
Starting point is 01:00:34 They brought their network to bear to kill Snapchat. The reason why TikTok was just a blind spot for them is TikTok is classified as a social network and it's not a social network at all. TikTok is an entertainment product. It doesn't matter who you follow on TikTok. What you see on TikTok is a function of what you watched and you're going to get more of the same. It's a user generated content network. And the insight from TikTok was the way to get the best content to limit it to your social network is an artificial constraint. We're going to give you the best content from across the whole network. And the vast majority of content is going to be crap, but this is like the absolute question before.
Starting point is 01:01:11 You don't think about margins, you think about absolute numbers. The absolute amount of great content, even if the margin for great content is infinitesimal, if we have a ton of content, the absolute amount of great content is going to be very large. And meta is like, where's social network? Meta's serving you content from your network of people you know, and TikTok serving you the best content from around the world. That's why they took a huge chunk out of them. Meta had to shift.
Starting point is 01:01:35 That's what's happened with Instagram and with Reels is it's not really a social network. it is a entertainment product that pulls from the entire network and social networking is like the group checked is possible in AI actually social network is important again because like we actually want humans we want to have some sort of connection to them
Starting point is 01:01:52 that would be interesting to see how that plays out but the other thing with the models is they're so impactful on advertising the biggest impact of the models the biggest monetization right now is probably not anthropic opening eye it's the incremental gain that is happening for Google and meta most of the stuff is pre-LM
Starting point is 01:02:08 but we're getting to LMs, whether it be generating advertising content, what we want, want verifiable domains. How do you verify if a generated image is good for an ad? Does the ad sell or not? They actually can validate their image creation and their text creation in a way no one else can, and their validation is the ad marketplace. Running a gazillion AB tests on all these different things, see what works, see what doesn't. Most ads are a throwaway.
Starting point is 01:02:34 It's fine. The vast word ads don't convert. They have this massive advantage, this huge liquid market that is a verifiable. machine where the verifiers are humans deciding whether they click on that ad and make a purchase or not, but they're doing it at global scale that can actually have a feedback loop to make their products better. You're also going to get a world where ad matching is actually still fairly crude. Here's the qualities of the person. Here's the qualities of the ad.
Starting point is 01:02:58 And it's like you create an embedding like a vector calculation and see what numbers match. And then you sort of match an ad to the person. What do LMs do? LMs predict. We're going to move to this world where MET is going to look at, people and say, this person probably wants to see this next and they're going to go find that thing and show it to them. The potential upside in terms of showing people better ads that are more relevant to them, they only need to increase a few percentage points for the returns to be
Starting point is 01:03:25 billions and billions of dollars. This alone is worth them investing in being on the leading edge in having these amazing models. I think a big problem that it has is they don't tell this story. It's weird, but Mark Zuckerberg has the same problem Sam Altman does. He doesn't love that. They have the best ad business in the world. They have an ad business that I think is a societal positive. You and I have set up these little content businesses that make great money. Content is you get a ride on social media. I grew up on Twitter, people sharing my links.
Starting point is 01:03:55 It was amazing. If you're selling some product, the beauty of the Internet is there is a niche out there that wants that product. The question is, how do you find the niche? Facebook advertising. That's what it does. it helps products find the people who didn't even know they wanted that product, but when they get it, they're so happy they got it. That's a huge societal positive.
Starting point is 01:04:17 You have new business from a new entrepreneur making a new product. You have customers who are happy they got something that they didn't know they would get otherwise. Those customers, by the way, got lots of free entertainment and they didn't have to pay for it along the way. And Meta made a bunch of money for themselves and their shareholders, which is basically everyone in the world. This is why advertising is great. And Meta's advertising in particular is awesome.
Starting point is 01:04:35 and I get frustrated that meta doesn't talk about that. Marksseberg has never really talked about the societal benefits of advertising except in passing in 20 years. He's handed it off to other people to take care of. And maybe there's a bit where him not paying attention is why there is a certain grit and grind that goes into building an advertising business. People get frustrated or have questions about it as far as data and all those sorts of things. And maybe there was a bit where he didn't want to be involved in and wipe his hands of it.
Starting point is 01:05:04 But you saw this when Apple passed ATT, app tracking transparency was one of the worst antitrust violations in the history of technology. Apple unilaterally obliterating all these business models while they're simultaneously building their own as far as advertising goes and doing all this tracking. Why trust us? And meanwhile, they're running these advertisements. I remember that advertisement of people on the bus like overhearing everyone around them, what they're saying. That was such a dishonest representation of how advertising works on the internet. You had Tim Cook in Congress talking about companies selling data. Facebook's not selling your data.
Starting point is 01:05:35 That's value to them. Why would they sell the data? Meta was not prepared to respond. I think you got this to Cheryl Sandberg back in the day. She wouldn't every call would talk about advertising how great it is and have a bunch of case studies. People who were benefiting from advertising and these new entrepreneurs. And then she left and it's kind of like that whole never got filled. It feels like it's a company that's kind of like embarrassed.
Starting point is 01:05:54 We make a lot of money from ads, but we got glasses and we're doing AI. It's like you have ads and ads are awesome. I think if they had communicated that more consistently, they would be in a better place generally, from a PR perspective. They would have been a better place relative to Apple. And I think they would have an easier time right now, convincing Wall Street, that let us invest. The other problem is they've spent cumulative $100 some billion on Oculus,
Starting point is 01:06:21 which I dated all along. And so there's a bit where why should we let you spend money again? The one major player and company that we haven't talked about much is Jensen and and NVIDIA. And I'm curious how you would tie this back to the notion of not understanding commodity markets in Silicon Valley, whether or not you think compute ultimately is a commodity. I'm curious whether or not you think intelligence will ultimately be a commodity. It's interesting that intelligence and compute, which seem to be by far the most interesting and important topics in tech, both might be commodities and less differentiated than tech-spire products.
Starting point is 01:06:52 The most interesting thing about the internet is free distribution. Bandwidth is a commodity. The fact that I can pull out my phone right now and connect to any information source in world for free, free on a marginal cost basis, it's because it's a commodity. It changed the world. Commodities change the world. There is a aspect of differentiated products by definition have lower tams because there's a elasticity aspect to it. Not everyone can afford to pay for it. People's willingness to pay is going to differ. Your market is going to be constrained. Apple's never going to serve the whole world by selling a device, whereas a Google can because it's free. That matters. You're paying for a commodity, but to the extent it is available to everyone is the
Starting point is 01:07:30 extent it is impactful. The internet is a commodity. It changed the world. So I don't think it'd be weird that intelligence ends up a commodity and changes the world. Promotities often are not thought of as good of businesses as these differentiated harm margin products. I'm curious for your thoughts on Jensen and Nvidia specifically. Invita's position is, I think, definitely unnatural. You look at Nvidia, they've maintained all their margins. Isn't that amazing? It's 2026, and everyone's coming for them and they're still charging however much money for a chip. But they're actually not maintaining their margins because this whole question of circular financing is people talk about lucent and things like that and you know this whole deal and invas provided 25% backstop but if you
Starting point is 01:08:09 actually ascribe a value to that to invidia's taking equity in the neoclouds or whatever they guarantee they're going to buy all their compute to 2030 why do they do that so that the entity in question can get a lower cost of capital so they can buy their reviews etc but implicit in that why do they get a lower cost of capital? They get a lower cost of capital because Nvidia assumed risk. This is my point before. Risk never disappears.
Starting point is 01:08:37 It just appears somewhere else. Taking on risk has a price. There is a world where AI takes off, it never stops, and everything is fine, and Nvidia captured all the upside of their risk. But there's also a world where, say, that there's this neocl quality that backed up, a ton of compute,
Starting point is 01:08:56 the hypersers have plenty of compute. They don't have enough compute. Nvidia is paying for a computer that no one wants. They just lost a bunch of money. If you think about it, there's an expected value of that investment. That expected value, it's not zero. It's not 100%. It's somewhere in the middle.
Starting point is 01:09:11 But that is a diminution of Nvidia's profitability. If you actually look at their business holistically, what that is is a price cut. Now, the price cut didn't show up in margins. It didn't show up in what they're offering. But a lot of what Nvidia is doing is how can we maintain our margins, even if the wide view, sort of discounted cash flow, expected value, holistic view of our company, people do discounted cash flows, but are you actually considering all these pieces?
Starting point is 01:09:37 The reality is that moving stuff off the balance sheet, by and large works. But they're doing all these deals to maintain what feels somewhat unnatural. We have seen price cuts. They're just manifesting in these very bizarre sort of ways. Now, in the long run, I think the challenge is their ultimate competitors are the hyperscalers, particularly Google and Amazon. So Google and Amazon aren't just building their own chips, but they're also looking to sell those chips externally.
Starting point is 01:10:03 Google already made a deal to sell like 20% of their TPUs, enthropic. On the last earnings call, Annie Jassy practically confirmed that they'll be selling trinium threes or maybe training four or they'll be selling trangium chips sort of eventually externally, which makes sense. That gives them a long-term buy-in to these companies.
Starting point is 01:10:19 There's a huge amount of R&D that goes in developing chips. They get more leverage on their spend. It all makes sense. And by the way, they're not selling their chips on differentiates. They're selling their chips as commodities. Invita is the one selling a differentiation. People aren't going to Amazon to use Traneum. So they're not cannibalizing the attractiveness of their cloud
Starting point is 01:10:36 by selling Traneum outside. So they're Nvidia's biggest problem. Because what's the number one advantage that the hypers have? Scale. Lower cost of capital. It's a capital fight. They have a lower cost of capital than the Neoclouds do. The neoclods are, they'll buy Nvidia left, right, and center.
Starting point is 01:10:54 And by the way, it also makes a total sense that, why SpaceX's out there. We will always buy Nvidia because they're the best. No, you'll buy Nvidia because they're the most fungible. Invita is true. It is the most fungible. Kuta's moat is dramatically diminished because the models don't care what they run on.
Starting point is 01:11:09 And that's what actually matters, what's built on top of the models. But it still matters. It's still something of a moat. If you want to play the game SpaceXI is doing where we're going to build a lot and rent it out, but reserve the right to pull it back, of course you're going to be on Nvidia
Starting point is 01:11:21 because the easiest way to rent it out is to be on Nvidia. You saw this very early, by the way. You go back to 2024, 2023. Invita starts talking about all these sovereign clouds. They start talking about, they tried to call
Starting point is 01:11:31 these Neotron models. They have this thing in 2024. I remember, it was the first one where it was like the rock star GTC at San Jose and like the huge Coliseum and just no one comes out.
Starting point is 01:11:39 It was a very boring GTC. The old ones used to be Nvidia demonstrating like 50 gazillion things because they're throwing stuff at the wall. They knew they had something with GPUs and they're trying to like find the use case. What's L.M. Showed up.
Starting point is 01:11:50 It's like, oh, we have the use case. But they were coming up with all these enterprise offerings. I can remember what they were called. They're like these modules, basically, that of course they were free,
Starting point is 01:11:58 but they only ran on Nvidia. And you could see what they were doing is they were trying to lock people in. Intel is a good example here. AMD clean them out in hyperscalor sales because the hyperscalers are put in the effort to get stuff working on AMD versus Intel. There are still small differences,
Starting point is 01:12:13 even though they're X86. Because they're buying at such scale, the investment to do it is worth it to get a better chip or lower price or whatever it might be. The part of Intel's business that never floundered was selling to government and selling to enterprises. They don't have the resources of a hyperscaler. They're not buying at that scale.
Starting point is 01:12:31 They're just going to keep buying what they had before. That's why Nvidia talks about selling to sovereign clouds. That's why they talk about selling to enterprises because they want to get in these markets where they're not going to be balancing this chip versus that chip. The hyperscalers have always been the threat to Nvidia for that reason. They're actually bigger.
Starting point is 01:12:49 So you have this issue where the hyperscalers are the threat. The hyperscalers have a better cost of capital. than the other companies, Invita wants to buy them. That's how you get this deal this week. I see this deal as a response. That's why it goes with the Google deal. Google can just issue equity. The shareholders don't love it,
Starting point is 01:13:04 but their monetization capacity is much higher than NVIDIA or NVIDIA's customers are. I think what NVIDIA is hoping for, maybe they wouldn't say this in so many words. But if we get to a world where we actually run out of power, that's probably good for NVIDIA, because in a world where we're told, constrained on power.
Starting point is 01:13:26 Everyone wants the best. We have to get the best efficiency, the best token efficiency. And I think Nvidia is still the most token efficient. So that is a good role for them. Probably the biggest problem for Nvidia over the last couple of years is I think the U.S. has actually brought a lot more power online
Starting point is 01:13:40 than expected. Surprise me, whether it be what Elon did sort of behind the meter, which has been replicated, or West Texas and natural gas, but even like restarting nuclear plants. You love how the U.S. response to these things. It's awesome. It's actually one of the biggest encouraging signals about the U.S.
Starting point is 01:13:58 is I was writing early on, assume this is a bubble, you want there to be a long-term payout. The dot-com, we got fiber in the ground. And by the way, Google's played this game before. Google built its business by buying up dark fiber. They had the killer search engine, but so much of the power what they do is because they bought up all this dark fiber that was basically free after the dot-com era. Our core internet still runs on WorldCom fiber. That was a lasting benefit. The railroads, BNSF is throwing off money that's going to Google from Northern Pacific and Jay Cook selling bonds to retail investors.
Starting point is 01:14:33 You want a bubble that produces something that lasts. And very long, it's like, what's going to last from AI? The GPUs don't last that long. Data centers, okay, fine. But what is it going to be? Power, it has to be power. If we're in a world where this all blows up, we have way too much power, that is an amazing world to be. We've always been energy constraint.
Starting point is 01:14:51 Energy undergirds everything. What would it be like to live in a world of energy abundance? It's hard to even imagine because our minds are so constrained by the fact we've actually always been in energy scarcity. I think we've done an unbelievable job. Power for sure is a constraint. It's going to be a constraint. But I think it has taken longer to become a constraint than anyone expected.
Starting point is 01:15:13 And I wouldn't be surprised if that includes Jensen Huang. I think he thought insufficient power was going to be. Nvidia's moat sooner than it happened. It turns out that the longer we have enough power, the more time Amazon has to make Trinium better, the more time Google has to make TPUs competitive from an inefficiency standpoint. And if we get in a world where, it's a world where those margins seem very hard to sustain. I love hearing your takes on just everything going on. It's the most interesting time I've ever observed in this world that you love so much. So thank you so much for your time. Thank you very much. If you enjoyed this episode, visit colossus.com.
Starting point is 01:15:51 you'll find every episode of this podcast complete with hand-edited transcripts. You can also subscribe to Colossus our quarterly print, digital, and private audio publication featuring in-depth profiles of the founders, investors, and companies that we admire most. Learn more at colossus.com slash subscribe. You know how small advantages compound over time. That's true in investing and just as true in how you run your company. Your spending system is your capital allocation strategy. Ramp makes it smarter by default, better data, better decisions, better economics over time.
Starting point is 01:16:40 how at ramp.com slash invest. As your business grows, Vanta scales with you, automating compliance and giving you a single source of truth for security and risk. Learn more at vanta.com slash invest. The best AI and software companies from open AI to cursor to perplexity, use WorkOS to become enterprise ready overnight, not in months. Visit WorkOS.com to skip the unglamorous infrastructure work and focus on your product. Ridgeline is redefining asset management technology as a true partner,
Starting point is 01:17:07 not just a software vendor. They've helped firms 5X and scale, enabling faster growth, smarter operations, and a competitive edge. Visit Ridgelineapps.com to see what they can unlock for your firm. Every investment firm is unique and generic AI doesn't understand your process. Rogo does. It's an AI platform built specifically for Wall Street, connected to your data, understanding your process, and producing real outputs. Check them out at rogo.a.ai slash invest.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.