Catalyst with Shayle Kann - Who benefits from the AI power bottleneck?

Episode Date: December 4, 2025

The bottleneck holding back AI is a scarcity of power, or so goes the story. That may be true — and plenty of reporting backs it up — but different actors in the space face varying incentives to p...lay up or play down that narrative.  So what incentives are at play, and how do they shape each player's story? In this episode, Shayle talks to Shanu Mathew, senior vice president and portfolio manager-analyst for U.S, sustainable equity at Lazard. Last month on X, he posted a breakdown of the actors — including hyperscalers, chip makers, utilities, and others – and how the different incentives they face shape how they talk about energy and AI. They cover topics like: Hyperscalers’ mixed incentives: the benefits of building their own capacity vs encouraging others to overbuild Why equipment makers, chipmakers, and land developers benefit from talking up the bottleneck to boost demand for their services How independent power producers and gas players benefit from high prices How the power-bottleneck narrative has shifted over time Resources: Latitude Media: ERCOT’s large load queue has nearly quadrupled in a single year   Latitude Media: The power bottleneck is changing data center financing Latitude Media: Early-stage data centers are driving up US power demand forecasts   Credits: Hosted by Shayle Kann. Produced and edited by Daniel Woldorff. Original music and engineering by Sean Marquand. Stephen Lacey is our executive editor.  Catalyst is brought to you by EnergyHub. EnergyHub helps utilities build next-generation virtual power plants that unlock reliable flexibility at every level of the grid. See how EnergyHub helps unlock the power of flexibility at scale, and deliver more value through cross-DER dispatch with their leading Edge DERMS platform, by visiting energyhub.com. Catalyst is brought to you by Bloom Energy. AI data centers can’t wait years for grid power—and with Bloom Energy’s fuel cells, they don’t have to. Bloom Energy delivers affordable, always-on, ultra-reliable onsite power, built for chipmakers, hyperscalers, and data center leaders looking to power their operations at AI speed. Learn more by visiting BloomEnergy.com. Catalyst is supported by Third Way. Third Way’s new PACE study surveyed over 200 clean energy professionals to pinpoint the non-cost barriers delaying clean energy deployment today and offers practical solutions to help get projects over the finish line. Read Third Way's full report, and learn more about their PACE initiative, at ⁠www.thirdway.org/pace⁠.

Transcript
Discussion (0)
Starting point is 00:00:00 A very brief word before we start the show. We've got a survey for listeners of Catalyst and Open Circuit, and we would be so grateful if you could take a few moments to fill it out. As our audience continues to expand, it's an opportunity to understand how and why you listen to our shows, and it helps us continue bringing relevant content on the tech and markets you care about in clean energy. If you fill it out, you'll get a chance to win a $100 gift card from Amazon, and you can find it at latitudemedia.com slash survey, or just click the survey link in the show notes.
Starting point is 00:00:30 Thank you so much. Latitude Media covering the new frontiers of the energy transition. I'm Shale Khan, and this is Catalyst. Who has incentives to talk up the power constraints, and who may not have incentives to do that and maybe take the opposite view where it's actually not as big of a deal, and where might economic incentives actually inform or influence or views more than is appreciated by the market?
Starting point is 00:00:57 Coming up, show me the incentive, and I'll show you the behavior. When utilities need flexible capacity they can count on, they turn to Energy Hub. Energy Hub works with more than 170 utilities, coordinating over 2.5 million devices to manage 3.4 gigawatts of flexibility, built for the moments when utilities can't afford uncertainty. Energy Hub builds and operates virtual power plants that utilities actually stake their grid planning on, coordinating EVs, batteries, thermostats, and more through a single platform built for utility scale. predictive, verifiable, and designed to perform when it counts.
Starting point is 00:01:42 Learn more at Energy Hub.com. Trillions of dollars are flowing into clean and critical infrastructure, but those investments aren't driven by technology alone. They're shaped by markets, by policy, by capital, and by the institutions that connect them. I'm Alfred Johnson, CEO of Crux, and host of a brand new podcast, Critical Capital. Each episode, I talk with people deploying capital,
Starting point is 00:02:04 shaping policy and building the clean economy. tune in as we unpack how progress is actually made. Listen to Critical Capital on Spotify, Apple, or wherever you get your podcasts. Catalyst is supported by Fish Tank PR, an award-winning PR firm focused on climate and energy tech, renewables, and sustainability. Fish Tank is known for generating prominent and effective media coverage for the brands they work with. If you want a PR partner that's thoughtful, shoots straight, and gets results, you'll like Fish Tank PR. To learn more about Fish Tank's approach, visit Fish, tankpr.com. That's F-I-S-C-H-Fish-Tankpr.com.
Starting point is 00:02:44 I'm Shale Khan. I lead the early-stage venture strategy and energy impact partners. Welcome. All right. So this episode is a reminder to always monitor incentives. More specifically, we're talking about the narrative and certainly the reality today around power scarcity as the rate limiter on the growth of AI. Everyone is talking about it. I actually We saw a chart recently that showed the frequency of mentions of the word power or energy on S&P 500 earnings calls over time. And you can imagine the shape of this chart. It had been pretty steady, actually trending slightly downward over time until 2025 when
Starting point is 00:03:21 the line literally went vertical. There's basically no question in my mind that power is actually a bottleneck for data center growth today and perhaps, therefore, for AI growth. That's sort of a truism. But it could also become a comfortable scale. apgoat, depending on where things trend in AI world. And because it's convenient and because it's widely discussed, it's important to think one level below the surface about what you hear from various players in the market. That's why I really loved this recent post on X initially from
Starting point is 00:03:54 Shanoo Matthew that we're discussing today. Shano has been on this pod before to talk about public market stuff because he's a senior vice president and portfolio manager for U.S. Sustainable Equity at Lazard. But he recently went. online and went meticulously through basically every player in the AI slash energy world and laid out their incentives. Should they drum up concern about power shortages? Should they downplay them? Should they capitalize on them? This conversation for me is foundational and should act sort of as a reference and a reminder for me anyway. Anytime I hear something new about energy and AI from one of the major players in the market. So let's go through it. Here's Shanu.
Starting point is 00:04:37 Shano, welcome back. Hey, Shal. Thanks for having me on again. All right. So what got you started thinking about the incentives of all of the different actors involved in data center power Nexus? Like, what sparked the thinking? It's a good question. I feel like everyone has been thinking about this for the last two years, or at least hopefully, so I don't feel as lonely.
Starting point is 00:04:56 But I think the premise for this tweet or thought that I had was that, you know, there's general understanding that there's like, you know, a few ground truths. And one's like AI is a foundational technology that's going to persist in society. Two is we need a lot more energy infrastructure. The magnitude and duration of the cycle is of the debate, but it introduces a duration mismatch where technology is often done on cycles that are one to two years, whereas energy is typically multi-year or even multi-decadeal, depending on the type of asset. And what I was trying to gear in is psychologically, humans or organizations have incentives and incentives drive behaviors, as everyone knows.
Starting point is 00:05:37 And how could we take that lens and apply it to the power debate? Because so many times I have folks coming to me from earnings calls or from events or conferences and saying, I heard this from X party or this from Y party. And that's completely at odds with what they heard from another player down the stack. And so what we were trying to do is a clean sheet exercise was looking up and down the supply stack for AI. Who has incentives to talk up the power constraints? And who may not have incentives to do that and maybe take the opposite. view where it's actually not as big of a deal. And are there economic incentives that may inform or
Starting point is 00:06:10 influence their behaviors? The goal wasn't to call out companies being misleading or anything like that is just namely to acknowledge where might economic incentives actually inform or influence their views more than is appreciated by the market. Yeah, I read the original post. And it was like in some ways it's kind of obvious, but at the same time, it was sort of like a lightning bolt to me. I was like, oh, yeah. Like I hear this stuff constantly as well from every corner. Everybody is talking about, the power bottleneck. And it is important to examine the incentives that drive anybody's behavior or the narrative that anybody's telling about it, not because there isn't a power bottleneck. I think you and I probably agree. Like, there is, for sure. But the magnitude, the duration, and certainly it probably
Starting point is 00:06:52 won't always be one. And so, you know, as this goes through whatever cycle it's going to go through, we need to be paying attention to, like, who is saying what and examining the incentives that drive that. So I thought it was super interesting. And what I wanted to do with you is kind of talk through some of them, what we are hearing from these various parties and then the incentives that they have to say what they are saying or maybe to say what they're not saying. But let's start by categorizing. Like, walk me through at the high level, like, there are a bunch of, there are a couple groupings of actors that have similar incentives. So how do you think about the groupings? Yeah, at a high level, I'll try to keep it simple. But, you know, again, there's various.
Starting point is 00:07:34 degrees of nuance required. But at a high level, you know, let's start with the hyperscalers who are, you know, the folks that are driving a lot of this CAPEX and investment cycle. You know, these are, think of it as like the cloud service providers, the Amazon's, Google's, the, you know, Microsoft's of the world as well as including meta, which is another hypercaler, even though they don't have a legacy cloud business. That drives, you know, investment spend on GPUs. And that's kind of the equipment, like you have the technology hardware, if you will, that includes, you know, GPUs, CPUs, custom silicon offerings. That moves upstream into the supporting equipment, which includes like electrical and cooling
Starting point is 00:08:08 equipment. And then if you kind of go outside the data center, then you start to get into, you know, who supplies that power equipment as well as the overall actual power of the facility. And moving upstream there is like, you know, who actually builds power, which is like utilities, as well as, you know, the labor and the EPCs and the engineering that goes into those types of facilities. So if you kind of just go from who's spending the capital and follow that down the stream, that's a general way to think about some of these bigger pockets.
Starting point is 00:08:33 And so I happen to jump into any of those. All right. So let's start with the hypers. They're obviously at the epicenter of the data center buildout. How do you think about their incentive when they talk about power? Definitely. And I think this is the most interesting from a game theory standpoint. So just the backup for the audience that may not be entirely clear, right?
Starting point is 00:08:51 The hyperscalers have really strong incumbent businesses, you know, oftentimes depending on you're talking about cloud or digital advertising. And they think that the spend on AI allows them. a better product opportunity in the future, such as they can accelerate growth of cloud or advertising offerings, or it will enhance their product offerings, which, you know, would lead to better returns over time. And so you have two options to go out and get more capacity, right? One, they build their own capacity, but then two, they also can go out and procure capacity on the external market. And that comes from neocloders or things that we can get into.
Starting point is 00:09:24 But if you think about it from their perspective, right, building your own capacity is typically what they prefer because they have control and riddle integration when they have the chance to because they have these they have teams internally they have the expertise but when you go back to that core issue right is that i think everyone agrees that we need more energy i think where the uncertainty comes in is how much energy do we need and if you think about it from the perspective of them if i have to go out and build all this infrastructure and this infrastructure is you know beyond the next few years i need to potentially be comfortable underwriting it for the next 1020 that energy is a natural mismatch right where it's like, okay, do I want to be the long-term risk-taker of the assets that I'm underwriting?
Starting point is 00:10:01 I might be comfortable doing that to an extent, but beyond that, do I perhaps let the market figure out the excess capacity? So if you're a hyperscaler, the argument four would be, if I really think that this is like the greatest demand super cycle and I'm severely constrained, I might try to go out and build as much as possible and then procure all the extra. The, you know, the skeptic or the pessimistic view would be they see line of sight into the demand they need and that's all they're going to be comfortable building to, and the rest I'll let the market sort out.
Starting point is 00:10:25 and such. So if you think about that from a power standpoint, my incentive in that scenario would be to talk up power constraints, right? Saying that there's not nearly enough of it. We need to build so much. Like this is the greatest supercycle. Because that will incent speculators, developers, other companies like neoclouds and stuff that want to compete for leases from hypers to go out and build infrastructure. And this one's interesting because Satcha, Nadella, for example, the CEO of Microsoft, kind of told you this actually on a podcast earlier this year. I think it was late last year. He was on dark question. He talked about when he was asked, why not. commit more resources to building more assets. And he ultimately said, well, I'm seeing a lot of activity from developers and co-locators and neoclows.
Starting point is 00:11:03 And I think that I might be able to procure cheap supply in the future. Because who benefits if there is an overbuild or too much build and conditions loosen? That means cheaper leases for them. And that might be cheaper than actually going out and building your own CAP-X. And so that's kind of the game theory one or the other in terms of why build or why might I just wait to see how the chips may fall. They're complicated, I think, because you can see it going either way. On one hand, they clearly have an incentive to say that there is this massive bottleneck in the form of power and power infrastructure, because that, hopefully, from their perspective, incentivizes the world to build more of that stuff so that they can build more data centers.
Starting point is 00:11:41 So they should be shouting from the rooftops. This is the bottleneck. Also, by the way, it's convenient that, you know, it may indeed be true, but it's also convenient for them to be like, the bottleneck is definitely power. That means it's definitely not demand, right, for their services. And again, that may be true today, but they could say that even if it weren't true, and that would be helpful to them. So to me, there's like a very clear incentive for them to say this power bottleneck is huge and insurmountable, and we need to have a mobilization, the likes of which we've never seen in the energy sector to solve it. On the other hand, if they don't solve it, if the world doesn't solve it, I should say,
Starting point is 00:12:20 they are probably better positioned than anybody to snatch up the scary, resource that is the available power supply in the sense that like if they are going to be forced to build their own capacity, which many folks are doing, like who's in a better position to write long lead orders for GVernova turbines than the hyperscalers who have big balance sheets and can afford to pay for it and so on? So like, you know, there is an extent to which if you're scared of the neoc clouds, for example, and you're a hyperscaler, you don't necessarily entirely want the world to solve the power bottle on that for you because it's sort of a source of competitive advantage, at least against that other class. My guess is that between those two
Starting point is 00:12:58 incentives, the one that says, no, we just want the world to solve the power problem because our job is AI. That's probably the one that wins out, but it doesn't seem pure as the driven snow to me, that it's like that clear. You hit it on the head, right? I think it's really, really complex when you pull it back the layers. I think the one thing I would add, right, is that a lot of the motivator for spending all those cap-x is that the, you know, each dollar of capacity not online that could be served, could be serving additional demand is revenue dollars that you're not making. And so that opportunity cost is so great of not having power. So to your point, you may be comfortable, especially on like a, for example, a gigawatt data center being $50 billion,
Starting point is 00:13:38 you know, spending X dollars of millions of dollars procuring deposits for long lead items, turbines, turbines, electrical equipment, switch gears, circuit brakes, etc. Just to make sure that the long lead items are actually settled to build. So if the power is there, that you can go ahead and plug the shells in immediately. But there is, you know, there is an ability to walk away or cancel or, you know, just lose the deposit of contracts as well. But their incentive would be to lock up as much capacity to your point as possible, right, because they want to have the optionality. But I think they also, you know, are playing for like, you know, worst case scenario, you can walk away from a few million dollar deposits. And I'm just speaking hypothetically here versus, you know,
Starting point is 00:14:14 the opportunity cost of building a, you know, multi-billion dollar data center. So there, there is all these, like, different levers they can pull, but it definitely feels that they're keeping optionality. And then just to be clear, too, like they are bringing on a lot of their own capacity, right? Like Amazon brought on 3.8 gigawatts in the last 12 months. So they're going to double their footprint in the next two years. Microsoft said they're going to double as well. And they brought on two gigawatts in the last 12 months. So they are bringing on a ton of capacity as well.
Starting point is 00:14:38 But it is just interesting to see they're also striking deals in neocloud. So, you know, are they, the bull would say that there's nowhere near enough supply and then they're forced to do that. And the bear would say, well, actually, there is want the speculative of risk to go to the neoclouds. and then they can walk away from the contracts if market conditions deteriorate. And I think no one really knows, you know, time will tell. Virtual power plants are becoming a reliable way for utilities to manage capacity. But enrolling devices is just the start. What really matters is confidence, knowing those resources will perform when dispatched
Starting point is 00:15:11 and being able to prove it from the control room to the living room. Energy Hub's platform handles the full picture, from near real-time forecasting, locational dispatch, and the kind of rigorous verification that holds up, when regulators, grid operators, or leadership ask, did it deliver? Easy enrollment creates momentum, proven performance builds trust. That's why more than 170 utilities rely on Energy Hub
Starting point is 00:15:33 to manage over 2.5 million devices delivering 3.4 gigawatts of flexible capacity. See what that looks like at energy hub.com. We're living through a profound economic shift, and energy sits at the center of all of it. Trillions of dollars are flowing into power plants, transmission lines, battery factories, data centers, but the future of energy isn't shaped by technology alone. It's shaped by markets, by policy, by capital, and by the institutions that connect them.
Starting point is 00:16:03 I'm Alfred Johnson, CEO of Crux, the capital platform for the clean economy. Join me for my brand new show, Critical Capital, as I talk with people deploying capital, shaping policy, and building projects. Together, we unpack how risk is priced, how incentives are structured, and how progress is actually made. Listen to Critical Capital Capital on Spotify, Apple, or wherever you get your podcasts. Are you tired of overpaying for big-name PR firms, but not really knowing what they're delivering?
Starting point is 00:16:31 Is your comms team wasting time reviewing lengthy messaging briefs and decks instead of engaging journalists or producing content? Are you wondering why your competitors are getting press and you aren't? Fish Tank PR is an award-winning climate and energy tech, renewables, and sustainability-focused PR firm dedicated to elevating the work of both early stage and established companies. Whether you need to position yourself as a thought leader in between project announcements or translate complex ideas and technologies into tangible, compelling stories that resonate with the media,
Starting point is 00:17:01 fish tank can help. Check out fish tankpr.com. That's f-i-s-ch-fish-tankpr.com. All right, there's another grouping of actors here where my first instinct to say is that it actually is straightforward what their incentives are, which is be, let's just say, OEMs of hardware to data centers. That could be, you know, you're selling equipment inside the data center or maybe not even hardware.
Starting point is 00:17:27 Let's include like EPCs here, for example, as well. Like your job is to provide services or hardware into the build of data centers. My first thought would be everybody there is aligned in their incentive to promote the power scarcity narrative. It's just, it just furthers their, the argument that there is limitless demand. for their services and we're just going to sell out as much as we possibly can. Do you think it's more complex than that? I think that one is pretty straightforward to your point, is that just going back to our prior point about long lead time items and the most constrained, a lot of this is equipment,
Starting point is 00:18:04 as well as the labor. Those are the direct beneficiaries. What do they get? They get higher backlogs. They get longer duration backlogs. They get better pricing in typically industries where you don't get, you basically get minimal pricing or as much as the market will bear. Whereas now you're the pricing power for the first time in generations, right, for certain equipment providers or certain labor producers. So this one is pretty straightforward. And you see that across the earnings, right? You can look at the earnings transcripts of companies like Quanta, like record backlog, Moss Tech, talking about, you know, record activity in their pipeline business as well as really a strong, even clean energy pipeline. You can go to the equipment or you see something like
Starting point is 00:18:40 avertive, which has a backlog that was up 30% organically year over year. You have eaten, which is up 20% backlog organically over year on, you know, like, build up. billion dollar books of business. And so I think there, that's what you'll see to your point, like a very limited narrative on talking down the potential market opportunity. Because if you think about it from their point of view, right, it's just more, more business. To your point, right, equipment, as you are power scarce, you need, you know, the latest and greatest to be the most power efficient per square foot or per IT capacity, per megawatt of IT capacity. And so you always want the latest and greatest and often the highest priced equipment as well as you want to
Starting point is 00:19:16 continually get the latest generation, which requires you. to size up, you know, the load of your equipment. In terms of the labor, if labor is the most constrained element, that means that you'll agree to, you know, perhaps a higher degree of pricing that you normally would, where if conditions were, you know, scarce, you may be forced to just take or, you know, whatever conditions that your buyers are willing to take. So, for example, electricians and plumbers, we're incredibly scarce there right now. I mean, there's market chatter of companies like the hyper-skillers flying out electricians from various parts of the country because they don't have enough labor. So you can imagine for the CPC companies, you know,
Starting point is 00:19:47 pricing power is great because they're the only ones that have labor and can actually go out and deploy these projects. In an environment where that doesn't look as favorable, right, you have to agree to tighter terms, you have less overall projects to work on, you have more than enough supply of labor folks. That means that your market will slow down and your pricing slowdown. So that is a vicious down cycle in terms of what happens on the other side of a growth cycle, right? So this bucket generally, I agree with you, straightforward, talk up the business opportunity.
Starting point is 00:20:13 It generally is positive and supportive for their businesses. All right, so let's talk about another one that I think of as being a little bit more complex then, which is utilities. Like on one hand, utilities are in the same position as everybody else we've discussed, which is basically like, look, if there's a huge bottleneck and power, clearly demand for their services, in this case electrons, is going to be through the roof. They're going to be able to spend more capex. They should get higher earnings. Like, this should be good for utilities. And so, of course, they would want to talk up the power scare city narrative. On the other hand, you know, folks sometimes blame the utilities for the power scarcity challenge.
Starting point is 00:20:49 And like, who is there to solve it but them to some extent? So there's probably some limit to the extent to which they can blame the or place the limitation of AI growth on power scarcity. So I wonder how you think about them and what you've been hearing from them when they talk in public market contexts. Definitely. I think this is one of the positions that is not enviable for a lot of different marketplaces. especially those in the other buckets. Because you bring up a great point where on the one side, generational cap-back cycle, I can get a guaranteed R-O-E on my investments,
Starting point is 00:21:23 and I can put through more investments. The downside is we're increasingly seeing the political issues around rising electricity rates, as well as folks being, you know, against having data centers in their local environment. So I'm like the positive side, it's like a potential business opportunity. On the negative side, I'm getting increasing amounts of pushback. And ultimately, utilities are regulated, right? they need to answer to a public utility commission and get the infrastructure they need approved.
Starting point is 00:21:48 And so now they're in this interesting predicament where they have to solve for all these limitations, right? They have to bring on as much infrastructure as possible, but also do it at the lowest cost or at least the most efficient use of dollars, such that they can't be blamed for inefficiently spending capital or artificially inflating demand. So I think utilities were, you know, the last few quarters, right, you talked, or even probably the last one to two years, it was a lot more. talking about the gigawatt pipeline and in how much they're growing. And you have folks throwing out tens of gigawatts in their pipeline or hundreds of gigawatts. And now it's talking a little bit more about how can we bring these gigawatts on in a very effective way and then ensuring that they have the labor, they have the equipment, they have the ability to execute on this quickly.
Starting point is 00:22:29 Some of these are also in regions, right, where they're impacted by regulatory impacts, such as like Texas with SB6 or PJM just actually went through and they couldn't get to a resolution on what's the, you know, approach to large load tariffs. But you're right. Utilities are conflicted in the sense of that they don't want to miss out on the opportunity, right? Because if they can't bring on the power or they aren't permitted to bring on the power, someone will take their load elsewhere to a different utility. And so they are in the business of problem solving right now. Whereas, you know, it will last one to two years, talk up the opportunity.
Starting point is 00:22:58 Now it's in the realm of can I do this effectively and cost efficiently. How do you think about the, there's another category, which is like the, I'll group together like real estate owners, landowners and then the, the like powered land developers. the developers who are going off and trying to find sites and make them powered and then sell them to a Kolo or a hyperscaler or whoever. What's their incentive? Their incentive is to talk up the constraints as well because it increases the value of the asset of their owning, which is the real estate or the powered land bank. If we think about solving again, if there's a constraint, that means that anything that accelerates you through the constraint is valuable, right? Or increases in value as a constraint gets worse or it remains? And so if I have a powered land bank, that means that I can move a lot faster.
Starting point is 00:23:43 than someone that has just a plot of land that has no interconnection access or anything like that, right? So I can charge a more premium price to developers or Neoclods, etc. Anyone else that would want to be further along up the development cycle. And so they're generally universally talking up the opportunity that they have and the ability to move faster. I'd say, you know, a lot of what we're seeing there is, or at least what we hear from chatter-wise, right, is that like you have transaction values that are much higher than they've ever been, or at least in recent cycles, as folks all are chasing the similar opportunity.
Starting point is 00:24:11 So pretty much any land banks that are power that are near plentiful energy sources, something like in the Northeast with near gas fields or in West Texas, right, you're seeing construction activity be plentiful because people think that it's a much faster path to value realization. So you're seeing that increasingly move up. I think like one tall, tell signal or maybe like a leading indicator that could like start to suggest weaknesses if you start to see real estate offerings that are power that are near, you know, tier one cities or have really good access to.
Starting point is 00:24:41 the energy infrastructure or fiber infrastructure that don't get a premium value or are struggling to sell in the market, that would be an interesting indicator that perhaps the market is strong as possible, but at least right now, the market indicators would suggest that value is considerable because people are still focused on time to power right now. All right. I want to move on to the chip players. They're an interesting one here. Like, if you think about Nvidia's incentives, on one hand, they share the incentives that
Starting point is 00:25:07 most of these other folks do of like, let's play up the power construction. in the hope that it gets solved. On the other hand, they want to be making the argument that we are just going to sell effectively infinite chips forever. Like, we're just going to sell
Starting point is 00:25:22 so, so, so many more GPUs. And if power is a real constraint on that, that's the limiting factor and it's kind of outside their control, then one would think that would affect their perceived value
Starting point is 00:25:36 and their perceived growth, I would say. But my sense is that NVIDIA is talking kind of like the hypers and really the story they're telling is this is a major constraint. I mean, possibly just because it's true, but maybe that's their incentive as well. Yes. And I think they actually, if, again, this is all very hypothetical game theory, but if you are in NVIDIA, right, like you are pitching that you are getting the best performance token per watt is, you know, what Jensen will call it. And basically arguing that they can extract most tokens per watt of useful energy.
Starting point is 00:26:09 And so they're giving you the lowest cost-efficient dollar to the highest level of performance. And so that actually gives them pricing power, right? Because since we are power constrained and that constraint is expected to get worse and power prices rise, the demedia chip holders actually, like the TCO advantage that they have versus less efficient chips actually goes up in that scenario, right? So they actually continue to do better as power remains constrained because it reinforces their pricing power. And so this introduces like the interesting angle where like custom silicon, for example, for those, you know, TPUs or, all the ratings this week, even though they've been in existence for a while, there's arguments that you can find more purposeful chips for certain workloads that require
Starting point is 00:26:48 less energy draws. And if, you know, you weren't as constrained on energy, you might be, or you might be willing to use some of those chips. That actually erodes your pricing power for NVIDIA, right? Because the idea is we're power constrained. I want to get the maximum amount of knowledge for every dollar I spend. And I can do that right now with NVIDIA chips that I may not be able to do with custom silicon chips. And so it actually reinforces their competitive advantage. And so they have a kind of an interesting angle here where to your point, they're going to sell more and more chips and you need power to bring online those chips. But they also probably want the market to remain tight because the longer it's tight, the better their pricing power actually
Starting point is 00:27:20 ends up being. So on balance, basically everybody we've talked about so far, you know, sometimes it's nuanced, but pretty much everybody is incentivized to play up the power bottleneck. And indeed, you know, they are. It is also real, but they are playing it up. Who do you think is on the other side of this equation? Like, who is incentive? to say that power is not such a big bottleneck. Yeah, and I think this part's a little bit more interesting, too, because to your point, I feel like a lot of people benefit if the power constraint remains. And that's just like an okay thing to observe.
Starting point is 00:27:49 It's just facts or facts. But on the other side, you know, I call it a few buckets. And the first that I think is independent power producers. And this might seem counterintuitive, but let me lay out my logic, is if you're an independent power producer, that means that you have a fleet of existing assets today. Those generate money based on selling into electricity markets. And so, you know, the input to their revenue is electricity prices. If we're in scarce conditions and those continue to grow, they generate a really healthy
Starting point is 00:28:17 incremental margin on that, right? Because they're not really building out new assets. You have slightly higher O&M, perhaps, by running your assets harder, but you're just flowing through a high electricity price. That is extremely profitable for them. And that's actually been the thesis for a lot of owning these assets. So these are like the constellations, the talons, the energies of the world. One thing I noticed, it's interesting.
Starting point is 00:28:34 If you look at the last two earnings calls, right, you have the folks like the CEO of constellation talking about the fact that, you know, energy prices actually aren't supportive of building new gas plants, which may or may not be true. And that, you know, there's operative, there's different items that we have or levers to pull like flexibility or, you know, things of like Tylenor's suggestion of, you know, can, you know, throttling workloads when you're at peak conditions to enable more excess capacity to be built and use today. I think that's interesting that the IPPs are talking out of that. Because like, if you game theory it out, it basically is suggesting that perhaps they don't want a lot of new supply of,
Starting point is 00:29:07 of the market, right? Because what does that do? That potentially dampens prices. And I just laid out a path where they can generate a lot more healthier EBIT does if they can, you know, sell into higher or appreciating power price markets. And so I think that's someone that is probably trying to downplay the impact just because their value in the marketplace goes up as long as this constraint, you know, remains. And, you know, another area that I think is a little bit more interesting to, it's almost a derivative of how the market works, but like LNG providers, for example, A lot of them just signed very long-term contracts. And then the basic arbitrage in USL&G is you buy cheap domestic gas and then you sell it to other markets like Asia or Europe to be able to sell into premium markets.
Starting point is 00:29:50 Their model actually gets a little bit into trouble here or the ARB gets less interesting if domestic gas prices rise, right? Because you go from taking a cheap input to a rapidly inflating input that's maybe no longer cheap and that kills your ARB on the other side too. So they're probably incentivized as well to talk down some of the power issues to ensure that, like, the supply goes to them versus going to a local market that they can be served much more profitably as well. So that's like two areas at least that came into mind in terms of the other side of the trade where, you know, perhaps trying to talk down the power constraint issue so that new supply doesn't enter the market and you can have to continue to, you know, raise your prices. That also, you know, another area would be like, just thinking about that
Starting point is 00:30:27 a lot loud now is the natural gas EMPs also as well, right? If everyone just chasing this glut, then you probably bring on more production that actually keeps a lid on your prices when you want prices to be rising. So I think the way to think about this one is, who benefits from a rising input price to their business models? And they're probably in the camp of talking down expectations. Right. That's kind of where, I guess, of those three groups, I think the IPPs and the natural gas ENP companies are kind of aligned, right? They both benefit from high prices of their commodity, so they don't want a ton of new capacity to get built. That's just good for them. The LNG folks are on the other side of that trade, right? They're buying.
Starting point is 00:31:05 the natural gas that gets produced and selling into another market. So they don't want prices to rise. They do want more production. They want as much drilling as possible, right? And so then the R gets bigger. So for them, again, this is complicated game theory. But like, but, you know, with the LNG players, you'd think they'd want to say, oh, it's a, you know, they should be telling you that we're talking about the power
Starting point is 00:31:27 bottleneck. It's actually a natural gas bottle neck. We need to be drilling so, so much more. And if that happens, then it keeps their prices low and keeps their R big. So that has to get a really interesting point though, right? Because, like, yes, they want natural gas production to be high because that means low. But they also don't want local sources of demand to accelerate because that means you have a lot more willing buyers, in this case, gas power plants, right?
Starting point is 00:31:50 So if a bunch of CCTs go up, then all of a sudden you have a local buyer that's willing to pay a premium price that raises the input price for them. They want to buy cheap net gas, but all of a sudden, if you have local demand that goes, incredibly higher, you're competing with another source. And, you know, a producer might be able to go to somewhere else versus. you and that impacts your ability to serve your contracts on a longer-term time horizon. So it is complicated. As you start to peel the layers of the onion back, you start to see all this, like, you know,
Starting point is 00:32:16 there is general incentives like for and against it within all these pockets, but it is just like it's hard to parse out without going through these exercises and say like, who benefits in what market. And that's the rule or the role that investors play, right, is we're generally trying to underwrite the range of scenarios, good, bad, neutral, and then probability wait, what's most likely to happen. Maybe taking a step back, I guess, just to wrap it up, it seems clear to me that this narrative, this general narrative of the power bottleneck has taken hold substantially over the past.
Starting point is 00:32:51 I don't know, you tell me, but 12, 18 months, something like that is when it's really taken hold. How would you describe the sentiment around that narrative today? And, like, have you seen it changing at all? Is it is the fervor growing right now? Like, where are we in the trajectory of people talking about this problem? Yeah, I'd characterize it at a high level. The last one of two years was really just getting our heads around the issue. What's the source of this demand?
Starting point is 00:33:17 How strong is it? And that's largely driven by GPUs and say, all right, we need the latest and greatest to train our models, scaling loss hold. That means we can justify more investment and we'll continue to, you know, perpetuate the cycle. I think what it turned into recently now is folks are getting into that R.O.C question is all the dollars that we're spending, you know, which is on the order of half a trillion dollars now a year, is that generating positive R.OIC?
Starting point is 00:33:38 And that question mandates, like, are they generating revenue and dollars from it? And so that moves you upstream to, okay, like, are folks actually doing that? And then that leads to that area where there's the question of, if I had more supply, could I generate more dollars? And would the RIC on each of those dollars be positive? And that's the part that we're right now is what is the real constraint here? If you talk to a lot of the providers that sell AI solutions, it's because we don't have enough powered shells or
Starting point is 00:34:03 power to get more supply online and that'd be able to generate more dollars. But I think that's like the real question is like if said another way, if we had unlimited power, unlimited constraints now that were all solved, would the AI trajectory still be as strong as it is today? And that's the question that we're getting into is like, which constraints of these are solvable? And if those constraints are relieved, does the cycle, you know, perpetuate positive for that player or negative? And I think right now as folks are trying to answer that question. And that's why you see kind of the gyrations that you do in the market every other day, right? where, for example, a lot of the AI power trade or AI plumbing trade,
Starting point is 00:34:37 wherever you want to call for the physical infrastructure, has done tremendously well for the last few years. I think folks oftentimes think about it as just Navidia, but the names, like a lot of the companies that we talked about earlier, like the EMPs, the MEPs, the MEP subcontractors, the networking and optical connectivity equipment, the switch gears, the circuit breakers, the transformers, the chillers, all these people have benefited.
Starting point is 00:34:58 And so now it's about the durability of those constraints, because that's ultimately what you're trading on now is like the, two, three, four years outward, can they actually grow into what the valuations have grown to? All right, Johnny, this was fun. Thank you for helping me think through all the complicated incentives that are out there, mainly to just talk about how big a problem power is. But we'll have you back on when things take a turn, as they inevitably will. Yeah, it'll be fun to tag along, and we'll see what happens here, and the narratives are always constantly changing, and the market's giving new opportunities to new narratives.
Starting point is 00:35:28 So let's circle back here in a year or two and see where we landed. Sean O Matthew is a senior vice president and portfolio manager for U.S. Sustainable Equity at Lazard. This show is a production of Latitude Media. You can head over to latitudemedia.com for links to today's topics. Latitude is supported by Prelude Ventures. This episode is produced by Daniel Waldorf, mixing and theme song by Sean Marquand. Stephen Lacey is our executive editor. I'm Shale Khan, and this is Catalyst.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.