Better Offline - Why AI Has No ROI with Paul Kedrosky

Episode Date: June 3, 2026

In this week’s Better Offline, Ed Zitron is joined by economist Paul Kedrosky to talk about why nobody can find the ROI of AI, why there won’t be a Dot Com Bubble-style recovery for AI dat...a centers, and how Google’s $80bn equity sale shows we’re at the top.https://paulkedrosky.com/ The Nick, Dick and Paul Show: https://www.youtube.com/channel/UCFbDiETo29GTIjg6Lk4imig Save $10 off a year of my premium newsletter: https://edzitronswheresyouredatghostio.outpost.pub/public/promo-subscription/gzqwkv54e1 - I’d be so grateful! YOU CAN NOW BUY BETTER OFFLINE MERCH! Go to https://cottonbureau.com/people/better-offline and use code FREE99 for free shipping on orders of $99 or more. Buy our new “FUCK DATA CENTERS” shirts today! --- LINKS: https://www.tinyurl.com/betterofflinelinks Newsletter: https://www.wheresyoured.at/ Reddit: https://www.reddit.com/r/BetterOffline/  Discord: chat.wheresyoured.at Ed's Socials: https://twitter.com/edzitron https://www.instagram.com/edzitron https://bsky.app/profile/edzitron.com https://www.threads.net/@edzitron Email Me: ez@betteroffline.comSee omnystudio.com/listener for privacy information.

Transcript
Discussion (0)
Starting point is 00:00:00 This is an IHeart podcast. Guaranteed Human. Run a business and not thinking about podcasting. Think again. More Americans listen to podcasts than adds supported streaming music from Spotify and Pandora. And as the number one podcaster, IHearts twice as large as the next two combined.
Starting point is 00:00:15 Learn how podcasting can help your business. Call 844-844-I-Hart. Joy is essential and it's also elusive. But now there's a new and exciting way to start your journey toward a more joyful existence. Joy 101. It's a new podcast hosted by me, Hoda Kotby. If you're craving inspiration to maximize your joy,
Starting point is 00:00:36 tune into these candid, uplifting, and moving on-air chats. Open your free IHeart Radio app. Search Joy 101 and listen now. Joy 101 with Hoda Kotby is presented by CVS. Hey, this is Chuck from Stuff You Should Know, and we're submitting our most sciencey episodes for your peer review with our new Stuff You Should Know doing science playlist.
Starting point is 00:00:59 Out now. You want to know about Occam's razor? Simplest explanation is usually the right one? We got you covered. Wondered what chaos theory is ever since the first time you saw Jurassic Park. Well, come on down. So distill a nice pot of tea, everybody, turn down the gas on your Bunsen burner,
Starting point is 00:01:13 and slip into your most comfortable lab coat and listen to the stuff you should know doing science playlist on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. June is Black Music Month, and on the Drink Chams podcast, we're speaking with the hottest names in the culture, like Sway Lee.
Starting point is 00:01:32 Do you realize how legendary you are? I appreciate that. I'd be seeing it, but I'm like, man, I still got, like, so much more to do. Like, Prince, he dropped, like, 30 albums. We dropped, like, five right now. Like, that's the rate we gotta be going. Yeah, that's a good attitude.
Starting point is 00:01:45 No matter the era, Drink Chams brings you the biggest names and the most unfiltered conversations. Listen to Drink Chams from the Black Effect Podcast Network on the IHeart Radio app, Apple Podcasts, or wherever you get your podcast. AllZone Media. Greetums. I'm Ed Zittron and this is Better Offline.
Starting point is 00:02:15 Better Offline. Today we are joined by the mighty economist Paul Kodroski. Paul, thank you for joining me. Hey Ed, how's it going? It's going great. Everyone's deeply upset because this week and the last week, everyone has been saying, huh, does AI have a return on investment? And it's, I've really been enjoying it because it's like, watching the dinosaurs look up and see the meteor. They're just like, what do you, what do you mean?
Starting point is 00:02:46 What do you mean this costs money? I don't know if you've seen the GitHub co-pilot stuff. Yeah, I actually put out a thing on it yesterday. Oh, sorry, Paul, terribly rude to me. You know me. I've got all sorts of crap on, so I haven't read it yet. But I'm excited to talk about this. I'm really excited.
Starting point is 00:03:05 It's really, and not only that, I mean, I'll sort of triangulate with three different things that touched on different aspects of this at the same time. One was obviously the GitHub co-pilot study which we can get into as deeply as you want.
Starting point is 00:03:18 There was also a piece that came out in part from the Peterson Institute for International Economics. Yesterday or the day before Jack Cook or Clark at Anthropics set it around
Starting point is 00:03:30 who is obviously one of the co-founders there and it's called Where is AI and GDP statistics? And then of course there was the debacle which I saw anonymous, someone that had anonymously disclosed that they had spent almost a half of $500 million because they had uncapped token expenses and discovered they'd sort of blown their credit cards.
Starting point is 00:03:51 Anyways, yes, there's a bunch of things there's a bunch of things. Well, let's start with the GitHub thing. So for the uninitiated, GitHub copilot, AI coding tool from Microsoft, a couple weeks ago, I broke the story, of course, that they were moving their users from a premium request model to a token-based model. So think of it like this with the listeners. if you, every time you use the cab service, you could just say, drive me from the upper west side to Red Hook. And that would just, that would be one drive and you get a certain amount of drives a month. And then suddenly the beginning of June, they turned to you and say, yeah, you've got to pay by the mile.
Starting point is 00:04:24 And you suddenly realize you've been taking 95 mile trips. You've been asking to drive from New Jersey to Maryland, which I realize is further than 95 miles. Don't, not a geographer, right? But nevertheless, on the GitHub co-pilot subreddit, people have just been posting. What the fuck? What do you mean? My whole balance is gone in three prompts. What do you mean by that?
Starting point is 00:04:47 It's, yeah, and this is part of the problem, right? Is this been, you can get all econo-wunky about this stuff, about the merits of metered pricing on a per-token basis versus lump sum pricing. But in a sense, you can think of this was the early pricing in terms of how tokens were metered out had two really important characteristics. one is they were grotesquely subsidized. You weren't actually seeing the real all-in cost
Starting point is 00:05:13 with respect to the loaded cost of actually providing you with those tokens. And then as a kind of don't pay a cent event up there with Costco, it was being bundled. So you had a second layer of masking with respect to what tokens were actually costing. And so once it becomes unsubsidized and unbundled, then you see your ass is dangling
Starting point is 00:05:36 in the breeze of real token pricing. I think it's funny as well because for years, people have been saying to be, that's not happening. They're not subsidizing it. It's different. It's just, it's like the Costco model, for example. People are like, oh yeah, well, they're making money other ways. It's like, no, they're not. They're just selling, in Microsoft's case, they were like, we're going to sell you $1,000 for $39. Right. What do you think? Do you think that's good? Do you like that? It's a lovely, it's a lovely come on. It brings people in. It's like the hot dogs in Costco.
Starting point is 00:06:09 except Costco has other things on which they make a boatload of money. Except the hot dogs cost like $7,000 a packet. It's just, I think it's quite deceitful, personally. I think it's because these, on one hand, we can make fun of these people. I will continue to do so. It's funny. But when you look at them, it is also quite depressing because they were intentionally misled. Like, these people had no idea.
Starting point is 00:06:35 It's not like these subsidized subscriptions like, hey, if you use them, this many tokens while paying for them it would cost this much until they made the change. Microsoft released the calculator, it allowed you to see that, but only once they'd announced it. So you have millions, I would say the vast majority of people that interact with AI who have no idea what it costs, literally none. Right. And which is made worse by some of the early overexcitement, especially among large corporations
Starting point is 00:07:04 that made the mistake of creating leaderboards. Oh my God, hell yeah. Right? So this is, we got into this token maxing phenomenon. So if you're inside of, which is obviously the idea that the more tokens you use, the better you do in your job review because look at you, you're all AI. The problem, of course, is this is a little bit like the Saudis handing out Humvees to everyone in America. Yes. Wow, this is awesome.
Starting point is 00:07:29 I love having a Humvee and then you have to fill it up. And so for a little while, it was like we were subsidizing these gross. protestically, profligate users of tokens, just like profligate users of gasoline, and then all of a sudden the bill comes to do and you say, wait a minute, this thing's a pig. It's a lot of gas.
Starting point is 00:07:48 I don't want to drive it for groceries anymore. And the exact same phenomenon is true with respect to being, again, exposed to having your ass hanging in the breeze of real token prices. Well, the other thing is as well, is I just put out our newsletter about this, you look at how these people are freaking out,
Starting point is 00:08:04 and you also realize they have no idea what AI costs. It's not just like, wow, this is a lot of money. It's they're not even thinking in terms of cost. It's not like they know, I don't know, they're refactoring something. They don't know how much that cost. They don't know how much anything costs. So it's not like they can smoothly transition to token-based billing because they don't, they don't know. They have no idea. No, and this is, this is the deep, this is the deep structural problem, because they were brought in through the side door of bundled pricing. And now, that's becoming unbundled.
Starting point is 00:08:39 And of course, that also is reflected in what we're told. I think the Wall Street Journal and others have written about this, and it would be interesting we see the final S-1s for some of the upcoming IPOs, that there is this attempt to try and even mask it in the financial filings where you get into this phenomenon of what we used to call earnings before bad stuff. And so what they're trying to do is hide the costs of training the models
Starting point is 00:09:05 and saying that's not actually. an operating cost, that's a capital cost. We shouldn't have to show that as a function of what actually the margins are on producing tokens. And that is, of course, a cheat, right? Because if that's true, then you should be able to capitalize these things and expense them for
Starting point is 00:09:21 a long period of time. And we know full well that these are actually operating costs because they tell us that every 18 months we're launching a new major model. These things are not capitalized. These are operating expenses that should be treated accordingly with respect to the actual cost of token production. So there's a multifaceted
Starting point is 00:09:37 game going on here, both in terms of how it's being presented to users, but also in terms of how they're trying to sell it in the context of the upcoming S-1s for the Anthropic and OpenAI IPO filings. Well, what's really funny as well about the idea of capitalizing training costs is they're never going away because it's not just pre-training, shoving the stuff in the models. They have to constantly tweak them because of model draft. Right, which from a classic my years ago accounting, whenever you have a regular and predictable cost
Starting point is 00:10:08 that you have to incur to continue operating your business that is no longer a capital cost that's an expensive item that should be expensive as such so you get into as I said back in the dark days of dot com and even the telecom boom you get into this problem of earnings before bad stuff where they want to exclude all of the things that make the numbers look bad
Starting point is 00:10:27 and then of course on the other side you have this run rate problem where we continually hear about what the run rates are at these companies and the window with respect to the run rate, could be the last 15 minutes, for all you know, right? A run rate is just, you extrapolate whatever is most convenient for you.
Starting point is 00:10:43 So it's a problem on both sides. Well, yeah, actually, that's it. I love talking about run rate. Everyone who listens to this show knows I'm a real run rate pig. Because, like, anthrop... I've reached out to both Open AI and Anthropic and said, hey, how do you define this number? And they will not respond.
Starting point is 00:11:00 They will not... They are very unfair to me, very nasty. They will not respond probably, probably because from what the information is reported, I don't know how OpenAI does it, but Anthropic not only includes the amounts of money that Amazon and Google make in their revenues. That's right.
Starting point is 00:11:18 When they resell the most. But they also, they do 13 times the last month's API spend and 12 times the current day's subscribers. So it's just there's so many ways. Also, so tokens spend. just organizational token spent, that's not a recurring cost. That's just, you can kind of, I guess, think, well, maybe people are spending this today. But that person who spent half a billion dollars, that company spent half a billion dollars on AI, right?
Starting point is 00:11:52 Yeah, yeah. That's not happening again. That person is, that you're not going to get one half a billion dollar Mr. Bean every single month. Right. as someone just goofily. I also genuine. Like, I know the report of Madison Mills. She's respectable report.
Starting point is 00:12:09 She's very, she's, she's good. She is well-sourced. It's just like, I hope Anthropic didn't include that 500 million in their annualized revenue. Yeah. I'm looking forward to it showing up in a public company filing because it almost inevitably will. This is going to be somebody one-time item, right?
Starting point is 00:12:30 And then- You think that that will, though? Oh, absolutely. I mean, half a billion, it's material for almost anyone. So my guess is it's going to show up somewhere. It'll be really interesting to see. And my guess is at that scale, it's a public company. So my guess is we will see that. We will know where that actually happened. And so it's going to be very entertaining. But this is the deep structural problem. And it gets worse, of course, because once you unbundled token pricing, and then you're looking at the actual year-over-year decline in quality-adjusting. token pricing, and you see the inherent deflationary curve underneath the hood. Now let's connect that to how all of these data centers that are producing these deflating tokens are being constructed, an increasing fraction of that. Can you elaborate what you mean by the deflating token? I'm not sure I understand.
Starting point is 00:13:22 So over the last, since 2022, on an annualized basis, on a performant basis, so ignoring what this continual jump to the frontier. If you imagine sort of on a comparable token basis cross models across the period, token prices have fallen anywhere from 70 to 90% year over year, consistently back to 2021. Right, but they're burning more tokens in the process. Right, right, right. But let's put that aside for one second.
Starting point is 00:13:53 Think about it. Turn it the other way around. So if I'm now, my business is now, I'm unbundling and I'm selling tokens, and that's the way customers, you're telling my customers to think about it. So now they're looking out and they start to see what happening with token prices and if I go back one generation,
Starting point is 00:14:11 maybe those prices are cheaper. Now we have this classic financial problem of what's called a duration mismatch, right? So I have debt funding the data centers that's 10 to 15 years duration and longer, which is predicated on fixed payments, but being made on the basis of tokens where you're telling the customer,
Starting point is 00:14:30 to control your costs, you may want to look back in time and use an older model. So I'm paying for a fixed cost with a deflating commodity. Right. This we know from the over and over and over again, these duration mismatches, especially duration mismatches that are built on top of debt and a deflating commodity are absolutely atomic with respect to causing a blow up in people's obligations with respect to these kinds of duration. mismatch problem. So there's a deep structural issue that this will expose and people haven't quite realized it yet. So you're saying that as the token costs get cheaper and everyone's being
Starting point is 00:15:10 encouraged to use this less or more thoughtfully, that's happening, but they're building the data centers as if number will only ever go up and they'll only ever use the tokens. That's exactly right. And so you've got this, wonderful. Again, the term of art. You've got a duration mismatch on top of a deflating commodity that can only end very, very badly. And it was masked because for a while you weren't exposed directly to that. You were just paying a straight-up subscription, almost like Amazon Prime. And of course, that doesn't work because Amazon Prime's costs across the border declining, whereas costs are increasing at the frontier declining in the back catalog, if you will, of tokens. And that's the thing with like Amazon Prime, for example,
Starting point is 00:15:51 yes, they have found, like Amazon or not like Amazon. People, I know many listeners don't love them. I agree. But it's like Amazon Prime. They fix those costs by building their own logistics network. And they found ways to, they had, I don't know, ways to make that cheaper. No one has that in AI. No one. Like it's just, we have three, four years in and everyone's like, oh, we'll do A6. No, we won't.
Starting point is 00:16:15 That didn't work. Right. We're like two or three generations of Petraeum, Infraentia, TPUs. Still not profitable. We know. Right. We know. We would know.
Starting point is 00:16:27 Yes, we would. We would know. But I think, and of course the problem is that if you look at, I was just looking at some data yesterday with respect to how small language models are increasingly closing the gap with large language models, which is causing training cycles on large language models to have to accelerate, become more expensive, throw more compute at it, more reinforcement learning. The costs are not, are particularly not declining. They're actually increasing sharply at the frontier because they're essentially being chased like the rabbits and, you know, like the rabbits. like Wiley Coyote and the Roadrunner. And so they're being chased into this very costly corner as a result. And that's a classic commoditization problem. If you go back to the 19, I don't know, late 19th century, a very similar thing happened in railroads as people were racing desperately
Starting point is 00:17:15 to try and find a way to build a corner and control themselves so that they could compete with all of these other upstart railroads. And of course, all that really happened was Cappex exploded, margins went to shit, and multiple railroads failed. led to the crash of what, 1873, 1893, and arguably was a cause in the Great Depression. So you're playing out this exact same game because you're sitting in this high-cap-x world that's increasingly funded by debt and built on top of this duration mismatch with token prices being now exposed and raw in front of people.
Starting point is 00:17:50 Happy Pride Month, Toronto. Pride is an opportunity for you to create your own space, to celebrate your existence. Iheart Radio is proud to be. an official sponsor of Pride Toronto Festival, and we won't stop. Celebrate Pride. Turn up the love and listen to IHeart Pride Canada. Your 24-7 radio stream and the only playlist you need for your Toronto Pride celebrations. Pride is so great because it gives a whole bunch of people this visibility that they've never had before.
Starting point is 00:18:23 We have a ton to celebrate Toronto. Happy Pride. IHeart Radio. Run a business and not thinking about podcasting, think again. More Americans listen to podcasts than ad-supported streaming. music from Spotify and Pandora. And as the number one podcaster, IHearts twice as large as the next two combined. So whatever your customers listen to, they'll hear your message. Plus, only IHeart can extend your message to audiences across broadcast radio.
Starting point is 00:18:49 Think podcasting can help your business. Think IHeart. Streaming, radio, and podcasting. Let us show you at iHeartadvertising.com. That's IHeartadvertising.com. Hey, I'm Hoda Kotby, host of the podcast, Joy 101 with Hoda Kotby. Together, we're going to have meaningful conversations with the world's most fascinating people. Like when actress Olivia Munn shared how she overcame fierce health challenges.
Starting point is 00:19:13 I've gone through breast cancer and then helped my mother through breast cancer, and that was more difficult. There's a lot of people who understand postpartner depression. I was not prepared for postpartum anxiety. Listen to Joy 101 with Hoda Kotby on the IHeartRadio app, Apple Podcasts, or wherever you get your podcasts. A decade ago, the ethanol kingpin of Iowa became the king of corn in Brazil. So we met with a lot of larger farmers,
Starting point is 00:19:37 went from Bahia to Tokatines to Madagroso. And he brought a team of executives. They were going to help the country get in on a gold rush. Carbon and its derivatives are going to be really the next great commodity that the globe's going to trade. But back home in Iowa, trouble was brewing.
Starting point is 00:19:54 If you live in Iowa, your land, your water, and your voice could all be at risk thanks to a man named Bruce Rastetter. Now, people are questioning if his class Climate solutions have anything to do with climate at all. You got to give Bruce and the guy's credit. They're Republicans. They don't give a bit of money. It's now.
Starting point is 00:20:11 On this season of drilled, Carbon Cowboys, the story of how the ethanol kingpin of Iowa became the king of corn in Brazil and what it tells us about the limits of technology and markets to solve the climate crisis. Listen on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. And the other thing is as well is people, just literally, in my piece today. People make this point about, oh, it's like the dot-com bubble in that we will, we will simply just, we'll reuse these things in the future. Like, we'll just pick these up. And it's, I read, I hear this from very smart people, are people who are not like,
Starting point is 00:20:53 beguiled by the AI industry. But it's like, okay, let's talk about what happened to the dot-com bubble. So when it exploded, you had those, some microsystems, the ultra, whatever it was, I forget. Forty-five-grinders. but that one server could run an entire company. You could run everything on it. Databases, messy CRMs, they had like, did they have on-prem lotus notes? Anyway, you had those things, but you could run that. And you could probably run that in a garage.
Starting point is 00:21:21 You might need to use the washing machines plug, but you could do it. And those things were 50 grand, so you'd probably get them at, what, 20, 30 large. Yeah. Okay, great. What happens when the AI bubble bursts? You can't just plug it in an AIG? A B200 GPU is about 50 grand. It requires about, I think, as I looked this up very recently, it's like 1,500, 1,500
Starting point is 00:21:44 watts for a Sun Microsystem server, about the same for a single B200, which will require bespoke cooling, a server, hardware, RAM, all of this other stuff. And then you'll find out that you can't do jack shit with a single GPU. Yeah, you're going to be a huge source of disappointment when you power it up, your neighborhood lights all blink out and you can't still can't do anything. So yeah. I just don't think you can actually use it. But that's, but that's, but that's, I call this, I was just, I got into this with someone recently who was making a similar, and I call it faith-based argumentation. It's this kind of, you know, quasi-religious orthodoxy that requires you to believe
Starting point is 00:22:22 the following five things. You know, they always create more jobs and they destroy. We can always reuse assets after the fact. And I'm one of the things I always point to people is that almost half of U.S. railroad lines built during the boom years in the late 19th century were eventually abandoned. And did they find reuse? They absolutely did. It only took 100 years and now they're mountain biking trails. Jesus, Christ.
Starting point is 00:22:44 Let's wait around for that. Those were railroads. They were railroads that didn't require electrification, I guess. So they were much more stable as assets, right? They didn't have the problems that GPUs and data centers do were not just the huge power and cooling requirements, but also the inherent the trajectory of the underlying technology
Starting point is 00:23:07 where it changes quickly enough that, you know, is a 20-year-old, you know, Blackwell have any use to anyone other than as a paperweight. Of course, the answer is probably not. Whereas a railroad... They are pretty heavy. They are extremely heavy. I actually was messing around with one recently.
Starting point is 00:23:22 And so, yeah, and so this is the problem. And again, it's this sort of naive argumentation, not to mention the old Keynes line, that it may be, it may be, great in the long run, but in the long run we're also all dead. So it really depends on your time horizon. And I find it honestly in the face of the kinds of consequential changes in the US economy, I find it a very glib style of argumentation where you're essentially patting people on the head and saying, don't worry your pretty little head, this will all work out because it always has.
Starting point is 00:23:50 And they're arguing from a data set sample size of five, which we wouldn't launch a, we wouldn't launch a drug on that basis. Also, I think it helps them rationalize bad behavior. Because if you say, okay, it worked, the one that actually upsets me is, well, the dot-com bubble worked out. It's like, yeah, the stock market lost 80% of its value, hundreds of thousands of people lost their jobs, people lost everything in some cases. And at the end, it's like, okay, that was also completely different, but you're being quite glib about the first part. But it's also, yeah, it's okay that people burn a lot of money for basically no reason. and it also allows you to not think about bad stuff.
Starting point is 00:24:34 It allows you to do the Andrisonian argument that there's no point in introspection. It's just a really bad idea. Right. Well, I think about these things that they'll all sort itself out. But I also think there's a deeper issue. And we may have talked about this before,
Starting point is 00:24:47 but the idea, a lot of people treat as an article of faith, Carlotta Perez's book, Technological Revolutions and Financial Capital, and one of the things that they, quote, take away from that, which I'm not convinced they do. I think they only look at the pictures. But anyways, one of the things they take away from her book and her work and other people's work with respect to these violent technological
Starting point is 00:25:05 revolutions is the idea that it really doesn't matter because it always works out. Here's the difference, though. In past episodes, we didn't tell ourselves that. So there's an element of reflexivity going on here because once you know the plot and you act as if the plot is somehow F-E-E-E-E-A, it's a law of physics, then the whole game changes because now you're acting as if it doesn't matter what I do because you think it doesn't matter what you do because you've got this idea in your head as an article of faith that it always works out. That wasn't true historically. No one in building out the railroads, rural electrification,
Starting point is 00:25:40 the fiber bubble, no one was telling themselves in the time this always works out. That was not part of the playbook. The idea that we now tell ourselves these things is such a deep structural change in terms of the way this stuff happens that it amazes me that no one understands it. Well, I think it's just, it's the rationalizing and it's also, it gives you a way of avoiding thinking about true structural issues. Right. It's thumb-sucking, I always call it. It's really a kind of thing.
Starting point is 00:26:10 It gives you comfort. It allows you to be like, well, Google isn't stupid for raising $80 billion in equity sales. Yeah, Google, the largest companies in the world couldn't just destroy their companies. by wasting all their money. It's like, yeah, go and type something into Google search. Go and type anything into Google. And tell me if this looks like a company running a good business or a good product or just a company throwing shit at the wall and being like,
Starting point is 00:26:40 this works, right? You know, fuck it. And we have so many examples of companies that were lauded during the run-up prior episodes for being really understanding the way the world works and being a real pathbreaker and so on. on baiting whether it was the global financial crisis and the banks at that time and my friend Jim Kramer's unfortunately timed comments
Starting point is 00:27:03 about Bear Stearns and all that kind of stuff because people are so backwards looking and so extrapolative with respect to the way they look at things, they just can't see the discontinuity. The obvious discontinuities ahead, and so they extrapolate and extrapolate and then they eventually extrapolate their way right off a cliff. And I see a lot of that in this going around.
Starting point is 00:27:24 And I don't know if you saw it, But there was a paper came out, as a good example of this, there was a paper came out yesterday, and this goes to the heart of the token pricing problem, and it came out, I think it was on SSRN or Amber. Yeah, the National Bureau of Economic Research. And so the paper basically was about how there's been, as you and I both know,
Starting point is 00:27:42 there's been this explosion in the number of GitHub commits and repositories and commits within them, and it's up something like 200% over the last 18 months, largely driven by harnesses and everything and all of these coding tools. tools. And of course, then they looked at the other side of it. This is this profligate use of tokens. What has it led to? Because producing more stuff that shows up on GitHub is just their need immediate variable.
Starting point is 00:28:05 Nobody in the real economy cares other than maybe Microsoft. And even they probably wish there was probably a little less activity on GitHub. And so they showed that this was just, they used iOS apps, Android apps, and one other category. Anyways, and they showed that the number of reviews per app has declined sharply as the number of repositories. commits has gone up. So essentially what we're seeing, and this is the thing that I think is really important, is these can be very effective if wildly subsidized productivity tools for coders, but the end economic result is mostly the production of sort of slop everything, slop apps, slop content, slop. And so you're flooding and commoditizing these markets
Starting point is 00:28:46 that are becoming both saturated and declining margins. And this is an incredibly important distinction that just because it's helping you produce more stuff, it doesn't mean that in the broader economy, its ability to absorb it is increased, nor does it care. And that's what this paper shows. And I think the idea that we're doing all of this work and what's increasingly become expensive work using tokens to produce things and makes coders very happy having, you know, things running in agentic loops. But the broader economy, you know, doesn't give a fuck. And by any chance did you read semi-analysis's AI dark output? I did, yes.
Starting point is 00:29:26 Which is one of the funniest things I have read in my life. So for the listeners, you'll have a link to this. But it's basically, yeah, AI is so, AI output will be real before it is measurable. We can capture token spend and we can capture jobs lost. But unless AI's output is sold at a visible price, only token spend is captured in GDP. By which they mean, we don't actually. measure whether something is good. We just measure whether something.
Starting point is 00:29:53 It's actually so... This is the shit a teenager would say when lying about having a girlfriend. It's just voodoo teen economics. Yeah, it really is. And again, it goes to that National Bureau of Economic Research paper. It's exactly the same thing. I was mentioning at the top,
Starting point is 00:30:13 there is this tremendous... I'll send you the link if you haven't seen it. And it's called, Where is AI and GDP statistics? filling the measurement gap came out from a couple of days ago. And they argued that essentially AI, quality adjusted AI output is up more than 2,000% per year. They come up with estimates of like $250, $300 billion on top of the... But they essentially come to the conclusion that this is all true as long as you accept our redefinition of GDP. And of course...
Starting point is 00:30:43 Ah. Right. Right. Right. If you allow me to redefine your... GDP, I could present you with some tremendous numbers. And the entire paper is absolutely fascinating
Starting point is 00:30:54 as an example of what's often called motivated reasoning. I need to believe this. Therefore, I construct an argument to allow me to continue to believe it in the way I get there is by redefining a variable that's already very squishy in the first place. Let's not pretend that
Starting point is 00:31:10 measuring GDP is much easier than like, I don't know, measuring muons in a cloud chamber or something. It's still very hard. And we're about to, you're trying to make it harder to justify something, that's just not defensible. And the AI dark output one is great because they, substitution dark output is work that was previously done by humans and is now done by AI. In our dark output monitor,
Starting point is 00:31:33 we have identified roughly one and a half trillion dollars in tasks that current AI could substantially augment or automate, to which I say, why hasn't it done it? Right. It's that, this is the AI thing, though, because specifically with AI. With other things, productivity is hard to measure.
Starting point is 00:31:51 It's hard to measure outputs with workers in knowledge work especially. It's doable, but it's not like a linear path, except you're selling a tool that can theoretically do anything.
Starting point is 00:32:04 If this did what they said it did, we would have gunfights in the street. We would have the destruction of most knowledge work, and it would be happening a year ago. It would be half happening. year ago, happening fully today, we would have the destruction of law firms. We'd have the destruction of hyperscalers because anyone would just be like, build me a Microsoft word, and it would
Starting point is 00:32:28 build them a Microsoft word, and they would use it, and it would be functional, bug-free, all of these things. They would be, well, I mean, we've already seen a spike in litigation from pro se people representing themselves, but nevertheless, we would see law firms turning into two or three person shops that would beat the leading litigators because they would have. Oh, absolutely. It would be very easy to see. In mid months, Toronto, pride is an opportunity for you to create your own space, to celebrate your existence. Iheart Radio is proud to be an official sponsor of Pride Toronto Festival, and we won't stop.
Starting point is 00:33:16 Celebrate Pride. Turn up the love and listen to IHeart Pride Canada, your 24-7 radio stream and the only playlist you need for your Toronto Pride celebrations. Pride is so great because it gives a whole bunch of people this visibility that they've never had before. We have a ton to celebrate Toronto. Happy Pride. Iheart Radio. Run a business and not thinking about podcasting, think again. More Americans listen to podcasts than ad-supported streaming music from Spotify and Pandora. And as the number one podcaster, IHearts twice as large as the next two combined. So whatever your customers listen to, they'll hear your message. Plus, only IHeart can extend your message to audience.
Starting point is 00:33:54 across broadcast radio. Think podcasting can help your business. Think IHeart. Streaming, radio, and podcasting. Call 844-844-I-Hart to get started. That's 844-844-I-Hart. Hey, I'm Hoda. Kotby, host of the podcast, Joy 101 with Hoda-Kotby. Together, we're going to have meaningful conversations with the world's most fascinating people, like when actress Olivia Munn shared how she overcame fierce health challenges. I've gone through breast cancer and then helped my mother through breast cancer, and that was more difficult. There's a lot of people who understand postpartner depression. I was not prepared for postpartum anxiety. Listen to Joy 101 with Hoda Kotby on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. A decade ago, the ethanol kingpin of Iowa
Starting point is 00:34:39 became the king of corn in Brazil. So we met with a lot of larger farmers, went from Bahia to to Tokatine's to Montegrozzo. And he brought a team of executives. They were going to help the country get in on a gold rush. Carbon and its derivatives are going to be really the next great commodity that the globe's going to trade. But back home in Iowa, trouble was brewing. If you live in Iowa, your land, your water, and your voice could all be at risk thanks to a man named Bruce Rastetter.
Starting point is 00:35:09 Now, people are questioning if his climate solutions have anything to do with climate at all. You got to give Bruce and the guy's credit. They're Republicans. They don't give a shit of money. It's now. On this season of drilled, Carbon Cowboys, the star. story of how the ethanol kingpin of Iowa became the king of corn in Brazil and what it tells us
Starting point is 00:35:28 about the limits of technology and markets to solve the climate crisis. Listen on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. I'll give you a related example, which made the rounds yesterday, and it kind of gets to the heart of this misunderstanding, is there was someone who shall remain undame but has a popular newsletter and used to work at a certain venture fund, put out something about, put out the radiologist, the radiologist paradox, which was the idea that back in 2016, Jeffrey Hinton, computer sciences and Nobelist, a really pioneer in image models and deep neural networks, said in a talk that within five years, if not 10 years, a large language, deep at the time, neural networks learning models would be better than radiologists and there's really no reason to continue training them. Now, of course, he said 10 years on the outside. Well, it's now 10 years later. And if you look at the data, we're continuing to produce more radiologists.
Starting point is 00:36:30 And that analyst then put out a note yesterday, and so did I think KOTU or someone else. And said, like, well, checkmate. Jeffrey hinted, look, we have a lot more radiologists. And of course, this is a classic example of a profound misunderstanding of so many things it's hard to keep track. One is that, again, it's not clear that being selectively better than radiologists at certain things like identifying, I don't know, prostate cancers or whatever else. Obviously, that's not good enough. Radiologists do more than that. But it also misunderstands the nature of the employment market because radiologists, like most of medicine, has created a very comfortable little cartel for themselves.
Starting point is 00:37:14 So even if there was Gale Force winds blowing at radiologists because of any, AI, the likelihood of you seeing it in such a short time, even if Hinton was right that they could in theory replace a significant slice of what radiologists do, it's a misunderstanding of the nature of the markets themselves. So it misunderstands both the technology and the nature of cartelized employment markets, whenever you have these kinds of arguments. And yet, it's used as an example of how the inexorable march of these things continues apace and it will always be augmenting. And I just think there's so many sort of nested misunderstandings of how what pressures AI is having on employment markets and how we might see it, where it might show up, then to take it
Starting point is 00:38:02 up a level, to then do these calculations and say, oh look, I can now come up with a defensible measure of how the augmenting function is working and then incorporate that in GDP. I kind of have to say bullshit. No, you can't. Also, we're failing at the simple stuff.
Starting point is 00:38:18 also just a very simple response is, okay, let's say it can identify them better than a radiologist, right? Now what? Right. The radiologist, though, it's, they don't just look at stuff like they are doctors, they've required, like, there's more to the process than just like, yes or no. And also, you are buying the experience. You're buying their experience and their connections and their ability to work within a hospital system. And there's, and there's tremendous papers on this, by the way. And treatment. Oh, absolutely. Showing how models... What do we do next? Right. Models in general, in a medical context,
Starting point is 00:38:55 and this is writ large, applies to models use in all complex environments. They tend to over-triage trivial cases, meaning that if you come in with like a cut, they're like, dude, this could be sepsis. Let's take you in
Starting point is 00:39:06 and start doing tissue biopsies. And it's like, no, no, it's just a cut. Leave me alone. And at the other end of the extreme, a woman comes in with chest, well, with pain in her back, which sometimes is indicative
Starting point is 00:39:16 of some kind of car. cardiac event, they're like, yeah, it's probably just a strain. And so this idea of marching straight through and saying that the only thing that matters is the input data, and therefore I can use these things in these complex environments. We know these tendencies towards overtriaging trivial cases and under triaging critical ones. That's also true, just as a side note, I gave a talk about this recently to the Fed, where I was showing how models do the exact same thing in financial markets, where they tend to become overaggressive when they should be conservative and vice versa, which leads to much more fragility in financial markets, and yet, you know, we march on.
Starting point is 00:39:52 And this is the deep problem, is this kind of complete misunderstanding of the nature of how these things respond in these complex environments. And then the systemic consequences of doing it. Like, for example, you replace radiologists with something with a tendency to over-triage. Guess what you're going to get? Far more testing, much more testing getting done, which may or may not be profitable for hospitals, but will have cascading consequences for people who have to have follow-up. biopsies because of things that look like possibly malignancies and turns out they weren't. And what we know for medicine is that for the most part, most things should be left alone. Yeah.
Starting point is 00:40:27 And again, I keep coming back to the really simple thing, which is if these things were going to replace people, they would just do it. They wouldn't be, everything wouldn't, I keep saying this, but everything wouldn't read like the Redler wrote it. It would just, every
Starting point is 00:40:43 single AI jobs thing is like, well, it's AI affected careers that might be doing this in this time, in this way. There was a CNBC headline last year. It was like 11% of jobs can already be done by AI. But when you looked, it was like, yeah, it was a labor simulator we made. Right, right. We didn't like, we didn't like, try.
Starting point is 00:41:04 It was the same problem with the meter studies, obviously, in terms of the duration, right? The duration of tasks. The METR, right, that one. Right, right. And the duration of tasks where you can get to 50% likely. of completion. And of course, if that was a human, using that as your as your benchmark, if that was a human, I would fire those guys, right? I mean, that's not a useful measurement in terms of how a human might think about a productive coworker. I don't think about you as half
Starting point is 00:41:30 the time you get shit wrong, right? That would be kind of, that would be something that would probably lead to review problems at the end of the quarter or year. And so we do, what's the line? Sam Harris's line, this is playing tennis without an ad, right? Yeah. It's just this And it's also just, we treat these things like they're fucking gifted children. It's like, wow, you could 50% of the time do this maybe. And that is, it's time for the New York Times to write an entire article. We need an odd lots episode that covers that 50% of the time this could do this. And it's just because you can't do the thing that every other obvious innovation has done.
Starting point is 00:42:16 You can't do it where you just go, wow, this does this. We could do this now. It's if this happens, and that is a load-bearing if, we might be able to possibly do this. We can't measure it in the way you measure other things, which is how we would otherwise distinguish whether something was good or not. So we made up a new thing. And wow, has it beaten the benchmarks we made up for it? Right.
Starting point is 00:42:40 And the problem, of course, is this all becomes a bit facile and glib and everything else in terms of the arguments being made. But it has spillover consequences in the real world, which is the unfortunate thing, is that let's follow the logic forward. If my job is I'm selling tokens and tokens, I need to sell more tokens rather than less because I have to pay the knot on some fixed obligation, well, I'm going to construct more data centers and construct more larger data centers. And you end up with these massive mega projects like this controversial one that Kevin O'Leary has been promoting. Miss the dog ship.
Starting point is 00:43:16 Right, north of Salt Lake City, you know, that in the limit might be the size of Manhattan or larger, as people point out. This has consequences because the arrow of time only moves in one direction. I defy you to find an example of, you know, the old talking head song where this used to be a parking lot, now it's covered with flowers. The data center is not going to reverse.
Starting point is 00:43:39 Once you build these giant things in the real world with real consequences in terms of, you know, sprawling out physically but also sitting on top of water and power, untangling that becomes really, really difficult, as does, for example, having to spin up all of these new natural gas plants to power these things because we're increasingly asking that hypers come with their own power behind the meter. Yeah, behind the meter, yeah. Right, right, right.
Starting point is 00:44:07 When we're doing that at the worst possible time because the combination of batteries and alternative sources ranging from wind and solar, for example, are becoming much more effective and able to be more persistent with battery backup, and yet we're installing these CO2 intensive things with 30 and 40-year lifespans funded by debt that are almost all likely to end up being stranded assets.
Starting point is 00:44:31 They'll be like the statues at Easter Island eventually, except natural gas plants. Well, and this is what I've been saying, it goes back to the dot-com thing I was saying. It's not like, an incomprehend, complete data center, which I think the vast majority, I don't think any of these things get finned, the vast majority of them don't get fully powered. Like that's sure. I think anything that's targeted over a gigawatt doesn't get finished. It fully agree. And the funny thing is with that is
Starting point is 00:44:56 people like, yeah, the dot-com bubble when at burst, people had the useful infrastructure. That will cost just as much to finish in the future, except the debt, you'll go to a credit for, you'll go to a, well, probably not private credit in the end of this, but go to a bank like, yeah, I want finish this data center, they will shoot you with a gun. They will, you will get headshotted by the bank manager for saying the words AI. It's just, and it's, these things are going to be everywhere. I'll give you an even more, it's an even more insidious than that. And I spend a lot of time talking, trying to talk off the ledge, if you will, various regional
Starting point is 00:45:34 economic development people. I was just talking to some people in New Mexico about this. and the problem they have is they've been trying to land some large employer for 25 years in these high unemployment regions and so I'm entirely sympathetic to the problem that a data center hyperscaler shows up
Starting point is 00:45:53 and says listen let me install this, give me the following giveaways with respect to taxes and this will eventually after construction we'll have this many jobs and so on and you don't have to keep fighting for the Hyundai Battery Factory or the Ford Assembly plant or whatever else it'll just be here spinning off tax revenues.
Starting point is 00:46:09 And so what happens is, A, that looks like a pretty good bet because it's a fixed obligation in terms of what will be flowing back into your county for years to come. And what do they do then? They start pre-budgeting that and saying, okay, we'll start building new playgrounds, we'll start fixing the water supply, we'll be able to fund schools. Great. Now, okay, you've front-loaded all of that stuff. What happens whenever the data center doesn't get finished? You're actually in a worse situation than you were previously.
Starting point is 00:46:35 So it has real world consequences in terms of these annuity streams that are being dangled in front of people whose regions have suffered economically for decades. And that's going to be the story over the next 25 years. Yeah, it's going to be years of data center collapses. Even after the AI bubble bursts, in my opinion, there's going to just be years of this. Because you're already seeing a lot of this stuff is speculative. And even then, even if these things get turned on, as you said at the beginning, we are in an era. where people are going to be trying to cut back on costs. But then that's the really basic answer.
Starting point is 00:47:10 What do more data centers do? What do we get out of these? Because Open AI has more compute than anyone. What are they doing? What's the difference? What does? I keep hearing the term AI factory. And I'm like, what do you mean?
Starting point is 00:47:27 What do you mean by that? Or a factory full of geniuses. That's my favorite. Oh, the data center. Oh, geez, a data center full of geniuses. I really dislike Dario Amaday. I hate how he sounds. I hate how he speaks.
Starting point is 00:47:40 Just like, what are you fucking talking about? Because more data centers so far has not actually improved these products. It's not. Like, there's not, if you gave OpenAI another 15 gigawatts of data centers doesn't exist, but let's say they did.
Starting point is 00:47:55 Nothing. Like, nothing is going to change about this. Yeah. I don't, and I don't think, but the other thing is as well, hey, is Vera Rubin going to make AI profitable?
Starting point is 00:48:08 Because if it isn't, this is probably the last generation. That is, I think, at this point, the thing. I think very much so. And I think that's one of the other consequences here that's going on. And I think it's one of the reasons why, and I don't know if you've noticed, but the Jensen has gone from being very promotional to extra special vary to the third power promotional. In terms of, I saw today he was anointing Marvel as the next. X trillion dollar company.
Starting point is 00:48:35 And for me, this is really unprecedented, but it only works if you start thinking about it in terms of the ecosystem of buyers and sellers in the context of AI CAPEX and realizing that the more valuable all of these companies become, the more money is sort of flowing around this, what we used to be called like a captive economy. And then it just recirculates amongst all the players as they become increasingly wealthy because their stocks get bit up. And so this notion of having people suggesting that one of their sort of people, you or quasi-competitors should also be valued at a trillion dollars is really unprecedented.
Starting point is 00:49:10 And you can only really understand it once you understand it that they are all essentially running printing presses in their basement and the printing press is their stock. And they're hoping that the value of the printing press and the currency keeps going up. And that way they can circulate more script among them, which in turn turns into purchasing. And that's the fundamental circularity at the core of all of this. So as we wrap up, I wanted to get, like, because I've already had emails and texts somehow, I don't know how they got my number. What do you think of this, what does this Google thing mean? So Google doing their $80 billion raise at the market. What does this tell you? Well, a couple of different things. One is that this is the equity raise?
Starting point is 00:49:53 Yes, exactly. So $10 billion from Berkshire and then some other, like $10 billion for Berkshire and then I think two different at the market sales. Yeah, so, I mean, so this tells you that the appetite continues to be incredibly high for their pay, for not for equity, which is surprising because for the most part, the funding has been increasingly moving towards credit, obviously, right? Yeah. And because of the saturation of their cash flows with respect to having to sort of inoculate themselves against all of the other commitments they have. My favorite example being that Microsoft's a good example of this is that their stock-based compensation is. so high that they have to, which is obviously only handled through cash flows, that the way they inoculate themselves against it is they have to do stock buybacks. And once you start doing that, you've got a much larger commitment of cash, which forces you after you pay for hyperscalor
Starting point is 00:50:46 data centers. You then have to start doing raises off balance sheet using SPVs and other kinds of funding vehicles. So that they're able to do this is sort of surprising to me to a degree that there's still this much appetite for non-credit equity financing of some of their future obligations because it gives you no call on future cash flows. So what's in it for you as a provider of equity here? It's not clear. Yeah. Is it also a sign that the debt is running out? Why would they do this instead of raising debt? So there's no question about that as well. So that's the other side of this is that as of Q1, 2020, what a year are we in?
Starting point is 00:51:22 26, I have to look around the room. That's bad. So as of Q1, 2026, the hyper-scalers are now the largest issue of investment-grade debt on in investment-grade markets worldwide. They just passed the banks. So yes, the other answer to this question is there is a capacity issue with respect to the further issuance of investment-grade debt. In a weird way, they would actually be better if they were issuing junk high-yield because there's a higher appetite for high-yield, but they just so happen to be currently anyways, prime credits. so they're issuing investment grade, and the appetite for that stuff is finite,
Starting point is 00:51:57 which is why increasingly the marginal buyer for the most recent credit issuances from the hypers is the usual suspects, like European insurance funds, Middle Eastern sovereign wealth, these are the people who famously tend to show up at the end of almost every bubble, and so here they are at the door again.
Starting point is 00:52:17 So yeah, do you think that this is toward the end? I'm not asking for a hug. No, no, no, no, I think very much that. I think the blow off top is the, is the, this year's three mega IPOs, and that kind of marks the gonging of the bell with respect to, take the seriousness with respect, you have to take this inability of these companies to make money. Paul, it's always such a pleasure to have you. Where can people find you?
Starting point is 00:52:44 Paul Kedroski.com is the best place. Hell yeah. Everyone, thank you so much for listening. I'm, of course, Ed Zittron. You can catch me on this podcast, better offline. Where's your ed.com. subscribe to newsletter to my principal form of income. I will be back with a monologue on Friday. Thank you all for listening and goodbye. Thank you for listening to Better Offline.
Starting point is 00:53:11 The editor and composer of the Better Offline theme song is Mattersowski. You can check out more of his music and audio projects at Mattersowski.com. M-A-T-T-O-S-O-S-K-I.com. You can email me at E-Z at Better Offline.com or visit Better Offline.com to find more podcast links and of course my newsletter. I also really recommend you go to chat. Where's Your Ed?at to visit the Discord and go to our slash Better Offline to check out our Reddit.
Starting point is 00:53:39 Thank you so much for listening. Better Offline is a production of Cool Zone Media. For more from Cool Zone Media, visit our website, coolzonemedia.com, or check us out on the IHeartRadio app, Apple Podcasts, or wherever you get your podcasts. Joy is essential and it's also elusive.
Starting point is 00:54:17 But now, there's a new and exciting way to start your journey toward a more joyful existence. Joy 101. It's a new podcast hosted by me, Hoda Kotby. If you're craving inspiration to maximize your joy, tune into these candid, uplifting, and moving on-air chats. Open your free IHeart Radio app.
Starting point is 00:54:36 Search Joy 101 and listen now. Joy 101 with Hoda Kotby is presented by CVS. Hey, this is Chuck from Stuff You Should Know, and we're submitting our most sciencey episodes for your peer review with our new stuff you should know doing science playlist. Out now. You want to know about Occam's Razor?
Starting point is 00:54:55 Simplest explanation is usually the right one? We got you covered. Wondered what chaos theory is ever since the first time you saw Jurassic Park? Well, come on down. So distill a nice pot of tea, everybody, turn down the gas on your Bunsen burner, and slip into your most comfortable lab coat
Starting point is 00:55:09 and listen to the stuff you should know doing science playlist on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. Here's something that should not be as complicated as it is, getting a racist statue removed. And here's something that should be a whole lot easier than it is, getting a new one put up in its place. I'm Akila Hughes, and Rebel Spirit Season 2 is about both of those things.
Starting point is 00:55:34 As I was watching these statues come down, I was thinking about what it meant that I grew up in a majority black city, in which there were more homages to enslavers than there were to enslave people. Listen to Rebel Spirit Season 2 on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts. June is Black Music Month, and on the Drink Chams podcast, we're speaking with the hottest names in the culture, like Sway Lee. Do you realize how legendary you are? I appreciate that. I'd be seeing it, but I'm like, man, I still got, like, so much more to do.
Starting point is 00:56:02 Like, Prince, he dropped, like, 30 albums. We dropped, like, five right now. That's the rate we gotta be going. Yep, that's a good attitude. No matter the era, Drink Chams brings you the biggest names and the most unfiltered conversations. Listen to Drink Chams from the Black Effect Podcast Network on the IHeart radio app,
Starting point is 00:56:19 Apple Podcasts, or wherever you get your podcast. This is an IHeart podcast. Guaranteed Human.

There aren't comments yet for this episode. Click on any sentence in the transcript to leave a comment.