Better Offline - Why AI Has No ROI with Paul Kedrosky
Episode Date: June 3, 2026In this week’s Better Offline, Ed Zitron is joined by economist Paul Kedrosky to talk about why nobody can find the ROI of AI, why there won’t be a Dot Com Bubble-style recovery for AI dat...a centers, and how Google’s $80bn equity sale shows we’re at the top.https://paulkedrosky.com/ The Nick, Dick and Paul Show: https://www.youtube.com/channel/UCFbDiETo29GTIjg6Lk4imig Save $10 off a year of my premium newsletter: https://edzitronswheresyouredatghostio.outpost.pub/public/promo-subscription/gzqwkv54e1 - I’d be so grateful! YOU CAN NOW BUY BETTER OFFLINE MERCH! Go to https://cottonbureau.com/people/better-offline and use code FREE99 for free shipping on orders of $99 or more. Buy our new “FUCK DATA CENTERS” shirts today! --- LINKS: https://www.tinyurl.com/betterofflinelinks Newsletter: https://www.wheresyoured.at/ Reddit: https://www.reddit.com/r/BetterOffline/ Discord: chat.wheresyoured.at Ed's Socials: https://twitter.com/edzitron https://www.instagram.com/edzitron https://bsky.app/profile/edzitron.com https://www.threads.net/@edzitron Email Me: ez@betteroffline.comSee omnystudio.com/listener for privacy information.
Transcript
Discussion (0)
This is an IHeart podcast.
Guaranteed Human.
Run a business and not thinking about podcasting.
Think again.
More Americans listen to podcasts
than adds supported streaming music from Spotify and Pandora.
And as the number one podcaster,
IHearts twice as large as the next two combined.
Learn how podcasting can help your business.
Call 844-844-I-Hart.
Joy is essential and it's also elusive.
But now there's a new and exciting way
to start your journey toward a more joyful existence.
Joy 101.
It's a new podcast hosted by me, Hoda Kotby.
If you're craving inspiration to maximize your joy,
tune into these candid, uplifting, and moving on-air chats.
Open your free IHeart Radio app.
Search Joy 101 and listen now.
Joy 101 with Hoda Kotby is presented by CVS.
Hey, this is Chuck from Stuff You Should Know,
and we're submitting our most sciencey episodes
for your peer review with our new Stuff You Should Know
doing science playlist.
Out now.
You want to know about Occam's razor?
Simplest explanation is usually the right one?
We got you covered.
Wondered what chaos theory is ever since the first time you saw Jurassic Park.
Well, come on down.
So distill a nice pot of tea, everybody,
turn down the gas on your Bunsen burner,
and slip into your most comfortable lab coat
and listen to the stuff you should know
doing science playlist on the IHeart Radio app,
Apple Podcasts, or wherever you get your podcasts.
June is Black Music Month,
and on the Drink Chams podcast,
we're speaking with the hottest names in the culture,
like Sway Lee.
Do you realize how legendary you are?
I appreciate that.
I'd be seeing it, but I'm like, man,
I still got, like, so much more to do.
Like, Prince, he dropped, like, 30 albums.
We dropped, like, five right now.
Like, that's the rate we gotta be going.
Yeah, that's a good attitude.
No matter the era,
Drink Chams brings you the biggest names
and the most unfiltered conversations.
Listen to Drink Chams from the Black Effect Podcast Network
on the IHeart Radio app,
Apple Podcasts, or wherever you get your podcast.
AllZone Media.
Greetums. I'm Ed Zittron and this is Better Offline.
Better Offline.
Today we are joined by the mighty economist Paul Kodroski. Paul, thank you for joining me.
Hey Ed, how's it going?
It's going great. Everyone's deeply upset because this week and the last week, everyone has been saying,
huh, does AI have a return on investment?
And it's, I've really been enjoying it because it's like,
watching the dinosaurs look up and see the meteor.
They're just like, what do you, what do you mean?
What do you mean this costs money?
I don't know if you've seen the GitHub co-pilot stuff.
Yeah, I actually put out a thing on it yesterday.
Oh, sorry, Paul, terribly rude to me.
You know me.
I've got all sorts of crap on, so I haven't read it yet.
But I'm excited to talk about this.
I'm really excited.
It's really, and not only that, I mean, I'll sort of triangulate
with three different things
that touched on different aspects
of this at the same time.
One was obviously the GitHub
co-pilot study
which we can get into
as deeply as you want.
There was also a piece
that came out
in part from the Peterson
Institute for International Economics.
Yesterday or the day before
Jack Cook
or Clark at Anthropics
set it around
who is obviously one of the co-founders there
and it's called
Where is AI and GDP statistics?
And then of course
there was the debacle
which I saw
anonymous, someone that had anonymously disclosed that they had spent almost a half of $500 million
because they had uncapped token expenses and discovered they'd sort of blown their credit cards.
Anyways, yes, there's a bunch of things there's a bunch of things.
Well, let's start with the GitHub thing.
So for the uninitiated, GitHub copilot, AI coding tool from Microsoft, a couple weeks ago,
I broke the story, of course, that they were moving their users from a premium request model to a token-based model.
So think of it like this with the listeners.
if you, every time you use the cab service, you could just say, drive me from the upper west side to Red Hook.
And that would just, that would be one drive and you get a certain amount of drives a month.
And then suddenly the beginning of June, they turned to you and say, yeah, you've got to pay by the mile.
And you suddenly realize you've been taking 95 mile trips.
You've been asking to drive from New Jersey to Maryland, which I realize is further than 95 miles.
Don't, not a geographer, right?
But nevertheless, on the GitHub co-pilot subreddit, people have just been posting.
What the fuck?
What do you mean?
My whole balance is gone in three prompts.
What do you mean by that?
It's, yeah, and this is part of the problem, right?
Is this been, you can get all econo-wunky about this stuff,
about the merits of metered pricing on a per-token basis
versus lump sum pricing.
But in a sense, you can think of this was the early pricing in terms of how tokens were metered out
had two really important characteristics.
one is they were grotesquely subsidized.
You weren't actually seeing the real all-in cost
with respect to the loaded cost of actually providing you
with those tokens.
And then as a kind of don't pay a cent event
up there with Costco, it was being bundled.
So you had a second layer of masking
with respect to what tokens were actually costing.
And so once it becomes unsubsidized and unbundled,
then you see your ass is dangling
in the breeze of real token pricing.
I think it's funny as well because for years, people have been saying to be, that's not happening.
They're not subsidizing it. It's different. It's just, it's like the Costco model, for example.
People are like, oh yeah, well, they're making money other ways. It's like, no, they're not.
They're just selling, in Microsoft's case, they were like, we're going to sell you $1,000 for $39.
Right.
What do you think? Do you think that's good? Do you like that?
It's a lovely, it's a lovely come on. It brings people in. It's like the hot dogs in Costco.
except Costco has other things on which they make a boatload of money.
Except the hot dogs cost like $7,000 a packet.
It's just, I think it's quite deceitful, personally.
I think it's because these, on one hand, we can make fun of these people.
I will continue to do so.
It's funny.
But when you look at them, it is also quite depressing because they were intentionally misled.
Like, these people had no idea.
It's not like these subsidized subscriptions like, hey, if you use them,
this many tokens while paying for them it would cost this much until they made the change.
Microsoft released the calculator, it allowed you to see that, but only once they'd announced
it.
So you have millions, I would say the vast majority of people that interact with AI who have
no idea what it costs, literally none.
Right.
And which is made worse by some of the early overexcitement, especially among large corporations
that made the mistake of creating leaderboards.
Oh my God, hell yeah.
Right?
So this is, we got into this token maxing phenomenon.
So if you're inside of, which is obviously the idea that the more tokens you use, the better you do in your job review because look at you, you're all AI.
The problem, of course, is this is a little bit like the Saudis handing out Humvees to everyone in America.
Yes.
Wow, this is awesome.
I love having a Humvee and then you have to fill it up.
And so for a little while, it was like we were subsidizing these gross.
protestically,
profligate users of tokens,
just like profligate users of gasoline,
and then all of a sudden the bill comes to do
and you say, wait a minute, this thing's a pig.
It's a lot of gas.
I don't want to drive it for groceries anymore.
And the exact same phenomenon is true
with respect to being, again,
exposed to having your ass hanging in the breeze
of real token prices.
Well, the other thing is as well,
is I just put out our newsletter about this,
you look at how these people are freaking out,
and you also realize they have no
idea what AI costs. It's not just like, wow, this is a lot of money. It's they're not even
thinking in terms of cost. It's not like they know, I don't know, they're refactoring something.
They don't know how much that cost. They don't know how much anything costs. So it's not like
they can smoothly transition to token-based billing because they don't, they don't know.
They have no idea. No, and this is, this is the deep, this is the deep structural problem,
because they were brought in through the side door of bundled pricing. And now,
that's becoming unbundled.
And of course, that also is reflected in what we're told.
I think the Wall Street Journal and others have written about this,
and it would be interesting we see the final S-1s
for some of the upcoming IPOs,
that there is this attempt to try and even mask it in the financial filings
where you get into this phenomenon of what we used to call
earnings before bad stuff.
And so what they're trying to do is hide the costs of training the models
and saying that's not actually.
an operating cost, that's a capital cost.
We shouldn't have to show that
as a function of what actually
the margins are on producing tokens.
And that is, of course, a cheat, right?
Because if that's true, then you should be able
to capitalize these things and expense them for
a long period of time. And we know full well
that these are actually operating costs
because they tell us that every 18 months
we're launching a new major model.
These things are not capitalized. These are operating
expenses that should be treated accordingly
with respect to the actual cost of
token production. So there's a multifaceted
game going on here, both in terms of how it's being presented to users,
but also in terms of how they're trying to sell it in the context of the upcoming
S-1s for the Anthropic and OpenAI IPO filings.
Well, what's really funny as well about the idea of capitalizing training costs is
they're never going away because it's not just pre-training, shoving the stuff in the models.
They have to constantly tweak them because of model draft.
Right, which from a classic my years ago accounting,
whenever you have a regular and predictable cost
that you have to incur to continue operating your business
that is no longer a capital cost
that's an expensive item that should be expensive as such
so you get into as I said
back in the dark days of dot com
and even the telecom boom you get into this problem
of earnings before bad stuff where they want
to exclude all of the things that make the numbers look bad
and then of course on the other side
you have this run rate problem where
we continually hear about what the run rates are at these
companies and the window
with respect to the run rate,
could be the last 15 minutes, for all you know, right?
A run rate is just,
you extrapolate whatever is most convenient for you.
So it's a problem on both sides.
Well, yeah, actually, that's it.
I love talking about run rate.
Everyone who listens to this show knows I'm a real run rate pig.
Because, like, anthrop...
I've reached out to both Open AI and Anthropic
and said, hey, how do you define this number?
And they will not respond.
They will not...
They are very unfair to me, very nasty.
They will not respond probably,
probably because from what the information is reported,
I don't know how OpenAI does it,
but Anthropic not only includes the amounts of money
that Amazon and Google make in their revenues.
That's right.
When they resell the most.
But they also, they do 13 times the last month's API spend
and 12 times the current day's subscribers.
So it's just there's so many ways.
Also, so tokens spend.
just organizational token spent, that's not a recurring cost.
That's just, you can kind of, I guess, think, well, maybe people are spending this today.
But that person who spent half a billion dollars, that company spent half a billion dollars on AI, right?
Yeah, yeah.
That's not happening again.
That person is, that you're not going to get one half a billion dollar Mr. Bean every single month.
Right.
as someone just goofily.
I also genuine.
Like, I know the report of Madison Mills.
She's respectable report.
She's very, she's, she's good.
She is well-sourced.
It's just like,
I hope Anthropic didn't include that 500 million in their annualized revenue.
Yeah.
I'm looking forward to it showing up in a public company filing
because it almost inevitably will.
This is going to be somebody one-time item, right?
And then-
You think that that will, though?
Oh, absolutely. I mean, half a billion, it's material for almost anyone. So my guess is it's going to show up somewhere. It'll be really interesting to see. And my guess is at that scale, it's a public company. So my guess is we will see that. We will know where that actually happened. And so it's going to be very entertaining. But this is the deep structural problem. And it gets worse, of course, because once you unbundled token pricing, and then you're looking at the actual year-over-year decline in quality-adjusting.
token pricing, and you see the inherent deflationary curve underneath the hood.
Now let's connect that to how all of these data centers that are producing these deflating
tokens are being constructed, an increasing fraction of that.
Can you elaborate what you mean by the deflating token?
I'm not sure I understand.
So over the last, since 2022, on an annualized basis, on a performant basis, so ignoring what
this continual jump to the frontier.
If you imagine sort of on a comparable token basis
cross models across the period,
token prices have fallen anywhere from 70 to 90%
year over year, consistently back to 2021.
Right, but they're burning more tokens in the process.
Right, right, right. But let's put that aside for one second.
Think about it.
Turn it the other way around. So if I'm now, my business is now,
I'm unbundling and I'm selling tokens,
and that's the way customers,
you're telling my customers to think about it.
So now they're looking out
and they start to see what happening with token prices
and if I go back one generation,
maybe those prices are cheaper.
Now we have this classic financial problem
of what's called a duration mismatch, right?
So I have debt funding the data centers
that's 10 to 15 years duration and longer,
which is predicated on fixed payments,
but being made on the basis of tokens
where you're telling the customer,
to control your costs, you may want to look back in time and use an older model.
So I'm paying for a fixed cost with a deflating commodity.
Right. This we know from the over and over and over again,
these duration mismatches, especially duration mismatches that are built on top of debt
and a deflating commodity are absolutely atomic with respect to causing a blow up
in people's obligations with respect to these kinds of duration.
mismatch problem. So there's a deep structural issue that this will expose and people haven't
quite realized it yet. So you're saying that as the token costs get cheaper and everyone's being
encouraged to use this less or more thoughtfully, that's happening, but they're building the
data centers as if number will only ever go up and they'll only ever use the tokens.
That's exactly right. And so you've got this, wonderful. Again, the term of art. You've got a
duration mismatch on top of a deflating commodity that can only end very, very badly. And it was
masked because for a while you weren't exposed directly to that. You were just paying a straight-up
subscription, almost like Amazon Prime. And of course, that doesn't work because Amazon Prime's costs
across the border declining, whereas costs are increasing at the frontier declining in the back
catalog, if you will, of tokens. And that's the thing with like Amazon Prime, for example,
yes, they have found, like Amazon or not like Amazon. People, I know many listeners don't love
them. I agree. But it's like Amazon Prime.
They fix those costs by building their own logistics network.
And they found ways to, they had, I don't know, ways to make that cheaper.
No one has that in AI.
No one.
Like it's just, we have three, four years in and everyone's like, oh, we'll do A6.
No, we won't.
That didn't work.
Right.
We're like two or three generations of Petraeum, Infraentia, TPUs.
Still not profitable.
We know.
Right.
We know.
We would know.
Yes, we would.
We would know.
But I think, and of course the problem is that if you look at, I was just looking at some data yesterday with respect to how small language models are increasingly closing the gap with large language models, which is causing training cycles on large language models to have to accelerate, become more expensive, throw more compute at it, more reinforcement learning. The costs are not, are particularly not declining. They're actually increasing sharply at the frontier because they're essentially being chased like the rabbits and, you know, like the rabbits.
like Wiley Coyote and the Roadrunner.
And so they're being chased into this very costly corner as a result.
And that's a classic commoditization problem.
If you go back to the 19, I don't know, late 19th century,
a very similar thing happened in railroads as people were racing desperately
to try and find a way to build a corner and control themselves
so that they could compete with all of these other upstart railroads.
And of course, all that really happened was Cappex exploded,
margins went to shit, and multiple railroads failed.
led to the crash of what, 1873, 1893, and arguably was a cause in the Great Depression.
So you're playing out this exact same game because you're sitting in this high-cap-x world
that's increasingly funded by debt and built on top of this duration mismatch with token prices
being now exposed and raw in front of people.
Happy Pride Month, Toronto.
Pride is an opportunity for you to create your own space, to celebrate your existence.
Iheart Radio is proud to be.
an official sponsor of Pride Toronto Festival, and we won't stop.
Celebrate Pride.
Turn up the love and listen to IHeart Pride Canada.
Your 24-7 radio stream and the only playlist you need for your Toronto Pride celebrations.
Pride is so great because it gives a whole bunch of people this visibility that they've never had before.
We have a ton to celebrate Toronto.
Happy Pride. IHeart Radio.
Run a business and not thinking about podcasting, think again.
More Americans listen to podcasts than ad-supported streaming.
music from Spotify and Pandora.
And as the number one podcaster, IHearts twice as large as the next two combined.
So whatever your customers listen to, they'll hear your message.
Plus, only IHeart can extend your message to audiences across broadcast radio.
Think podcasting can help your business.
Think IHeart.
Streaming, radio, and podcasting.
Let us show you at iHeartadvertising.com.
That's IHeartadvertising.com.
Hey, I'm Hoda Kotby, host of the podcast, Joy 101 with Hoda Kotby.
Together, we're going to have meaningful conversations with the world's most fascinating people.
Like when actress Olivia Munn shared how she overcame fierce health challenges.
I've gone through breast cancer and then helped my mother through breast cancer,
and that was more difficult.
There's a lot of people who understand postpartner depression.
I was not prepared for postpartum anxiety.
Listen to Joy 101 with Hoda Kotby on the IHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
A decade ago, the ethanol kingpin of Iowa became the king of
corn in Brazil.
So we met with a lot of larger farmers,
went from Bahia to Tokatines
to Madagroso.
And he brought a team of executives.
They were going to help the country get in
on a gold rush.
Carbon and its derivatives are going to be really the next
great commodity that the globe's going to trade.
But back home in Iowa, trouble was brewing.
If you live in Iowa, your land, your water,
and your voice could all be at risk
thanks to a man named Bruce Rastetter.
Now, people are questioning if his class
Climate solutions have anything to do with climate at all.
You got to give Bruce and the guy's credit.
They're Republicans. They don't give a bit of money.
It's now.
On this season of drilled, Carbon Cowboys, the story of how the ethanol kingpin of Iowa
became the king of corn in Brazil and what it tells us about the limits of technology
and markets to solve the climate crisis.
Listen on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts.
And the other thing is as well is people, just literally,
in my piece today. People make this point about, oh, it's like the dot-com bubble in that we will,
we will simply just, we'll reuse these things in the future. Like, we'll just pick these up.
And it's, I read, I hear this from very smart people, are people who are not like,
beguiled by the AI industry. But it's like, okay, let's talk about what happened to the dot-com
bubble. So when it exploded, you had those, some microsystems, the ultra, whatever it was,
I forget. Forty-five-grinders.
but that one server could run an entire company.
You could run everything on it.
Databases, messy CRMs, they had like, did they have on-prem lotus notes?
Anyway, you had those things, but you could run that.
And you could probably run that in a garage.
You might need to use the washing machines plug, but you could do it.
And those things were 50 grand, so you'd probably get them at, what, 20, 30 large.
Yeah.
Okay, great.
What happens when the AI bubble bursts?
You can't just plug it in an AIG?
A B200 GPU is about 50 grand.
It requires about, I think, as I looked this up very recently, it's like 1,500, 1,500
watts for a Sun Microsystem server, about the same for a single B200, which will require
bespoke cooling, a server, hardware, RAM, all of this other stuff.
And then you'll find out that you can't do jack shit with a single GPU.
Yeah, you're going to be a huge source of disappointment when you power it up, your
neighborhood lights all blink out and you can't still can't do anything. So yeah.
I just don't think you can actually use it. But that's, but that's, but that's, I call this,
I was just, I got into this with someone recently who was making a similar, and I call it faith-based
argumentation. It's this kind of, you know, quasi-religious orthodoxy that requires you to believe
the following five things. You know, they always create more jobs and they destroy. We can always reuse
assets after the fact. And I'm one of the things I always point to people is that almost half of U.S. railroad lines
built during the boom years in the late 19th century
were eventually abandoned.
And did they find reuse?
They absolutely did.
It only took 100 years and now they're mountain biking trails.
Jesus, Christ.
Let's wait around for that.
Those were railroads.
They were railroads that didn't require
electrification, I guess.
So they were much more stable as assets, right?
They didn't have the problems that GPUs and data centers do
were not just the huge power and cooling requirements,
but also the inherent the trajectory of the underlying technology
where it changes quickly enough that, you know,
is a 20-year-old, you know, Blackwell
have any use to anyone other than as a paperweight.
Of course, the answer is probably not.
Whereas a railroad...
They are pretty heavy.
They are extremely heavy.
I actually was messing around with one recently.
And so, yeah, and so this is the problem.
And again, it's this sort of naive argumentation,
not to mention the old Keynes line,
that it may be, it may be,
great in the long run, but in the long run we're also all dead. So it really depends on your time
horizon. And I find it honestly in the face of the kinds of consequential changes in the US economy,
I find it a very glib style of argumentation where you're essentially patting people on the head
and saying, don't worry your pretty little head, this will all work out because it always has.
And they're arguing from a data set sample size of five, which we wouldn't launch a, we wouldn't
launch a drug on that basis. Also, I think it helps them rationalize bad behavior.
Because if you say, okay, it worked, the one that actually upsets me is, well, the dot-com bubble
worked out. It's like, yeah, the stock market lost 80% of its value, hundreds of thousands
of people lost their jobs, people lost everything in some cases. And at the end, it's like,
okay, that was also completely different, but you're being quite glib about the first part.
But it's also, yeah, it's okay that people burn a lot of money for basically no reason.
and it also allows you to not think about bad stuff.
It allows you to do the Andrisonian argument
that there's no point in introspection.
It's just a really bad idea.
Right.
Well, I think about these things
that they'll all sort itself out.
But I also think there's a deeper issue.
And we may have talked about this before,
but the idea, a lot of people treat as an article of faith,
Carlotta Perez's book,
Technological Revolutions and Financial Capital,
and one of the things that they, quote,
take away from that, which I'm not convinced they do.
I think they only look at the pictures.
But anyways, one of the things they take away
from her book and her work and other people's work with respect to these violent technological
revolutions is the idea that it really doesn't matter because it always works out.
Here's the difference, though.
In past episodes, we didn't tell ourselves that.
So there's an element of reflexivity going on here because once you know the plot and you act
as if the plot is somehow F-E-E-E-E-A, it's a law of physics, then the whole game changes
because now you're acting as if it doesn't matter what I do because you think it doesn't matter
what you do because you've got this idea in your head as an article of faith that it always works out.
That wasn't true historically. No one in building out the railroads, rural electrification,
the fiber bubble, no one was telling themselves in the time this always works out.
That was not part of the playbook. The idea that we now tell ourselves these things is such a deep
structural change in terms of the way this stuff happens that it amazes me that no one understands it.
Well, I think it's just, it's the rationalizing and it's also, it gives you a way of avoiding
thinking about true structural issues.
Right.
It's thumb-sucking, I always call it.
It's really a kind of thing.
It gives you comfort.
It allows you to be like, well, Google isn't stupid for raising $80 billion in equity sales.
Yeah, Google, the largest companies in the world couldn't just destroy their companies.
by wasting all their money.
It's like, yeah, go and type something into Google search.
Go and type anything into Google.
And tell me if this looks like a company running a good business or a good product
or just a company throwing shit at the wall and being like,
this works, right?
You know, fuck it.
And we have so many examples of companies that were lauded during the run-up prior episodes
for being really understanding the way the world works
and being a real pathbreaker and so on.
on baiting whether it was the global financial crisis
and the banks at that time
and my friend Jim Kramer's unfortunately timed comments
about Bear Stearns and all that kind of stuff
because people are so backwards looking
and so extrapolative with respect to the way they look at things,
they just can't see the discontinuity.
The obvious discontinuities ahead,
and so they extrapolate and extrapolate and then they eventually
extrapolate their way right off a cliff.
And I see a lot of that in this going around.
And I don't know if you saw it,
But there was a paper came out, as a good example of this,
there was a paper came out yesterday,
and this goes to the heart of the token pricing problem,
and it came out, I think it was on SSRN or Amber.
Yeah, the National Bureau of Economic Research.
And so the paper basically was about how there's been,
as you and I both know,
there's been this explosion in the number of GitHub commits
and repositories and commits within them,
and it's up something like 200% over the last 18 months,
largely driven by harnesses and everything
and all of these coding tools.
tools. And of course, then they looked at the other side of it.
This is this profligate use of tokens. What has it led to? Because
producing more stuff that shows up on GitHub is just their need immediate variable.
Nobody in the real economy cares other than maybe Microsoft. And even they probably wish there
was probably a little less activity on GitHub. And so they showed that this was just,
they used iOS apps, Android apps, and one other category. Anyways, and they showed that the number
of reviews per app has declined sharply as the number of repositories.
commits has gone up. So essentially what we're seeing, and this is the thing that I think is
really important, is these can be very effective if wildly subsidized productivity tools for
coders, but the end economic result is mostly the production of sort of slop everything,
slop apps, slop content, slop. And so you're flooding and commoditizing these markets
that are becoming both saturated and declining margins. And this is an incredibly important
distinction that just because it's helping you produce more stuff, it doesn't mean that in the
broader economy, its ability to absorb it is increased, nor does it care. And that's what this
paper shows. And I think the idea that we're doing all of this work and what's increasingly
become expensive work using tokens to produce things and makes coders very happy having, you know,
things running in agentic loops. But the broader economy, you know, doesn't give a fuck.
And by any chance did you read semi-analysis's AI dark output?
I did, yes.
Which is one of the funniest things I have read in my life.
So for the listeners, you'll have a link to this.
But it's basically, yeah, AI is so, AI output will be real before it is measurable.
We can capture token spend and we can capture jobs lost.
But unless AI's output is sold at a visible price, only token spend is captured in GDP.
By which they mean, we don't actually.
measure whether something is good.
We just measure whether something.
It's actually so...
This is the shit a teenager would say
when lying about having a girlfriend.
It's just voodoo teen economics.
Yeah, it really is.
And again, it goes to that National Bureau
of Economic Research paper. It's exactly the same thing.
I was mentioning at the top,
there is this tremendous...
I'll send you the link if you haven't seen it.
And it's called, Where is AI and GDP statistics?
filling the measurement gap came out from a couple of days ago.
And they argued that essentially AI, quality adjusted AI output is up more than 2,000% per year.
They come up with estimates of like $250, $300 billion on top of the...
But they essentially come to the conclusion that this is all true as long as you accept our redefinition of GDP.
And of course...
Ah.
Right.
Right.
Right.
If you allow me to redefine your...
GDP, I could present you with some tremendous
numbers. And the entire paper
is absolutely fascinating
as an example of what's often
called motivated reasoning. I need to
believe this. Therefore, I
construct an argument to allow me to continue
to believe it in the way I get there
is by redefining
a variable that's already very squishy
in the first place. Let's not pretend that
measuring GDP is
much easier than like, I don't know, measuring
muons in a cloud chamber or something.
It's still very hard. And we're about to, you're
trying to make it harder to justify something, that's just not defensible.
And the AI dark output one is great because they,
substitution dark output is work that was previously done by humans and is now done by AI.
In our dark output monitor,
we have identified roughly one and a half trillion dollars in tasks that current AI
could substantially augment or automate,
to which I say, why hasn't it done it?
Right.
It's that, this is the AI thing, though, because
specifically with AI.
With other things,
productivity is hard to measure.
It's hard to measure
outputs with workers
in knowledge work
especially.
It's doable,
but it's not like a linear path,
except you're selling a tool
that can theoretically do anything.
If this did what they said it did,
we would have gunfights in the street.
We would have the destruction
of most knowledge work,
and it would be happening a year ago.
It would be half happening.
year ago, happening fully today, we would have the destruction of law firms. We'd have the
destruction of hyperscalers because anyone would just be like, build me a Microsoft word, and it would
build them a Microsoft word, and they would use it, and it would be functional, bug-free,
all of these things. They would be, well, I mean, we've already seen a spike in litigation
from pro se people representing themselves, but nevertheless, we would see law firms turning
into two or three person shops that would beat the leading litigators because they would have.
Oh, absolutely.
It would be very easy to see.
In mid months, Toronto, pride is an opportunity for you to create your own space, to celebrate your existence.
Iheart Radio is proud to be an official sponsor of Pride Toronto Festival, and we won't stop.
Celebrate Pride.
Turn up the love and listen to IHeart Pride Canada, your 24-7 radio stream and the only playlist you need for
your Toronto Pride celebrations. Pride is so great because it gives a whole bunch of people
this visibility that they've never had before. We have a ton to celebrate Toronto. Happy Pride.
Iheart Radio. Run a business and not thinking about podcasting, think again. More Americans
listen to podcasts than ad-supported streaming music from Spotify and Pandora. And as the number
one podcaster, IHearts twice as large as the next two combined. So whatever your customers
listen to, they'll hear your message. Plus, only IHeart can extend your message to audience.
across broadcast radio. Think podcasting can help your business. Think IHeart. Streaming, radio,
and podcasting. Call 844-844-I-Hart to get started. That's 844-844-I-Hart. Hey, I'm Hoda. Kotby,
host of the podcast, Joy 101 with Hoda-Kotby. Together, we're going to have meaningful conversations
with the world's most fascinating people, like when actress Olivia Munn shared how she
overcame fierce health challenges. I've gone through breast cancer and then helped my mother through breast
cancer, and that was more difficult. There's a lot of people who understand postpartner depression.
I was not prepared for postpartum anxiety. Listen to Joy 101 with Hoda Kotby on the IHeart
Radio app, Apple Podcasts, or wherever you get your podcasts. A decade ago, the ethanol kingpin of Iowa
became the king of corn in Brazil. So we met with a lot of larger farmers, went from Bahia to
to Tokatine's to Montegrozzo. And he brought a team of executives. They were going to help the country
get in on a gold rush.
Carbon and its derivatives are going to be really the next great commodity that the globe's going
to trade.
But back home in Iowa, trouble was brewing.
If you live in Iowa, your land, your water, and your voice could all be at risk thanks
to a man named Bruce Rastetter.
Now, people are questioning if his climate solutions have anything to do with climate
at all.
You got to give Bruce and the guy's credit.
They're Republicans.
They don't give a shit of money.
It's now.
On this season of drilled, Carbon Cowboys, the star.
story of how the ethanol kingpin of Iowa became the king of corn in Brazil and what it tells us
about the limits of technology and markets to solve the climate crisis. Listen on the IHeart Radio
app, Apple Podcasts, or wherever you get your podcasts. I'll give you a related example, which made
the rounds yesterday, and it kind of gets to the heart of this misunderstanding, is there was
someone who shall remain undame but has a popular newsletter and used to work at a certain venture fund,
put out something about, put out the radiologist, the radiologist paradox, which was the idea that back in 2016, Jeffrey Hinton, computer sciences and Nobelist, a really pioneer in image models and deep neural networks, said in a talk that within five years, if not 10 years, a large language, deep at the time, neural networks learning models would be better than radiologists and there's really no reason to continue training them.
Now, of course, he said 10 years on the outside.
Well, it's now 10 years later.
And if you look at the data, we're continuing to produce more radiologists.
And that analyst then put out a note yesterday, and so did I think KOTU or someone else.
And said, like, well, checkmate.
Jeffrey hinted, look, we have a lot more radiologists.
And of course, this is a classic example of a profound misunderstanding of so many things it's hard to keep track.
One is that, again, it's not clear that being selectively better than radiologists at certain things like identifying, I don't know, prostate cancers or whatever else.
Obviously, that's not good enough.
Radiologists do more than that.
But it also misunderstands the nature of the employment market because radiologists, like most of medicine, has created a very comfortable little cartel for themselves.
So even if there was Gale Force winds blowing at radiologists because of any,
AI, the likelihood of you seeing it in such a short time, even if Hinton was right that they could in theory replace a significant slice of what radiologists do, it's a misunderstanding of the nature of the markets themselves. So it misunderstands both the technology and the nature of cartelized employment markets, whenever you have these kinds of arguments. And yet, it's used as an example of how the inexorable march of these things continues apace and it will always be augmenting. And I
just think there's so many sort of nested
misunderstandings of how
what pressures
AI is having on employment markets
and how we might see it,
where it might show up, then to take it
up a level, to then do these
calculations and say, oh look,
I can now come up with a defensible measure
of how the augmenting function is
working and then incorporate that in GDP.
I kind of have to say
bullshit. No, you can't.
Also, we're failing at the simple stuff.
also just a very simple response is, okay, let's say it can identify them better than a radiologist, right? Now what?
Right. The radiologist, though, it's, they don't just look at stuff like they are doctors, they've required, like, there's more to the process than just like, yes or no. And also, you are buying the experience. You're buying their experience and their connections and their ability to work within a hospital system. And there's, and there's tremendous papers on this, by the way.
And treatment.
Oh, absolutely.
Showing how models...
What do we do next?
Right.
Models in general, in a medical context,
and this is writ large,
applies to models use
in all complex environments.
They tend to over-triage trivial cases,
meaning that if you come in
with like a cut,
they're like, dude, this could be sepsis.
Let's take you in
and start doing tissue biopsies.
And it's like,
no, no, it's just a cut.
Leave me alone.
And at the other end of the extreme,
a woman comes in with chest,
well, with pain in her back,
which sometimes is indicative
of some kind of car.
cardiac event, they're like, yeah, it's probably just a strain. And so this idea of marching
straight through and saying that the only thing that matters is the input data, and therefore
I can use these things in these complex environments. We know these tendencies towards overtriaging
trivial cases and under triaging critical ones. That's also true, just as a side note,
I gave a talk about this recently to the Fed, where I was showing how models do the exact same thing
in financial markets, where they tend to become overaggressive when they should be conservative
and vice versa, which leads to much more fragility in financial markets, and yet, you know, we march on.
And this is the deep problem, is this kind of complete misunderstanding of the nature of how these things respond in these complex environments.
And then the systemic consequences of doing it. Like, for example, you replace radiologists with something with a tendency to over-triage. Guess what you're going to get?
Far more testing, much more testing getting done, which may or may not be profitable for hospitals, but will have cascading consequences for people who have to have follow-up.
biopsies because of things that look like
possibly malignancies and turns out
they weren't. And what we know for medicine is
that for the most part, most things should be left
alone. Yeah.
And again, I keep
coming back to the really simple thing, which is
if these things
were going to replace people,
they would just do it. They wouldn't
be, everything wouldn't, I keep
saying this, but everything wouldn't read
like the Redler wrote it. It would just, every
single AI jobs
thing is like, well, it's AI affected
careers that might be doing this in this time, in this way.
There was a CNBC headline last year.
It was like 11% of jobs can already be done by AI.
But when you looked, it was like, yeah, it was a labor simulator we made.
Right, right.
We didn't like, we didn't like, try.
It was the same problem with the meter studies, obviously, in terms of the duration, right?
The duration of tasks.
The METR, right, that one.
Right, right.
And the duration of tasks where you can get to 50% likely.
of completion. And of course, if that was a human, using that as your as your benchmark,
if that was a human, I would fire those guys, right? I mean, that's not a useful measurement in
terms of how a human might think about a productive coworker. I don't think about you as half
the time you get shit wrong, right? That would be kind of, that would be something that would
probably lead to review problems at the end of the quarter or year. And so we do, what's the
line? Sam Harris's line, this is playing tennis without an ad, right? Yeah. It's just this
And it's also just, we treat these things like they're fucking gifted children.
It's like, wow, you could 50% of the time do this maybe.
And that is, it's time for the New York Times to write an entire article.
We need an odd lots episode that covers that 50% of the time this could do this.
And it's just because you can't do the thing that every other obvious innovation has done.
You can't do it where you just go, wow, this does this.
We could do this now.
It's if this happens, and that is a load-bearing if, we might be able to possibly do this.
We can't measure it in the way you measure other things, which is how we would otherwise
distinguish whether something was good or not.
So we made up a new thing.
And wow, has it beaten the benchmarks we made up for it?
Right.
And the problem, of course, is this all becomes a bit facile and glib and everything
else in terms of the arguments being made. But it has spillover consequences in the real world,
which is the unfortunate thing, is that let's follow the logic forward. If my job is I'm selling
tokens and tokens, I need to sell more tokens rather than less because I have to pay the knot
on some fixed obligation, well, I'm going to construct more data centers and construct more larger
data centers. And you end up with these massive mega projects like this controversial one that
Kevin O'Leary has been promoting.
Miss the dog ship.
Right, north of Salt Lake City,
you know, that in the limit might be the size of Manhattan
or larger, as people point out.
This has consequences because the arrow of time only moves in one direction.
I defy you to find an example of, you know,
the old talking head song where this used to be a parking lot,
now it's covered with flowers.
The data center is not going to reverse.
Once you build these giant things in the real world
with real consequences in terms of, you know,
sprawling out physically but also sitting on top of water and power,
untangling that becomes really, really difficult,
as does, for example, having to spin up all of these new natural gas plants to power these things
because we're increasingly asking that hypers come with their own power behind the meter.
Yeah, behind the meter, yeah.
Right, right, right.
When we're doing that at the worst possible time because the combination of batteries
and alternative sources
ranging from wind and solar, for example,
are becoming much more effective
and able to be more persistent with battery backup,
and yet we're installing these CO2 intensive things
with 30 and 40-year lifespans funded by debt
that are almost all likely to end up being stranded assets.
They'll be like the statues at Easter Island eventually,
except natural gas plants.
Well, and this is what I've been saying,
it goes back to the dot-com thing I was saying.
It's not like, an incomprehend,
complete data center, which I think the vast majority, I don't think any of these things get
finned, the vast majority of them don't get fully powered. Like that's sure. I think anything that's
targeted over a gigawatt doesn't get finished. It fully agree. And the funny thing is with that is
people like, yeah, the dot-com bubble when at burst, people had the useful infrastructure.
That will cost just as much to finish in the future, except the debt, you'll go to a credit for,
you'll go to a, well, probably not private credit in the end of this, but go to a bank like, yeah, I want
finish this data center, they will shoot you with a gun.
They will, you will get headshotted by the bank manager for saying the words AI.
It's just, and it's, these things are going to be everywhere.
I'll give you an even more, it's an even more insidious than that.
And I spend a lot of time talking, trying to talk off the ledge, if you will, various regional
economic development people.
I was just talking to some people in New Mexico about this.
and the problem they have is
they've been trying to land
some large employer for 25 years
in these high unemployment regions
and so I'm entirely sympathetic to the problem
that a data center hyperscaler shows up
and says listen
let me install this, give me the following
giveaways with respect to taxes
and this will eventually
after construction we'll have this many jobs and so on
and you don't have to keep fighting for the Hyundai Battery Factory
or the Ford Assembly plant or whatever else
it'll just be here spinning off tax revenues.
And so what happens is, A, that looks like a pretty good bet
because it's a fixed obligation in terms of what will be flowing back into your county for years to come.
And what do they do then?
They start pre-budgeting that and saying, okay, we'll start building new playgrounds,
we'll start fixing the water supply, we'll be able to fund schools.
Great. Now, okay, you've front-loaded all of that stuff.
What happens whenever the data center doesn't get finished?
You're actually in a worse situation than you were previously.
So it has real world consequences in terms of these annuity streams that are being dangled in front of people whose regions have suffered economically for decades.
And that's going to be the story over the next 25 years.
Yeah, it's going to be years of data center collapses.
Even after the AI bubble bursts, in my opinion, there's going to just be years of this.
Because you're already seeing a lot of this stuff is speculative.
And even then, even if these things get turned on, as you said at the beginning, we are in an era.
where people are going to be trying to cut back on costs.
But then that's the really basic answer.
What do more data centers do?
What do we get out of these?
Because Open AI has more compute than anyone.
What are they doing?
What's the difference?
What does?
I keep hearing the term AI factory.
And I'm like, what do you mean?
What do you mean by that?
Or a factory full of geniuses.
That's my favorite.
Oh, the data center.
Oh, geez, a data center full of geniuses.
I really dislike Dario Amaday.
I hate how he sounds.
I hate how he speaks.
Just like,
what are you fucking talking about?
Because more data centers so far has not actually improved these products.
It's not.
Like,
there's not,
if you gave OpenAI another 15 gigawatts of data centers doesn't exist,
but let's say they did.
Nothing.
Like,
nothing is going to change about this.
Yeah.
I don't,
and I don't think,
but the other thing is as well,
hey, is Vera Rubin going to make AI profitable?
Because if it isn't, this is probably the last generation.
That is, I think, at this point, the thing.
I think very much so.
And I think that's one of the other consequences here that's going on.
And I think it's one of the reasons why, and I don't know if you've noticed,
but the Jensen has gone from being very promotional to extra special vary to the third power promotional.
In terms of, I saw today he was anointing Marvel as the next.
X trillion dollar company.
And for me, this is really unprecedented, but it only works if you start thinking about it
in terms of the ecosystem of buyers and sellers in the context of AI CAPEX and realizing
that the more valuable all of these companies become, the more money is sort of flowing around
this, what we used to be called like a captive economy.
And then it just recirculates amongst all the players as they become increasingly wealthy because
their stocks get bit up.
And so this notion of having people suggesting that one of their sort of people, you
or quasi-competitors should also be valued at a trillion dollars is really unprecedented.
And you can only really understand it once you understand it that they are all essentially
running printing presses in their basement and the printing press is their stock.
And they're hoping that the value of the printing press and the currency keeps going up.
And that way they can circulate more script among them, which in turn turns into purchasing.
And that's the fundamental circularity at the core of all of this.
So as we wrap up, I wanted to get, like, because I've already had emails and texts somehow, I don't know how they got my number.
What do you think of this, what does this Google thing mean? So Google doing their $80 billion raise at the market. What does this tell you?
Well, a couple of different things. One is that this is the equity raise?
Yes, exactly. So $10 billion from Berkshire and then some other, like $10 billion for Berkshire and then I think two different at the market sales.
Yeah, so, I mean, so this tells you that the appetite continues to be incredibly high for their pay, for not for equity, which is surprising because for the most part, the funding has been increasingly moving towards credit, obviously, right?
Yeah.
And because of the saturation of their cash flows with respect to having to sort of inoculate themselves against all of the other commitments they have.
My favorite example being that Microsoft's a good example of this is that their stock-based compensation is.
so high that they have to, which is obviously only handled through cash flows, that the way
they inoculate themselves against it is they have to do stock buybacks. And once you start doing
that, you've got a much larger commitment of cash, which forces you after you pay for hyperscalor
data centers. You then have to start doing raises off balance sheet using SPVs and other
kinds of funding vehicles. So that they're able to do this is sort of surprising to me to a degree
that there's still this much appetite for non-credit equity financing of some of their future obligations
because it gives you no call on future cash flows. So what's in it for you as a provider of equity here?
It's not clear.
Yeah. Is it also a sign that the debt is running out?
Why would they do this instead of raising debt?
So there's no question about that as well. So that's the other side of this is that as of Q1, 2020, what a year are we in?
26, I have to look around the room. That's bad.
So as of Q1, 2026, the hyper-scalers are now the largest issue of investment-grade debt on in investment-grade markets worldwide.
They just passed the banks.
So yes, the other answer to this question is there is a capacity issue with respect to the further issuance of investment-grade debt.
In a weird way, they would actually be better if they were issuing junk high-yield because there's a higher appetite for high-yield,
but they just so happen to be currently anyways, prime credits.
so they're issuing investment grade,
and the appetite for that stuff is finite,
which is why increasingly the marginal buyer
for the most recent credit issuances from the hypers
is the usual suspects,
like European insurance funds,
Middle Eastern sovereign wealth,
these are the people who famously tend to show up
at the end of almost every bubble,
and so here they are at the door again.
So yeah, do you think that this is toward the end?
I'm not asking for a hug.
No, no, no, no, I think very much that.
I think the blow off top is the, is the, this year's three mega IPOs,
and that kind of marks the gonging of the bell with respect to,
take the seriousness with respect, you have to take this inability of these companies to make money.
Paul, it's always such a pleasure to have you.
Where can people find you?
Paul Kedroski.com is the best place.
Hell yeah.
Everyone, thank you so much for listening.
I'm, of course, Ed Zittron.
You can catch me on this podcast, better offline.
Where's your ed.com.
subscribe to newsletter to my principal form of income. I will be back with a monologue on Friday.
Thank you all for listening and goodbye. Thank you for listening to Better Offline.
The editor and composer of the Better Offline theme song is Mattersowski. You can check out more of his
music and audio projects at Mattersowski.com. M-A-T-T-O-S-O-S-K-I.com.
You can email me at E-Z at Better Offline.com or visit Better Offline.com to find more podcast links
and of course my newsletter.
I also really recommend you go to chat.
Where's Your Ed?at to visit the Discord
and go to our slash Better Offline
to check out our Reddit.
Thank you so much for listening.
Better Offline is a production of Cool Zone Media.
For more from Cool Zone Media,
visit our website,
coolzonemedia.com,
or check us out on the IHeartRadio app,
Apple Podcasts, or wherever you get your podcasts.
Joy is essential and it's also elusive.
But now, there's a new and exciting way
to start your journey toward a more joyful existence.
Joy 101.
It's a new podcast hosted by me, Hoda Kotby.
If you're craving inspiration to maximize your joy,
tune into these candid, uplifting,
and moving on-air chats.
Open your free IHeart Radio app.
Search Joy 101 and listen now.
Joy 101 with Hoda Kotby is presented by CVS.
Hey, this is Chuck from Stuff You Should Know,
and we're submitting our most sciencey episodes
for your peer review with our new stuff
you should know doing science playlist.
Out now.
You want to know about Occam's Razor?
Simplest explanation is usually the right one?
We got you covered.
Wondered what chaos theory is
ever since the first time you saw Jurassic Park?
Well, come on down.
So distill a nice pot of tea, everybody,
turn down the gas on your Bunsen burner,
and slip into your most comfortable lab coat
and listen to the stuff you should know
doing science playlist
on the IHeart Radio app,
Apple Podcasts,
or wherever you get your podcasts.
Here's something that should not be as complicated as it is, getting a racist statue removed.
And here's something that should be a whole lot easier than it is, getting a new one put up in its place.
I'm Akila Hughes, and Rebel Spirit Season 2 is about both of those things.
As I was watching these statues come down, I was thinking about what it meant that I grew up in a majority black city,
in which there were more homages to enslavers than there were to enslave people.
Listen to Rebel Spirit Season 2 on the IHeart Radio app, Apple Podcasts, or wherever you get your podcasts.
June is Black Music Month, and on the Drink Chams podcast,
we're speaking with the hottest names in the culture, like Sway Lee.
Do you realize how legendary you are?
I appreciate that.
I'd be seeing it, but I'm like, man, I still got, like, so much more to do.
Like, Prince, he dropped, like, 30 albums.
We dropped, like, five right now.
That's the rate we gotta be going.
Yep, that's a good attitude.
No matter the era, Drink Chams brings you the biggest names
and the most unfiltered conversations.
Listen to Drink Chams from the Black Effect Podcast Network
on the IHeart radio app,
Apple Podcasts,
or wherever you get your podcast.
This is an IHeart podcast.
Guaranteed Human.
