TBPN - IBM's AI Rollercoaster, Demis Calls for AI Watchdog, NY Pauses AI Data Centers | Diet TBPN

Episode Date: July 14, 2026

Diet TBPN delivers the best of today’s TBPN episode in 30 minutes. TBPN is a live tech talk show hosted by John Coogan and Jordi Hays, streaming weekdays 11–2 PT on X and YouTube, with each episode posted to podcast platforms right after.Described by The New York Times as “Silicon Valley’s newest obsession,” the show has recently featured Mark Zuckerberg, Sam Altman, Mark Cuban, and Satya Nadella.TBPN is made possible by:Ramp - https://ramp.comPublic - https://public.comCisco - https://www.cisco.comConsole - https://www.console.comCrowdStrike - https://www.crowdstrike.comFigma - https://www.figma.comMongoDB - https://www.mongodb.comNYSE - https://www.nyse.comRailway - https://railway.comShopify - https://www.shopify.com/Follow TBPN: https://TBPN.comhttps://x.com/tbpnhttps://open.spotify.com/show/2L6WMqY3GUPCGBD0dX6p00?si=674252d53acf4231https://podcasts.apple.com/us/podcast/technology-brothers/id1772360235https://www.youtube.com/@TBPNLive

IBM is absolutely nuking. The stock is down 25%. Boom. IBM, well, that is a crazy chart. What is that the one week chart? It looks better on the five year because the stock is actually way up in the AI era since the launch of ChatGPT. IBM has done really, really well. The stock has basically doubled since the introduction of ChatGPT during the AI era. You know, are you going to be a winner or a loser? Are you going to get steamrolled sloped, something like that? But it's been doing well up until to day when the company reset the narrative around their server business specifically. So the high-level reason that IBM is not well positioned in the token path to use the Brad Gersner and Gavin Baker Parliands is that AI spending is currently flowing into GPUs, memory, networking, hyperscale cloud computing and frontier model inference. IBM is not a major winner in those categories. So just to

refresh on IBM, because it's interesting business with a great name, international business machines. The first business machines they made were punch card systems. They made clocks. It's like you're running a business. You need a great clock. You're going to need a great clock. You're going to need a clock. No, that really was part of this. Not just any clock. Like a clock that works really well. That's right. Professional clock. Clock pro max. Exactly. Clock pro max. It's lighter. It's the lightest that is best looking. Not fastest. You don't want a fast clock. But tabulating machines, basically a bunch of different ways to process information. mechanically. And that foundational insight, you know, was pretty simple. It was businesses will

continually pay forever to automate record keeping. And at a high level, that's sort of been working forever. And they're continuously through. You know if they ever tried to sell a clock as a SaaS product, time as a service. Hmm. If you really, really squint Red Hat Kubernetes, it's keeping time between distributed systems. Maybe there's something there. But When you're running a database across a bunch of different servers, there's some timekeeping aspect that's important. But no, I don't think they ever did. The IBM, the people know the mainframe business, that started in 1964. System 360, it was a compatible family of devices, which is interesting.

It's not just one, people think one mainframe, but it was actually a whole bunch of different systems that you can upgrade piecemeal without redesigning the entire workflow. So you need a little bit more storage. You upgrade that. You need a little bit more compute. you upgrade that. And this turned IBM into the dominant supplier of corporate computing banks, insurers, airlines, manufacturers, governments. They all used IBM as the central system for their hardware and software.

This was the mainframe era. And the whole reason that IBM in particular became dominant in mainframes was they focused on high reliability, long customer relationships, expensive switching costs. It's very difficult once you're in the IBM ecosystem to weed your way out, proprietary software tied to the hardware, certain things. software would only run on IBM hardware so you couldn't re-platform. You had to rip everything out, which is very difficult for a large bank or a large airline in the 60s and 70s. Good for business. And they also had huge, huge support and consulting contracts associated with all the software and

the hardware that they were delivering. Sort of a precursor to the Ford deployed engineer, if you squint a little bit. But the PC era was the real turning point. So the IBM PC launched in 1981. This legitimized the personal computing market and set up two new companies, Intel and Microsoft to capture immense value during the next computing boom. So the IBM PC ran Windows and used an Intel chip. At the time, IBM was doing 30 billion in revenue. Intel was doing less than $1 billion, and Microsoft was only doing $17 million in sales. And so I think Microsoft had like 120 employees. And all of a sudden, those two companies became ultimately way, way, way bigger, like 10 times as big. So the market eventually fractured and proposals to break IBM into

separate companies started to pop up. The market fractured because once you had an Intel chip set and Windows operating system, you could run Windows on a different chip set and you could have a different chip set with different operating system. And the value capture piece, there were just other PC manufacturers that came in and then obviously Apple with their, you know, anti-AIBM like challenge the man campaign. So the market was fracturing and there was a bunch of proposals during the 80s and 90s to break up the company into separate units. Lou Gersner, who became CEO in 1993, rejected that idea. And he said, quote, we do not necessarily need to manufacture every piece of technology.

We need to be the company that makes all of it work together. So we have to work together. We're going to be the integrator, the systems integrator. His strategy ultimately produced three things. IBM Global Services, large outsourcing contracts, and a vast consulting organization. And that's a lot of what we know about IBM today. So services businesses do have limitations, though. Lower margins, higher head count, slower organic growth, price competition, etc.

In 2019, IBM acquired Red Hat for $34 billion and spun off its traditional managed infrastructure outsourcing business in 2021. So today, you can think of IBM as sort of three key businesses. They have software, which is 44% of the business. That's an 80% gross margins, great business. 31% of their business is consulting. That's under 30% gross margins, though. And then 23% of the business is infrastructure, which is just shy of 60% gross margin.

And so for the last three years, the stock's been doing really well. well, up 77% before dividends, and the Red Hat acquisition started paying off. And the Z17 mainframe cycle was surprisingly solid, but the problem is that they just called out a shift away from mainframe spending with customers shifting capital spending towards the physical AI buildout, demand for AI and associated hardware is strong, but IBM is losing share of their customers' technology budget. IBM still does have a strong asset for the AI era. Red Hat OpenShift, which is their enterprise Kubernetes platform for orchestrated. workloads across multiple computers. But there are so many other companies offering AI capabilities

up and down the stack that they're getting a little hammered today with the biggest share drop in its 115 year history. Rough day for IBM. But an interesting story nonetheless. Demis Hasabas from DeepMind, the DeepMind chief. He is called for a U.S.-led body to test frontier AI models. He says, society has a precious window to prepare for technology advancing at historic speed. He's a Nobel laureate. The Financial Times has the story, and there's an article that he posted on X that will sort of click through and give you the takeaways. From the Financial Times, Google Deep Mine chief executive, Demis Heshabis, has called for the creation of a U.S. led standards body to test new frontier class AI models for national security threats,

arguing that urgent action from international regulators is needed to address the risks posed by rapidly advancing technology. I'm surprised, has he never proposed this before? This feels like something that has been proposed many, many times, but maybe I'm just misremembering the AI 27 people and the AI 2040 people and the Open AI white paper and what Anthropics said. It feels like we've seen this before, like we need to have a regulatory body of some sort. all the way going back to when the All In podcast was talking about an FDA for AI back like two or three years ago. But it's now here, and it's coming from a deep mind executive, which hits a little harder. The warning from Hasabas, a Nobel laureate who leads Google's AI efforts,

follows the White House's abrupt export ban on Anthropics' most advanced models last month, alongside a fresh wave of warnings about the potential for AI to disrupt the global economy and financial system. We talked a little bit about the economists that got together with a much more moderate, I think, because it wasn't actually calling for any sort of change to the development of AI whatsoever or the rollout. And they were just saying it could get, AI could get better in the next 10 years. Yes. Which is a very sort of. Could get a lot better.

That's what they said. They didn't just say better. They said a lot better. But the actual pitch from the economists was we need to have economists and government officials think about responses if there is. is job displacement from AI? What is the impact? What will the reaction be? So to sort of like prep the legislation. So you can be more ready when things start to happen, whether that's retraining or stimulus or jobs programs or all sorts of different things. So this intervention from Demis is the most detailed proposal yet for AI regulation from Google, which is vying

for AI leadership with Anthropic and Open AI. Quote, we've already seen the challenges frontier models pose for cybersecurity, good point, and other threats, including nuclear and bio-risks, may soon emerge as capabilities continue to advance. The rapid progress we're seeing in AI requires a new approach to testing frontier AI model capabilities that is dynamic, adaptable, and rigorous. The U.S. is well positioned, given its economic and technical standing to take the first step in developing such a framework. My big question is, it seems pretty easy to go to the leading labs and say, hey, you have to go through this process, but do we have a good framework in the United States for reviewing code that China just sort of throws over here open-sourced?

Because, I mean, as we've seen with the Kimmy K-2 and GLM, like, if you tie someone up in an FDA-like review for even six months, let alone a year, let alone what the FDA timelines are for drug development, five years, ten years sometimes, you are going to have open-source models that are way, way more advanced. So there's the name. New Frontier model is going through a six-month review, let's say. Maybe it's really like a one-month review, and then there needs to be... With AI, it could be a two-minute review.

I would hope. But let's say it's like a three-month delay or six-month delay. Then when it eventually does get released, it gets distilled likely within even less time than that is publicly available. I would like to see... So we keep seeing these letters and proposals. And they always come, one, with a request for urgent action, but they rarely come with super concrete scenarios, like near-term scenarios. I want, here's what's going to happen in six months. Here's what's going to happen in 12 months.

Or even just like a trigger. Like, it would be interesting if somebody said, if the unemployment rate goes above 10%, I would recommend a stimulus check of $1,000 be sent to everyone and mean. test it so it only goes to the middle class and lower class. Like that is a very reasonable thing. That's basically what happened during COVID, right? Like the unemployment rate went to 15% and then boom, there were checks in the mail. And that's a very concrete proposal that you could say, if this happens, then this happens. Yeah, I want, I want someone like Demis. Basically, the, world of less wrong and AI 2027 and 2040, they're willing to lay out super concrete scenarios. and they can at times come across as very sci-fi.

Yeah, yeah. But there's always, at least so far, been some element of reality in them. I hear what you're saying. I want somebody who's like generally more like kind of moderate to come in and just say like, here's a few potential scenarios and this is what I think. Because I don't believe it's, you know,

Demis could suggest what he thinks that the government should do. The U.S. government in this case, he's, you know, encouraging like the U.S. watchdog. He's in London, though. So I think it's going to be on our lawmakers and our government to understand in these different scenarios, at least start thinking through in these different scenarios, how would we approach them? Yeah, I just, I always have a problem with the timelines and predictions because those can get so nitpicked and they're so hard. I'd be more interested in less of like, no, but don't you think that'd be helpful if, if, I don't think it's

helpful. No, no, no, I actually don't. I think it's much more helpful to say if the unemployment rate goes to 10%, create a new government body that hires people to do something. Like, create the next TSA. I just think, or send out similar checks or lower interest rates, right? If you tell Washington, D.C., AI models are very good at hacking computer systems and they're going to get better at hacking computer systems. There's not really much for them to do with that because hacking computer systems are already, it's already illegal. Yeah. And the solution there is for companies to beef up their own cybersecurity, make sure they're using the most advanced models. Yeah. And so if you play out more concrete scenarios where like, here's a timeline

for the trucking industry and potential job displacement within trucking or any of these other categories. I just think it allows people in Washington, actual lawmakers, to start thinking about. I just think that's always wrong. Like, they're always wrong about those predictions. It's so much better to just say, look, if the trucking industry goes through mass, job displacement, then here's what I actually propose. Here's the solution. As opposed to just saying, like, there might be a problem, and I think that there's a problem coming down the pipe. I don't know. Like, it's like, what are you actually advocating for other than just being like, the sky might fall? I have a P-dume of this number, and it's your job to go figure it out. It's like, you're smart.

What do you suggest? UBI? Higher taxes? I just don't think predictions are always wrong. There's been so much, so many examples over the last decade where people have gotten predictions, like, dead on. Yeah, yeah. ...Cyrational awareness. Tyler, what do you think about this? Yeah, I mean, I'm probably in the camp of, like, proactive regulation. Like, usually, like, has had bad consequences. It doesn't really work out.

But also, I was just going to say, like, what he's describing is basically just Casey, the Center for Ais and Incination, which is under the Commerce Department. Yep. And it's, like, a slightly beefed up version because right now Casey is, like, very much you opt in. Yeah. But it seems like he should just have said, like, you should specifically beef up Casey, add these policies, do these specific things. And I think that would be much more palatable or well received or like something.

Like what do we actually do with this letter? It's kind of very, you know, like I'm not sure what we actually do with this. Yeah, it feels like if, I mean, to go back to cybersecurity, it's like if it's a national issue, like the NSA works on this stuff, increase their budget, maybe, raise taxes to increase their budget, issue more debt to increase their budget. If it can be solved by the private market, it's like go support crowd strike or start a new company that can help.

with cybersecurity? I don't know. The actual concrete recommendation boiled down from what Demis wrote is something along these lines. Create a U.S. Frontier AI Standards body. That's like Casey, but probably more beefed up. He's also advocating that it's overseen federally but funded by AI companies. Define and regularly update benchmarks to determine which models and labs qualify as frontier. So that's something that doesn't exist yet. Require frontier labs to, submit models for testing up to 30 days before release. That's sort of nice because that would allow someone who's just going and building a recommender system on Netflix that's actually, it is using AI technically, but it's not a frontier

model because it doesn't qualify for that. So then they can just go and ship the latest recommendation algorithm on Netflix, no big deal. Test models for cyber biological nuclear, deception, autonomy, and guardrail passing capabilities require strong cybersecurity, personal vetting, model cards, watermarking. and substantial safety research, use national labs, federal agencies, and independent third-party auditors to conduct evaluations, develop independent confidential tests, so labs cannot train specifically against the benchmarks, require labs to fix serious vulnerabilities discovered after release, apply the rules to all frontier models deployed in the United States, including foreign and open source models,

while exempting smaller models. Okay, so he wants to apply it to foreign open source models. That feels very tricky, but I guess you could get like sort of DMCA notices to Hugging Face and GitHub so that it doesn't proliferate across the web. Yeah, I mean, there's probably some power a lot to like where people are actually downloading and inferencing the model.

And I guess if you go to all the Neo clouds and all the open source folks and you're like, okay, this model is actually a bad model, you got to go, you got to stick to GLM 5.2. Yeah, it's much easier to regulate the compute. This is going to be very controversial to the open source fans.

Yeah, this is kind of like the George Hoss's nightmare tape. Yeah. tagging every single GPU. For sure, for sure. Coordinate a slowdown among Frontier Labs, if testing reveals sufficiently serious risks and turn the US framework

into an international system of shared frontier AI standards. Well, I like the general direction. I like the idea that he's just sharing his viewpoint more broadly. I think all of that is good. I'm not sure that there's enough to dig into here exactly how this would, like where the rubber meets the road,

how this would be implemented, or what effect this would actually have on the industry. Like, this could be really good for open source because it could just slow down the frontier closed source labs. It could also be really bad for open source if it's much more cumbersome because an open source project might not have a regulatory budget to actually massage a model through the approval process. Like there's a reason why small biotech companies get acquired by Big Pharma before they launch their drugs. It's because the big pharma companies have offices in Washington, D.C. and can walk

the legislators through the whole process. So in general, I'm sympathetic to the view. where people say, oh, regulation benefits the biggest companies in the world, because historically that's how it's played out. Maybe that's different this time. Who knows? It could just slow down the frontier. But, you know, he does work for a leading lab. So what's going on in New York?

I will tell you what's going on in New York. Today, New York Governor Kathy Hochel signed an executive order placing a one-year pause on new AI data centers in the state. This is the wamp. for everyone, except 70% of Americans. But the order establishes a moratorium while New York develops a regulatory framework and conducts environmental impact assessments, examining data centers energy demand, water use, water quality, air quality, and effects on the electric grid.

You would think there's a decent amount of oversight around those things generally already, air quality, like whether you start a new barbecue restaurant or a coal plant, you would imagine that there's just a general rule about not polluting the atmosphere that would apply to data centers by default. But it seems like there's a little bit of a special case here, and so they're working on this in particular. The move immediately drew criticism from the tech industry, which argues that restricting data center construction will cost local communities, jobs, and weaken America's position

in the global AI race. Earlier this year, Maine considered a similar moratorium, but Democratic governors, Janet Mills vetoed the proposal after concerns it would block a major data center planned for a town, still struggling after the closure of a local paper mill. Hocchel's Republican challenger, Bruce Blakeman, also opposes the moratorium, arguing that local governments, not the state, should decide whether to approve projects that promise significant economic benefits. If it stands, the order would make New York the first state to impose a broad moratorium on large-scale AI data centers. There hasn't been that much of a data center boom in New York State that I'm aware of.

It'll be interesting to see how they define AI data center. Will they do it on energy or what type of GPUs you're racking or what's going on there? But more to dig in. Ken Griffin was on Goldman Sachs's podcast, the Exchange's podcast. The Exchange's podcast. And it was circulating this week, even though it was, I think, recorded last month. And he was talking about how, yeah, in his view, what an error this would be to the data centers are going to get built. And if they're not built here, that means hundreds of billions of dollars of revenue, basically flowing, flowing through other countries, right?

Other countries, I mean, it'd probably go to other states first, right? Well, he was talking about it. Oh, if it goes national. You know, if New York does it, there's going to be a lot of other states. Yeah, the meme is like China wins in this scenario. U.S. Senator John Federman. Yeah, we did this with nuclear. We did this with manufacturing.

Yeah. And I'll agree. We're mistakes. There's also an article in the Wall Street Journal. Can a prettier data center curb the community backlash? People have been batten this idea around for a while. But let's pull up this image and you tell me, would you be okay with this going into Malibu?

The Malibu Compute Company. Would you be cool with this? If it was puking out diesel fumes 24-7? If it was clean and it didn't drive up energy, didn't use any water, it was all closed loop, and it looked like this. Tolerable, right? I wouldn't just be okay with it being in my town.

I'd want it in my backyard. Yes. True Yimbi over here. That's right. In an effort to soothe local opposition architects planned data centers that resemble tech campuses or art museums rather than bland boxes, you have to imagine that the money that they're spending on the data center for a facade like this has got to be very, very cheap by comparison.

It looks like a slat wall. Less. And all of a sudden, just every time it screenshotsed, like there was that odd Google presentation where they were in front of those crazy tanks, and they put the logo on there, and it made it look like they were taking like a brewing facility and turning it into a data center. But it was just for the press release.

The data center was actually somewhere else, but it was just sort of like an odd image. Americans are up in arms over data centers. Of course, we know this. They worry how much water these buildings use and fume at the amount of electricity they consume. People hate the way they look, too, says the Wall Street Journal.

Now a small number of builders are on a mission to ensure that new data centers don't have to be eyesores, Gensler, one of the world's largest architecture firms, is leading the charge. It's drawing up plans for data centers that look more like Silicon Valley Tech campuses or art museums rather than windowless rectangles that neighbors often grouse about resembling prisons. It's no different than any other building, and it doesn't deserve to look any worse than any other building, said Jeffrey Diamond, a design director at Gensler. Yeah, see, this is just very rough.

Yeah, not good. That is objectively in the back. You got to do more. Yeah, yeah. People will push it to the limit unless there's some pushback. But in other aesthetically pleasing AI development news, Clanker media shared that researchers built a soft floating robot for indoor interaction. And for so many of the AI robots, of the humanoid robots that we see on this show are

lovecraftian and horrific. this is so cute. I want one. Don't you want one? Just floating around answering your questions? These have the, this has the potential to be a,

like a massive hit as a consumer product. It uses helium and flapping fins instead of propellers. Extremely cute. The result is quiet, lightweight, and safe to touch. It can follow people,

give reminders, and act as a study buddy. So you can be studying in this whale can come up next to you and answer your questions about your math homework. See, I don't even need it to be smart. No. I just wanted to fly around.

Load it up with GPT2. It's good enough. No. Before we jump, I got to talk about my dear friend Brandon. Jacobi, who I saw in the chat earlier, launched his new studio, a multidisciplinary design practice for those who challenge the boundaries of technology. He combined a Star Wars intro style. video with a barrel, a wave.

A barrel. Oh, cool. Okay, I'm visualizing that. I think he made this for us. Okay. Do you want to pull it up? Look at this. Wait. Motion design. Oh, interesting. Yeah, this is both of us.

Our interest. Yeah, this is perfect. He made the launch video for an audience of two. For some reason, I was imagining the text curling up like a wave and it being sort of hard to read, but this is much better. I love it. It's a good statement. Brandon and I... This is a mission statement. This is an essay.

Worked together for a few years. And he was doing this. He was one of the first personnel news we did on the show. We tracked his move to X, everything else. But anyways, he's been doing this kind of work forever. He was a design lead at X as well as Cash App, as well as My Last Company. And he's incredibly talented. So he's open for business.

Fantastic. Leave us five stars on Apple Podcasts and Spotify sign up for our new. newsletter at tbpn.com and we will see you tomorrow goodbye