TBPN - Thinking Machines’ First AI Model, California Loses $3.2B to Texas, TSMC Adds $100B | Diet TBPN
Episode Date: July 16, 2026Diet TBPN delivers the best of today’s TBPN episode in 30 minutes. TBPN is a live tech talk show hosted by John Coogan and Jordi Hays, streaming weekdays 11–2 PT on X and YouTube, with ea...ch episode posted to podcast platforms right after.Described by The New York Times as “Silicon Valley’s newest obsession,” the show has recently featured Mark Zuckerberg, Sam Altman, Mark Cuban, and Satya Nadella.TBPN is made possible by:Ramp - https://ramp.comPublic - https://public.comCisco - https://www.cisco.comConsole - https://www.console.comCrowdStrike - https://www.crowdstrike.comFigma - https://www.figma.comMongoDB - https://www.mongodb.comNYSE - https://www.nyse.comRailway - https://railway.comShopify - https://www.shopify.com/Follow TBPN: https://TBPN.comhttps://x.com/tbpnhttps://open.spotify.com/show/2L6WMqY3GUPCGBD0dX6p00?si=674252d53acf4231https://podcasts.apple.com/us/podcast/technology-brothers/id1772360235https://www.youtube.com/@TBPNLive
Transcript
Discussion (0)
We have a very special show for you today because we have Tyler Cosgrove guest hosting.
He's here in chair.
And I know I'm going to make mistakes today because I always throw it over to Jordy.
I got to remember this.
Tyler, it reminds me of this video from Warren Buffett.
We got to play it to show what I'm going through emotionally today without Jordy in the TVPN Ultradome.
Let's pull up this video of Warren Buffett throughout the years at the Berkshire Hathaway shareholder meetings.
Warren Buffett always goes to Charlie after he gives his comment.
He gives his speech and then he kicks it over to Charlie.
Charlie?
Charlie?
Charlie?
Charlie?
Cheeriegerker.
Yeah.
Makes me want to cry.
It's emotional.
Charlie, me.
Charlie?
Charlie.
That's Greg Abel.
So if that happens today, I apologize.
But the first big story is, of course,
Thinking Machines' new model has released.
Miramaradi's AI startup.
release its first model in bid to loosen AI Giants grip.
We're going to be talking about open source, closed source, where the frontier is,
national geopolitical model moves.
And some people had an idea this was going to happen, some inkling.
Oh, they have an inkling.
Did they?
I didn't have an inkling that they were going to jump into the open source rate.
I think it's actually, I think it makes a lot of sense given the Tinker API, right?
The whole business is, you know, you're doing fine tuning on open source models.
Yeah.
It makes a lot of sense that they're going to have their own.
Yeah.
that you can easily.
It's sort of like they are set up as a business to launch an open source model
without it degrading any other piece of their business
because the Tinker API, that fine-tuning that they do,
that integration with the customers that they have actually benefits from open source.
And then they can go to their clients and say,
look, you know, it's the red hat model at any time you can leave
because we are giving you the weights of the model, open source.
You can do whatever you want with them.
but keep working with us because we're helping you a bunch and we're making money in the process.
So Thinking Machines Lab, the first model is an open weights model designed to chip away at the lead of OpenAI and Anthropics, says the Wall Street Journal.
Former Open AI Technology Chief Miramir Maradi is betting on more customizable artificial intelligence models to chip away at the lead that frontier labs, such as her former employer, hold over the technology.
TML, a company led by Muradi, released its first AI model Wednesday and did it with open weights, meaning that others can modify it with their data, called Inkling.
The model has 975 billion total parameters, making it far smaller than estimates of the most advanced closed source models.
So only, I think the number is 41 billion of those are actually active at any moment.
Yeah.
So this is definitely on the bigger side of open source models.
Sure.
Yeah.
But like that number, it's not, these aren't like dense models like what you traditionally think of.
Sure.
Of the models like, you know, four years ago.
Yeah, yeah.
Muradi told the journal, we trained it to be a broad, balanced foundational, foundational,
model, strong across many domains, flexible enough to adapt. Inkling is not the strongest overall
model available today, open or closed, which is a different frame of reference for many of these
model launches. Everyone's been jockeying for the frontier, even if they're not world-class
at everything. Usually when they launch, they say, oh, well, we're best at something or we're best at
this, but a different tone, different communication strategy. And I think it's being well-received.
I think people are having fun with it.
Yeah, I mean, I think the main pitch here is that this model is, like, uniquely set up for the Tinker API.
It's built to be fine-tuned.
Sure, sure.
That's the whole point.
Got it.
D.D. Das says, thingy machines just drop the best open-weight AI model outside of China.
And obviously, that is a big topic of conversation as business leaders in the United States have some policies and some reticence about using Chinese open source models, even if they're not worried about the dystopian, you know, manuring.
candidate hidden inside the weights. Maybe they just want to be aligned with a U.S.-based company for a
variety of reasons. Inklink beats Nemotron 3 Ultra, and benchmarks put it between Kimmy K2.5 and 2.6.
Of course, there's also news today that Kimi K3 will be launching and is another jump forward,
but there's back and forth between some AI researchers around what's going on there, how long
that strategy will continue. So, D.D. says, many were contended.
to this throne, but thinky has come out on top. Really solid release and will pair well with
Tinker, so there are some benchmarks that you can go and dig into if that's your thing.
There's another very bullish take from Jack Morris of Engram Labs. He says people are
underestimating what a big deal this is. This is the only open weight model that's trained
without distilling for open AI, from open AI or Anthropic. Kimmy distills, GLM distills, GLM,
distills, Nemotron distills, Kimmy and Deepseek, which count, basically a fully different tech stack, the first pure open frontier coding model. Very exciting. And there's a community note on this. Can you break down exactly like where are they standing on the shoulders of giants? Where are they not?
So I think this tweet is not exactly true. In the blog post, they say to bootstrap post training, we ran an initial supervised fine tuning on synthetic data generated by open weight models, including Kimi K2.5. Okay. So I think that's like, just a short term.
generally how people think of like distillation, that they mean something related to this.
So I think that actually is not that different than what the people at, you know, at Nvidia with Nemetron did.
Sure.
So this is not like very new, I think.
But it's sort of like the lightest touch of distillation that could happen because it's just one piece of the pipeline, one small amount of data.
It's not one of these scenarios where we're like, why is it identifying as Claude or why is it just saying that it's chat GPT?
But it is funny because you can kind of say like, oh, well, if this is like kind of distilled on Kimi and Kimi's kind of distilled on closed source.
Yep.
Well, then maybe you get some kind of two-layered dissipation.
This sort of round-trip loop.
But at the same time, there's probably something to be said for the more layers of abstraction.
The more, you know, ingredients you pour in, like the distillation becomes weaker and weak.
Yeah.
And I think there's also an important question of like, well, okay, they're doing some level of distillation.
Like, why?
Because you can either be like, well, they're just doing it to save time, whatever.
Like, obviously, they have these capabilities, but there's no point in, you know, doing everything over again.
You might as well just use what's out there already.
Or is it because these capabilities that they get from this, you know, distillation, light, whatever it is,
are those actually super imperative to the model like being good?
And Grimm says our founder, Jack Morris, recently issued some unfounded claims that got community.
Noted, we deeply apologize for the confusion caused by his original post, the follow-up post and the follow-up to the follow-up post.
Nevertheless, we stand by his conviction in his own takes and in strong open source models like inkling.
And there is a question of like distillation is a vague term where it's not a binary thing.
And if it's not in the pre-training data, does it count?
I think it's also very much this.
This means people love to talk about on X.
Yeah.
They like to kind of scapegoat.
Oh, you know, it's all distillation.
That's the only reason Chinese models are good.
Yep.
Is that actually true probably?
I mean, Anthropics head of national security policy, Taran Chabra, accused Zipu, z.A.I.
of distilling both Claude and Open AI models for GLM 5.2 at the Aspen Security Forum earlier this week.
This is from Vincent Chow, senior AI reporter at SCMP.
He said it's the first time that they've named Zipu specifically after previously calling out Deepseek,
Ali Baba, Moonshot, and Minimax join the club at this point.
Also accused, they also accuse Deepseek of continuing its adversarial campaign of distillation.
Anthropic is now shutting down distillation accounts on the order of millions accounts of per week.
That is crazy scale.
I mean, you always think about it as like, oh, there's like shut down that one company or shut down that one block of IP addresses.
But when there's a really, really distributed attack, we've even heard about whole companies that just like resell clawed tokens or GPT's 5.6 tokens.
and that looks like a reasonable business because it's just a wrapper company, of course.
You want to work with them, but then you don't realize that on the other side, who are their
customers? Why do they, why did they get to 100 million run rate so quickly?
Well, maybe it's a lab that's trying to distill through this pass-through entity.
And of course, it's hard to like watermark the tokens once they go out the API and they get
passed through some other system and they can go through other countries, all sorts of things.
So millions per week, that is crazy. That's got to be really difficult to, uh,
It's a game of whackamol.
They say, GLM is, quote, probably the most advanced Chinese model on the market now,
which poses significant cybersecurity challenges.
They hinted that Anthropic will expand access to mythos to ensure fair fight for cyber defenders.
And they said that distillation challenge is real in shrinking U.S. lead in AI,
suggesting that the U.S. government could do more to clamp down on Chinese model adoption globally
by working with allies similar to trusted telecom efforts like Huawei and ZTE.
So obviously a hot topic and people will be debating how exactly how heavy of a hand the government should be put in.
I think this release is also makes a lot of sense.
I think it was a week ago there was that article about like Beijing isling at curbing overseas access to Chinese top AI models.
Yeah.
Right.
So you're not going to be able to access the Chinese open source, right?
It makes a lot of sense to start doing American open source, Western open source.
Yeah, it really does feel like there's a pretty wide.
It feels very well-timed.
Yeah, it seems like there's a pretty wide gap between.
between at least what's reported preferences from Beijing, from the actual government and the companies.
The companies are like, send us all the NVIDIA chips, let's distill everything,
and then let's open source these models and compete internationally.
And Beijing's like, maybe we need like an indigenous supply chain here.
Maybe we need to lock down these models, keep our lead over here, go work internally.
I don't know.
This was an interesting post from Grace Lee.
she asked the question, how did Open AI soul finally learned design taste?
She projected a thousand websites by GPT 5.6 soul into a design manifold and discovered big holes.
These holes were where GPT 5.5 previously generated outputs with, quote, bad AI smell.
So there were, you know, there's these tells in any AI model, but it's not this, it's that, the M-Dash.
Once people start identifying those as, ah, we don't like that.
that, it's too AI, it's too generic. One way it appears to actually sort of beat that out of the model
is to actively avoid those specific things. And then she calls out three particular areas that have
been avoided as anti-patterns. One, the bento box layout in dashboards. Two, large typefaces and
hero images. I did realize that sometimes you would ask for a website and you would just get a massive
block of huge text. And that's just not the way when you land on a beautiful website.
It's usually there's more wordsmithing.
There's more terse language.
Well, you know, you make your first website with five, six whole or whatever, and it looks really good.
Yeah.
And then you make tan and they're like, oh, okay, there's actually a lot of patterns I'm seeing.
Totally, totally.
And you can start clocking them like everywhere you see.
You see a lot of like clodisms, whatever on general design.
You see them everywhere.
Yeah, especially if you don't come with any opinion.
You know, it's like the, you know, high border radius on the edges.
There's a little color on the side.
Yeah, yeah.
Especially if you don't come with like an opinion.
If you come, like, we made a whole vibe-coded website in Codex for just the latest episode of Nick Bostrum on Joe Rogan.
And I wanted it to look like a UFC fight card and a fight promotional website.
And it doesn't look like any like normal AI slop.
I mean, there's still like AI generated images.
It looks like AI.
But it doesn't look like, oh, yes, that's the bento box layout, or that's the offset layout, or that's the purple, or it's stealing from linear.
It's a completely different style.
So if you at least inject like one reference point, you'll usually land somewhere.
Yeah.
I mean, it's interesting, though, this makes it seem like the new model is not necessarily,
it doesn't have like higher variance with outputs it gives, but we basically just found like,
oh, there's certain examples that people really don't like.
Let's just remove those.
But you're not necessarily like making the model more creative by removing these like patterns
that always comes to.
Yeah.
Well, you're giving like the flavor of creativity.
and maybe that's...
Yeah, but you can imagine
if we kind of keep the same model
for six months,
we'll just notice new patterns.
Totally.
And you'll have this kind of...
But at the same time,
like Mid Journey had like a very distinct look
and people like that look,
at least some people.
And so if you can quickly
personalize and customize
and land in a place where
someone whose job is designing dashboards
is happy every time with the layout.
Like there is somewhat of a platonic ideal
for some of these design patterns.
And at the same time, if you're, yeah, working on certain, like, there's certain designs that are just, like, solved.
Like, you know, make the call to action green, blue, not red, right?
And so some of those, like, do need to be consistent.
And then also, I imagine that many folks who are using these tools, like, in enterprises, are doing, even if it's not a fine tune, they're uploading a reference for everything that they're designing.
so it's consistent with the brand that they've designed.
Yeah.
Anyway, California Forever lost a $3.2 billion shipyard project from Defense Startup Serronic
after the company chose the Port of Brownsville, Texas over Solano County.
Oh, no, you're not supposed to clap for that.
We got a Texan in the studio who's happy about that.
This is bad news for California.
We want California to have a whole bunch of amazing stuff.
Brandon Corral, who wrote the newsletter, TPPN.com today, was very very,
disappointed about this. The automated shipyard, known as Port Alpha, is expected to create
roughly 10,000 permanent jobs along with thousands of union construction jobs. Supporters say California's
lengthy approval process ultimately cost the state one of the first marquee tenants that California
forever had pointed to as evidence. Its planned city could anchor a new era of American shipbuilding.
Joshua, executive director for the California Alliance for Jobs, said California failed to move with the
urgency the product required, quote, while Texas moved quickly and aggressively, thank you, Jackson,
California could not provide clear expedited approval process needed. He said, calling the decision
an enormous loss for Solano County, California workers, and our state's manufacturing economy earlier
this year, California Forever signed a 40-year construction labor agreement covering 70,000 acres,
and labor groups later backed legislation to fast-track environmental review and permitting for the proposed
shipyard. The legislation has yet to advance. Instead, Texas approves.
approved a $211 million tax abatement package in June to secure Seronics investment at Brownsville,
roughly 20 miles from Starbase.
Labor leaders said they warned that without expedited approvals, the project would leave the state,
and that is exactly what happened.
A project insider told the San Francisco Chronicle that California Forever itself remains on track,
but acknowledged that losing a major defense contractor sends a powerful signal about the state's ability
to compete for large industrial investments.
It's very disappointing.
But I like Yan, I like the California Affair Project, and I'm excited for where he takes it next.
I'm sure he's on the hunt for the next major tenant.
Got to talk about TSM.
Yes, TSMC.
TSM both beat earnings and raised their CAPEX guy.
They're spending a lot more money.
Pledge to invest an additional $100 billion in the U.S.
plans to spend a record amount, cementing its position atop the global semiconductor supply chain.
Yes.
And yeah, they're investing another $100 billion in Arizona Fabs, but people are worried about overspending.
The news is that the NASDAQ's spending plans offset by strong results.
Very, very odd story that in a time when even TSM, which was not a particularly AGI-pilled company for a long time since they've been through the smartphone boom, so many booms and busts, so many cyclical build-out cycles.
that when they are finally like, yes, now is the time.
People are, I don't know.
They're skeptical.
In Creator World, there's some news from Colin Samir.
Lexus is now the official car of Colin and Samir.
What does that actually mean?
They made four ads for them that roll out across YouTube.
They're sponsoring four videos on their channel.
It's the first of its kind deal that represents broader shift taking place in media,
the aperture of what it means for a brand to work at the country.
creators changing quickly. It's very cool to see because obviously they've been on YouTube for a long
time. They've done a lot of like host red ads, mid-roll ads, but this is a much deeper
integration and something that I think will be hopefully replicated all over YouTube and
be a new source of revenue for creators of all kinds. So I was excited to see this. In other
entertainment news. Jake,
from Economic,
says this is almost hard to believe.
Disney spent
$129 billion
acquiring Marvel, Star Wars, Pixar, ESPN,
and Fox, which is $182 billion
in today's dollars.
Throw in all their legacy assets
in the entire company's market cap today
is $169 billion.
Wow.
Do you know what this picture is missing?
Which?
What do you mean?
So, they're saying they acquired all these assets,
and the company is only worth $169 billion.
What's missing from this analysis?
The cash that's been returned to shareholders.
Disney across dividends and buybacks has returned like $70 billion, maybe more, to shareholders,
which is, I don't know, I just thought this.
And it is, it is an interesting angle because they have spent a lot acquiring,
and the company is not worth more than what they acquired.
So there's this question of like, were those acquisitions of creative or destructive?
or dilutive. But there is a whole separate picture, which is that a lot of cash has been returned
to shareholders throughout this journey. Yeah, also, I mean, that's the mechanism with which
those acquisitions were funded also should. Yeah, matters a lot. I don't know. It was sort of interesting.
Sean Frank has a pitch. He says you should move to New York City. Bro, you got to move to NYC.
The weather? Horrible. 100 degrees. Easy. AC. F that. Taxes so high. Rent. Highest in the country. Air quality.
the worst in America. Tech, bro, we banned. Do they really ban Waymo in New York?
I believe so. Yeah, there's no Waymo. Wow. That's very wild. Yeah, if you can make it here,
you can make it anywhere. So, I don't know, do you ever have aspirations to move to New York City?
At some point, it seems... You've been to New York City. Yeah, yeah. It's a nice city. That's the thing,
is that all of this is true, and it's still a great city to hang out. It's so fun, so dense.
You can see so many people walk around. It's beautiful. It's just like, I don't know, it's unlike anything
else. Still great, but yeah. You never lived in New York City. I've never lived in New York City,
but I've spent a lot of time there. So I've had a good time. Thank you to everyone who tuned in in the
chat. Thank you for positive reviews of Tyler. Let us know anything of Tyler. Leave us a review
on Apple Podcasts and Spotify. Write us an email. Tell us how he did. I think he did fantastic.
Have the best Thursday of your life. Yes. There you go. That's a good impression. That's a good impression.
But thank you. Sign up for a newsletter at TBPN.com, and we will see you on Monday.
See you. Goodbye.
Oh, we got the flashbang. There we go.
