TBPN Live - Sam Altman LIVE on Sora, Hollywood, & the Future of Ads | Bill Peebles, Dylan Patel, Elad Gil, Robby Stein, Morgan Housel, Misha Laskin
Episode Date: October 10, 2025(02:32) - 𝕏 Timeline Reactions (16:29) - Softbank Pursues $5B Loan (28:18) - China Races to Buy NVIDIA Chips (33:06) - 𝕏 Timeline Reactions (56:31) - Sam Altman, CEO of OpenAI &... Bill Peebles, Head of Sora, discuss the advancements of Sora, OpenAI's AI-driven video generation platform, highlighting its enhanced physics understanding and user-friendly creation tools that have led to a high user engagement rate. They emphasize the importance of continuous innovation and the potential for AI to transform content creation, while also addressing the need for responsible management of AI-generated content and the protection of individual likenesses. Altman also touches on the challenges of scaling AI technologies and the strategic decisions involved in resource allocation to support ongoing development. (01:28:19) - Elad Gil is a prominent entrepreneur and investor, known for co-founding Color Genomics and investing in companies like Airbnb, Coinbase, and Stripe. He discusses the transformative potential of AI in professional services, emphasizing how AI can automate repetitive tasks, enhance productivity, and significantly improve profit margins. Gil highlights the opportunity to acquire traditional, labor-intensive businesses, implement AI to streamline operations, and use the increased cash flow to scale through further acquisitions. (01:57:37) - Robby Stein, Vice President of Product at Google Search, discusses the integration of advanced AI technologies into Google's search engine, highlighting features like AI overviews and AI mode that enhance user experience by providing quick, relevant information and enabling natural language queries. He emphasizes the importance of accuracy and quality in AI responses, leveraging Google's extensive search history to improve results, and addresses trust concerns while encouraging businesses to adapt their content strategies to align with AI-driven search advancements. (02:17:32) - Morgan Housel, a partner at Collaborative Fund and author of "The Art of Spending Money," emphasizes that spending is more art than science, as individual preferences and life experiences shape financial decisions. He discusses the importance of distinguishing between internal and external benchmarks of success, noting that while external achievements are visible, true contentment often stems from internal satisfaction. Housel also highlights the significance of minimizing future regrets by focusing on meaningful experiences and relationships over material possessions. (02:44:38) - Misha Laskin, co-founder and CEO of Reflection AI, a startup specializing in AI tools for automating software development, discusses the company's recent $2 billion funding round led by Nvidia, which has elevated its valuation to $8 billion. He emphasizes Reflection AI's commitment to developing open-source AI models in the U.S. for global distribution, aiming to provide enterprises with compliant alternatives to existing models. Laskin also highlights the company's focus on co-designing algorithms with advanced American chips to enhance performance and competitiveness. (02:58:03) - Dylan Patel, founder of SemiAnalysis, discusses the launch of InferenceMAX, an open-source benchmarking suite that evaluates inference performance across various hardware platforms and models, aiming to provide up-to-date and realistic insights into LLM inference performance. He highlights the industry's need for standardized, transparent benchmarks to assess hardware efficiency and cost-effectiveness, emphasizing that InferenceMAX addresses this by benchmarking popular models on major hardware platforms nightly with the latest software. Patel also notes the significant support from major industry players, including NVIDIA, AMD, Microsoft, OpenAI, Oracle, and others, underscoring the collaborative effort to enhance AI infrastructure evaluation. (03:17:53) - 𝕏 Timeline Reactions TBPN.com is made possible by: Ramp - https://ramp.comFigma - https://figma.comVanta - https://vanta.comLinear - https://linear.appEight Sleep - https://eightsleep.com/tbpnWander - https://wander.com/tbpnPublic - https://public.comAdQuick - https://adquick.comBezel - https://getbezel.com Numeral - https://www.numeralhq.comPolymarket - https://polymarket.comAttio - https://attio.com/tbpnFin - https://fin.ai/tbpnGraphite - https://graphite.devRestream - https://restream.ioProfound - https://tryprofound.comJulius AI - https://julius.aiturbopuffer - https://turbopuffer.comfal - https://fal.aiPrivy - https://www.privy.ioCognition - https://cognition.aiGemini - https://gemini.google.comFollow TBPN: https://TBPN.comhttps://x.com/tbpnhttps://open.spotify.com/show/2L6WMqY3GUPCGBD0dX6p00?si=674252d53acf4231https://podcasts.apple.com/us/podcast/technology-brothers/id1772360235https://www.youtube.com/@TBPNLive
Transcript
Discussion (0)
You're watching TBPN. Today is Friday, October 9, 2025. We are live from the TBPN.
Oh, it's October 10th. I forgot to change the date on my sheet. It's good. Thank you for catching that.
We are live from the TBPN Ultrodome, the Temple of Technology, the Fortures of Finance, the capital of capital.
And we wanted to open with this post by Jira tickets. GAT says, don't worry about the bubble. If it pops, we'll just make a new bubble.
We got some guys who are really good at making new bubbles.
Bubble talk is all...
We used to pray for a bubble like this.
We did.
That was how we started the show.
We said lever up.
We said we're praying for a bubble while it's here.
People are starting to lever up.
And it's time to double down and support our strongest soldiers, those who are holding up the global economy.
And we are joined by some folks who are going to be holding up the global economy.
Sam Altman's joining in just 55 minutes.
Bill Pee.
Bill Peebles is joining, the head of SORA.
We also have a lot, Gil, Robbie Stein from Google, Morgan Housels coming on, talk about a book.
We have a couple other folks joining.
Misha Laskin, which was a $2 billion round that got out yesterday.
And we have Dylan Patel from Semi Analysis, talking about inference max, which is already putting the timeline in turmoil.
Folks are taking shots at AMD, but Dylan Patel says he has the data that can
that shows that AMD, in some cases, can be a lower total cost to own.
There are certain models that favor AMD, GPTOSS, might be one of them.
This is all from his new benchmark called Inference Max, where he's going to take us through it.
It's a fascinating project.
I think something like $50 million of capital was kind of marshaled just to run the GPUs,
to run the test, to run the benchmarks, because they run them every single night, and they vary different models.
It's incredible that Dylan's been able to marshal this.
amount of resources for effectively a test.
Yeah, and he makes no money from it.
It's free.
Obviously, people will work with semi-analysis at some point.
It's amazing, but basically all the different AI companies are in helping out with this.
So we'll dig into that.
Boston in the chat says bubble made of steel, hopefully.
A steel bubble.
What about a diamond bubble?
Yeah.
A diamond bubble.
I like it.
Something.
Something there.
You could still see through it.
In the meantime, let me tell you about Ramp.
Time is money, save both.
Easy to use corporate cards, bill payments, accounting and a whole lot more, all in one place.
Mark Cuban, Dylan Aberscato on our team says, Mark Cuban is the greatest marketer of all time.
Every video generated from his cameo includes brought to you by cost plus drugs.
Even when it's not in the prompt, he baked this into his cameo preferences.
So every SORA post he appears in is an ad for cost plus drugs.
I love how shameless Cuban is about promoting cost plus drugs.
drugs. A lot of people become a bean air. They lose the ability to just be shameless. Not
Mark Cuban. He, at every possible chance, even on our show, I think he was promoting cost plus
drugs. And I do think the beautiful irony here of him, you know, not too many months ago,
saying, you know, we need to make sure that ads aren't in LLMs. He's the first person
to incorporate ads into SORA. Of course, not a language.
model, but still brilliant. I had this idea, too. I'm bummed that he scooped me, did it first. I did go
into my prompt and I put, always depict me as a bodybuilder. And it works really well.
Yeah, I didn't really think about it. Except to your credit, you don't look that much different.
Thank you. Thank you. The Open AI team was playing around. They made a video with John and Bill
yesterday and they texted Ben they were like by any chance did John like do some type of prompt
that depicts him as having very large muscles because I guess they were trying to in a suit and
they're trying to make it as accurate as possible of course represent me appropriately and
they just keep getting results of this like extra burly businessman but it's having a lot of fun
so yeah I mean if you're playing around on cameo I highly encourage having some fun with that
with that prompt throw brand in there throw a description I saw
someone that said that they always want to be depicted with an Adamar Pig Gay watch on
the wrist. There we go. So no matter what you prompt, they get an AP on the wrist, which I love.
If you want to know, you can go to bezel.com. Get bezel.com. Your bezel concierge is available
to source to any watch on the planet. Seriously anyone. Tom Osmond in the chat says,
Gents, how's the horse? The horse is fantastic. Can we pull up the horse cam? Checking in on the
horse. Yes. Never been better, folks. Thriving after its first full week.
in the old town with us.
The horses streamed live to all platforms thanks to re-stream, one live stream, 30 plus destinations,
multi-stream and reach your audience, wherever they are.
Lots of good questions coming in from the chat.
Fannis says there's a downgrade on the quality store generates the last few days.
Have you noticed that?
I have.
It's hard to really tell.
I haven't.
I generated a few collabs with Sam and Bill last night.
I thought they were fine.
They were good.
They take a minute, but it's not noticeable, to me, at least.
Interestingly, I have noticed that the SORA app sometimes can't just load normal videos.
The generation actually works fine for me.
Interestingly, it feels like they're CPU poor, because just the loading the actual feed sometimes loads and then just doesn't play.
So there's something going on there where they're just scaling all parts of the system, I'm sure,
because I've seen some videos on SORA that now have like thousands of likes.
which is clearly an indication that there are a lot of people watching.
People consuming video on the platform.
Palanteered says the channel Palantirred, of course, says OpenAI dropping 25 billion on a data center in Argentina, deserves a triple-com.
I hadn't seen this.
This came out this morning.
OpenA.I.
Energy Way, a $25 billion Argentinian data center project.
Wasn't there also a bailout of Argentina or something?
Well, yeah.
So while Open AI and Sir Energy here working on a 25 billion.
dollar data center project, Bessent is like figuring out how to bail out the Argentinian government
for just 20 billion. Yes, yes. There's this hilarious post by Alpha Picks. This was sent into our
group chat like five different times. This is Besson, wake up, espresso shot. 13th on Bloomberg
quiz, bail out Argentina. And it just says it's a shot of, a screenshot of a Bloomberg terminal.
And I guess this is from the quiz that goes out. He got a 242 score. He's 13,000. He's 13.
It just says anonymous U.S. Department of Treasury.
Of course, it could be someone else, but it's very funny to imagine.
I like that a lot.
Anyways, this, I guess, news leaked of opening I and Sir Energy.
They signed a letter of intent in LOI.
Let's give it up for LOIs, carrying a lot of weight these days.
For a data center project in Argentina requiring an investment of up to $25 billion,
the project would involve a large-scale facility with a capacity of up to 500 megawatts
to support advanced AI computing.
a government statement structured under Argentina's R-I-G-I tax break scheme, which went into
effect last year.
The project, if completed, would be one of the largest technology and energy infrastructure
initiatives in the country's history.
So I'm sure we'll get more news here.
But another day, another multi-billion dollar announcement from...
There was a moment when...
Whoa, Taylor Hodge in the chat.
Buenos Aires.
AI race.
Nominative determinism is going crazy.
There was a moment when the sovereign AI initiative was very much about building a data center
and then running open source software on it.
But I do think that it's not that unreasonable to say that it is critical to your geopolitical
strategy as a country to just have an open AI data center in your country.
Because then you have access to the open AI API API at lower latency potentially.
ChatGPT runs better in your country.
That could be not just profitable from like a business perspective,
but it's also a matter of like going where the energy is.
Like if you're a country that has cheap energy,
it makes sense to kind of set up infrastructure there
instead of trying to manufacture all of the energy in America,
build all the data centers in America,
and then just have all of the tokens flowing over the internet backbone.
I don't know.
It doesn't seem that great to me.
But the market is selling off.
It's very sad.
I wish we could be wearing white suits today, but it's a rough day in the market.
The Dow is down 1.25 percent, and the NASDAQ is down like...
One member of our team, who we won't name, was using leverage and opened up their brokerage this morning and immediately said, I'm chopped and cooked in a very genzy way.
At the team breakfast this morning, everybody got a good laugh.
So hopefully he'll be so back very soon.
Yes.
A rough one out there today.
Yes.
And the reason that most people are describing why the stock market is falling is because of a news from Donald Trump.
Before we get into reading Donald Trump's statement, let's tell you about Privy, wallet infrastructure for every bank.
Privy makes it easy to build on crypto rail, securely spend up white label wallets, sign transactions,
integrate on-chain infrastructure all through one simple API.
DJT should put ads in these posts so long. I mean, he's really actually maxing out the word count on some of these. But yeah, as John was saying, S&P. We talked about this yesterday. It made it to the front page of the journal today. Yesterday, China squeezes the United States in rare earth move. So China's newest restrictions on rare earth materials would mark a nearly unprecedented export control that stands to disrupt the global economy. That does not sound good.
giving Beijing more leverage in trade talks and ratcheting up pressure on the Trump administration to
respond. So we talked about this yesterday. We went through some of...
Isaac, foster in the chat, just says it just needs more leverage for the comeback.
100%. Get the intern more leverage. Make it all back.
Always lever up. So yes, yesterday we read through Dean Ball's analysis of the rare earth move by
China. There's some green shoots there. We do have, America does have some leverage.
but it's all in the backdrop of this larger trade negotiation.
Now, the United States government has responded.
Donald Trump has responded with this letter or this post on truth social.
I think they're just called Truths over there.
And the Kobe S.E letter kind of breaks it down.
Breaking the S&P 500 falls 70 points in seconds after President Trump publishes the below paragraph
about China.
Trump says he is calculating interest, increased tariffs on Chinese products.
Trump also says there is no reason to meet Chinese President Xi Jinping anymore.
And so we can read through a little bit of this.
It's a very long post.
He's becoming a thread boy over there.
Trump says some very strange things are happening in China.
They are becoming very hostile and sending letters to countries throughout the world
that they want to impose export controls on each and every element of production having to do with rare earths
and virtually anything else they can think of.
Even if it's not manufactured in China, nobody has.
ever seen anything like this, but essentially it would clog the markets and make life difficult
for virtually every country in the world, especially for China. We have been contacted by other
countries who are extremely angry at this trade hostility, which came out of nowhere. Our relationship
with China over the past six months has been a very good one, thereby making this move on trade
an even more surprising one. I have always felt that they have been lying in wait, and now, as usual,
I have been proven right. There's no way that China would be allowed to hold the world capital
But that seems to have been their plan for quite some time, starting with the magnets, in quotes, and other elements that they have quietly amassed into somewhat of a monopoly position, a rather sinister and hostile move to say the least.
But the U.S. has monopoly has monopoly positions also, much stronger and much more far reaching than China's.
I have just not chosen to use them.
There was never a reason to do so, until now, he says.
The letter they sent is many pages long and details with great specificity each and every element that they want to withhold from other nations.
Things that were routine are no longer routine at all.
I've not spoken to President Xi Jinping because there was no reason to do so.
This was a real surprise, not only to me, but to all the leaders of the free world.
I was to meet President Xi in two weeks at APEC in South Korea, but now there seems to be no reason to do so.
So pulling out of the talks.
The Chinese letters were especially inappropriate in that this was the day that after 3,000 years of bedlam and infighting, there was peace in the Middle East.
I wonder if that timing was coincidental, putting on the tinfoil hat.
Just noticing coincidences.
Depended on what China says about the hostile order that they have just put out, I will be forced as President of the United States to financially counter their move for every element.
They have been able to monopolize.
We have two.
I never thought it would come to this, but perhaps, as with all things, the time has come.
Ultimately, though potentially painful, it will be a very good thing.
In the end, for the USA, one of the policies that we are calculating in this moment is a massive
increase of tariffs on Chinese products coming to the United States.
There are many other countermeasures that are likewise under serious consideration.
Thank you for your attention to this matter.
And so the trade war is returning, and we will continue to monitor this.
situation. And again, don't need to freak out. The S&P's record high was just a couple
days ago. Yeah. And with all of these, you know, the tensions can ratchet up very quickly.
We saw this with the tariff tantrum, the liberation day, the massive sell-off, and then
quickly things were negotiated and largely reversed in many ways. A lot of companies got through
that. I mean, we just experienced this with base power, where we were like, so you're in a lot of
trouble, and then they got through it entirely, very quickly, and raised a million dollars.
Yeah, raising a massively oversubscribed round.
Yeah, but in the backdrop of like permanent tariffs, it was like, oh, that's rough.
Well, yeah, I don't think it changed their strategy. I think they always intended to set up the
factory in Austin. Of course. But I'm sure it's certainly accelerated.
Yeah, but they have, you know, they have to get certain, the supply chain is so global all
over the place that it was certainly a cause for concern. But, well, speaking of energy.
Oaklo, the nuclear company that Sam Altman backed years and years ago. I think he's no longer
on the board now. 2014. But Oaklo is up almost 10% today. So a little green in the midst of all
a lot of red. Well, let me tell you about cognition. They're the makers of Devin. Devon is the
AI software engineer. Crush your backlog with your personal AI engineering team. Pedro Domingos
has a chart from the Financial Times
showing the number of years after release
to scale the Internet versus just scaling ChatGPT.
And the Internet took 13 years to get to 800 million users.
ChatGPT took a little over two, maybe three.
So really remarkable.
And of course, the Internet is the greatest distribution engine
for products in history.
Like ChatGPT, yeah.
And so it is a very acceleratory effect.
Tron Ares is getting some reviews
The Telegraph had a headline today
They said, Tron Ares is so bad
It makes you wish AI would hurry up and destroy Hollywood
Long case for Sorrow
One out of five stars
I was so excited for Tron Aries
Populated by some of the most aggressively
Charmless characters ever seen in a blockbuster
Almost makes me want to see it now
I agree, I agree
I want to see it I love the first Tron
I'm optimistic that the second Tron
will deliver in one way or another.
Either way, should we go to SoftBank?
Masayoshi Sone is seeking $5 billion in a margin loan,
backed by Armstock.
He's love or not.
He's flush with Armstock.
It was the way he made his second $100 billion.
He made his first with Alibaba,
his second with Arm.
So SoftBank Group is in talks to borrow $5 billion from global banks,
refilling its coffers at a time.
Masayoshi Sone is accelerating the Japanese,
these investment firms bets on...
We've got to pause for one second and give Masa credit
for not top ticking Open AI.
He invested earlier this year, somewhere
around a $330 billion valuation.
A lot of people were saying, this is crazy.
They thought it was bearish.
Now, Open AI just closed a secondary or a tender offer
at $500 billion.
So nice little markup for Masa.
Hopefully he's been able to actually fund the entire investment.
I think there's a number of Open AI investors that have been working to pull the capital necessary together.
It was also a, it was a big jump in valuation at the time.
I feel like it was more than like a 2X step up or something from the previous round that everyone was talking about.
And so it was like, oh, okay, this is a big jump in valuation, but of course the business had grown.
And it was also, there was also that funny picture of Masayoshi Sown holding a crystal ball and then dropping
it, and you could read all sorts of things into that. But if you read too much into it,
you would be wrong because it's been on a tear, and he's done quite well. But now he is
levering up further. So SoftBank is close to signing a deal with a handful of lenders for a margin
loan secured by shares of its chip unit, arm holdings. The capital will fund additional
investment in Open AI this year, the people said, who asked not to be identified. A margin
loan is a type of facility where you borrow money using your investments like stocks as collateral.
a representative for SoftBank declined to comment.
SoftBank shares slid 4% on Friday, the most in September 26.
And Arm is down 8% themselves.
I wonder how much that is tied to the other stuff that's going on with global economy.
Part of it's Morgan Stanley lowered their price target based on the 2027.
For SoftBank or Arm?
Oh, for Arm.
Oh, for Arm.
Okay.
So that's a factor.
Yep.
So Sone has embarked on a spending spree this year to try and position the firm as a linchpin in the global AI boom.
most recently pledging as much as 30 billion
towards Open AI and buying ABB's robotics arm
for 5.4 billion.
I had no idea he bought an entire robotics division.
That's pretty cool.
Arms 38% rally this year
has in turn granted SoftBank the confidence
in leeway to grow its investment war chest.
SoftBank has raised a total of $13 billion
in margin loans from arm shares
with $5 billion still undrawn.
I wonder how much Elon took in margin loan
during the Twitter buyout
because I feel like some of that
was backed by Tesla stock
he was saying he wasn't going to sell Tesla stock
but then I think he got a margin loan against it maybe
I'm not exactly sure.
All I know is that X
the social media platform or Twitter
what was originally Twitter's like annual
interest payments were north
of a billion which was part
of what created urgency
to
merge with XAI
who had a obviously larger
valuation, and again, still putting pressure on the combined entity, but at least the equity
overall is marked up substantially. I think if I remember correctly, yeah, there was like something
around, I think it was like very levered. It was like something like they had like 30 billion.
Something like that. There were a couple different tranches and I don't remember the exact
details, but I mean, I was able to roll it into XAI and, you know, raise more money. And so,
you know these things can can kind of like you can you can move the chips around the board
for for years and and try different things to piece together value well if you want something
that you won't have to need you won't have to go into debt to sign up for because you can sign up
for free figma.com think bigger build faster figma helps design development teams build great products
together the group had secured about eight billion in margin loans ahead of arms initial
IPO in
23, 11 banks,
including J.P. Morgan,
Barclays, B&P,
Credit Agricola,
Goldman Sachs,
provided the facilities
by linking mandates
for arms IPO to loans.
Earlier this year,
the group also raised
a $15 billion
one-year facility
to help fund
AI investments in the United States
in what is among
its largest borrowings raised.
Soan's insatiable appetite
for deals
has extended far and wide.
I thought I was going to say insatiable appetite for leverage.
For capital.
It's also true.
Deals.
I mean, when should you have a satiable appetite for deals?
Everyone should have an insatiable appetite for deals.
Yeah.
centered on ideas to capitalize on the expected exponential growth of AI technologies.
His most ambitious projects include the $500 billion Stargate Initiative
that aims to build data centers across the United States in partnership with Oracle and Open AI.
SoftBank is also exploring the feasibility of large-scale industrial management.
Manufacturing Hub in the United States. That's cool, which would encompass production lines for AI-powered
industrial robots. That's probably a little bit further out, but pretty cool. SoftBank joins a wave of
big tech firms and investors plowing unprecedented amounts of capital into a technology with the potential
to transform industries and economies. But the flurry of deals and partnerships, many involving
Nvidia Corp and Open AI are escalating concerns that an increasingly complex internet...
Something that I want to understand better is how much chatter there was about the circular
telecom feels in like 1999 and early in the first quarter of 2000 because oh I mean by the first
quarter of 2000 it was like front page everywhere well things didn't really correct until
March yeah but I'm saying in 1999 the New Yorker ran a profile of Mary Meeker that's called
the woman in the bubble so like the New Yorker which isn't in the business of like calling bubble
early was just describing it, you know, like everyone agrees that this is a bubble and we're
profiling someone who's at the center of it. Yeah. In the New Yorker, which I feel like it's still
six months below. You know, over the last couple weeks, you can't scroll three posts. Yep.
Without seeing somebody, you know, posting some type of graphic or or meme or just general
concern for the circular nature of some of these transactions. Yep. The, you know, and Doug's point is like
from semi-analysis for Monday's interview is that, you know, the next leg up in the bubble
is leverage. But here, Morgan Stanley in this article, is estimated the amount of debt tied
to AI has ballooned to $1.2 trillion, making it the largest segment in the investment grade
market. It's pretty remarkable. Yeah, we were talking about like, when does the number actually
get big in terms of total debt? Because if you look at like the market for treasuries, that's obviously
way bigger or the market caps of all the hyper scalers combined, that's, you know, 10 to 20 trillion.
It's really, really big.
But one trillion of debt feels like a lot.
That feels like a lot.
And so I wrote...
But the notable thing here is understanding who is actually on the hook for the debt, right?
A lot of, I think, Open AI broadly has done, has made a extremely made it, had a focus of not tying the
debt to the actual for-profit entity, and then obviously not the nonprofit itself, right?
So the question is they can be at the center of all this, but they're not necessarily directly
on the hook for any of this, you know, 1.2 trillion.
Yeah, yeah, yeah. Where does the actual debt live? What is it entitled to? Does it have warrants
over equity? Like, all of that matters a ton. I wrote about the bubble talk in today's
newsletter. You can sign up at tbpn.com. And I was reflecting on 10 years ago in 2015, Sam Altman
was also being, you know, talked about, a lot of people were talking about the bubble. Vanity Fair
ran an article at the time that said something to the effect of like, like, we talked to multiple
experts in financial bubbles and they say it's going to pop any minute. And so Sam formulated this
bet and said that, like, look, I think he was the head of YC at the time. He was like, I don't
think we're in a bubble right now. And he framed it in three propositions that all had to come true.
So the first one was Uber, Palantir, Airbnb, Dropbox, Pinterest, and SpaceX. They were worth
under $100 billion at the time in 2015. By 2020, five years from then, he said they have to be worth
more than 200 billion. And second, he said mid-sized company, Stripes, Zenefits, Instacart,
Mix Panel, T-Spring, Optimizely, Coinbase, Docker, and Weebly together had to be worth over
27 billion. They were worth less than nine back in 2015. And the brand new YC Winter 2015 batch
needed to be worth over $3 billion. And what's crazy is that if you, if you just think about
those three buckets, which one, so Sam got two of them right, he missed on one, which one do
think he missed on? The big companies, Uber, Palantir, SpaceX, those ones needed to double. The mid-tier
companies, Stripe, Coinbase. I'm not going to pretend I know that he missed on the big, the public
company. He missed on the big companies, which is crazy because today, Uber's a $200 billion
company. SpaceX and Palantir are both at 400, 500, so you have over a trillion dollars now. But
he missed because a couple of those companies had kind of traded down that particular year. But he hit
on the second one, Coinbase obviously went huge stripe as well.
And in the third, in the YC Winter 2015 batch,
there was a company called GitLab that's already worth something like $7 or $8 billion
in the public markets.
And so he hit on basically all of them.
I still regard it as like he was very, very close to being just completely correct.
He did lose the bet.
But as we talk about another bubble, I was thinking about like,
should we have another framework for like where we expect things
to go in five years to assess it.
And I feel like energy is where we should go with this.
So in the newsletter, you can go read it.
I tried to formulate like how much energy
open AI will be consuming in five years in 2030,
how much energy data centers globally will be consuming
and how much energy will the United States be producing.
And there are obviously linear projections
of all of these, but I think Sam is bullish
on the idea of like we're gonna destroy those
those estimates and we're going to see significant build out and he's certainly doing deals to
make that happen. But I wonder how he would quantify it. So I'd like to dig in there. But first,
let me tell you about Vanta. Automate compliance, managed risk, improved trust, continuously Vantas
trust management. Platform takes the manual work out of your security and compliance process and replaces
it with continuous automation, whether you're pursuing your first framework or managing a complex program.
There's an article in the New York Times today on a Singaporean firm,
called MegaSpeed. The CEO has socialized with NVIDIA's Jensen Huang. Now the company is being
scrutinized by U.S. officials for its ties to China. So on a humid June night last year,
Jensen Huang, the chief executive in Vida held court with several of his company's major
Asian customers at a bar with sweeping views of Taipei. They stood and toasted the booming
artificial intelligence industry. Next to NVIDIA chief was a woman named Huang Lee or Alice
Wang, an executive of Singapore-based data center company called Megaspede, great name,
which was poised to buy two billion of Nvidia chips. Though Ms. Huang and Megaspeed are little
known players in the AI industry, their association with Nvidia and its CEO has recently
become a preoccupation in Washington. Commerce Department officials have been investigating
whether Megaspeed, which has close ties to Chinese tech firms, is helping companies in China
sidestep American export restrictions, according to more than a half dozen current and former
officials and other people familiar with the companies who spoke on condition of anonymity to
discuss an examination that is not public. The inquiry, which is active, calls into question
how closely NVIDIA is tracking where its AI chips end up and highlights the possibilities
of American export laws easily being sidestepped. Megaspede is also facing scrutiny from
Singaporean police who told the New York Times in a statement that they are investigating the
company for breaching local laws without elaborating further. As the dominant provider of AI
chips, Nvidia's annual revenue has soared. I'm going to skip over this because I know you already
know this. Yeah. So while you skip over that, let me tell you about graphite.dev. Code review
for the age of AI. Graphite helps teams on GitHub ship higher quality software faster. Continue,
Giori. Megaspeed illustrates the challenges facing U.S. government officials trying to keep China
from assessing powerful AI chips. After splitting off from a Chinese gaming company in 2023,
Megaspeed set up a subsidiary in Malaysia that quickly snapped up nearly two billion worth of
NVIDIA's most advanced products. Most of the
those ships came from the U.S. branch of a Chinese company that has already been sanctioned for
providing technology to the Chinese military, according to records obtained through import genius,
which is started by Ryan from Flexport.
Yes, that's right.
And his brother.
That was his first company.
That was his first company.
It's so funny that the whole like pivot to AI is not just a Silicon Valley American meme.
Like it's definitely happening in China too.
They're like, yeah, we're doing gaming.
But like, you know, this AI stuff is way better.
just pivot to AI, or like, high flyer being like, we got to, we got to get on the large language
model action.
High frequency trading is cool.
Yeah, it's cool, but like, let's just, let's focus on AI.
Yeah, so anyways, this story is evolving.
I'm not surprised to hear that, that, I mean, I think it's actually good that the
Commerce Department is, like, trying to figure out what's actually happening here.
I think there's been a lot of rumors floating around.
And, like, you know, data center companies in Malaysia and Singapore, you know, having, you know,
an extreme demand for chips and this sort of uncertainty of like, okay, who's actually paying.
Remember one of our first episodes, we read a Wall Street Journal article on Malaysia,
the Switzerland of AI, because everyone was building a ton of data centers there
so that they could sell inference or build token factories that would sell to both American
companies, Singaporean companies, Chinese companies, and it was kind of like this neutral
territory. But as the trade war heats up, people are going to want.
more answers, more analysis, they're going to want to understand exactly, you know, or any of these
things. Does every deal fit perfectly within the current restriction framework, right? Yeah.
Because obviously diversion is a natural thing. I mean, we've heard, we've heard stories of this
in the Ukraine-Russia conflict where companies will go, you know, entrepreneurs will go buy DJI drones
and then go deliver them and, you know, what are the actual restrictions on that? It all gets,
when the economic stakes are high
and things are trading at a premium,
you can literally, I mean,
we've heard this from,
there was one account of someone
loading the training data onto hard drives,
flying to another country,
doing the training run,
saving the weights onto hard drives
and then flying back.
And it's like,
that's kind of hard to predict.
That definitely is a run around
on the chip controls.
It's not the stated goal
of those chip controls.
But, you know,
when there's a huge,
dollars on the line and training runs are extremely valuable.
And I think it's, it's fair to kind of try to understand Ms. Huang, the CEO of Megaspeed's
background. She spent much of her career in mainland China, including working as a television
reporter from Chinese state media. Let's hear it for television reporters. One of us,
one of us. From being a television reporter to creating a new hyperscaler. I love
to do anything in this world. Who knows? I think we'll stay on
of that game, but good to see
that you can start content
go anywhere. We'll leave it to our friends.
Yeah. Good post here from
High Yield Harry.
Okay.
It says A16 Z and Sequoia co leading around.
It's the Crips and the Bloods. Is that what it is?
Uniting.
Uniting. Is that what's happening?
This is about Kalshi?
Referencing
Calshi
who followed Polly Market,
who announced their $2 billion
financing earlier this week from
ICE, not the immigration
branch of the government. And not the
international commodities exchange, the
intercontinental exchange. That's right. That's the name.
But Colchie raised 300 million
backed by Andresen Horowitz
and the
prediction market wars are heating
up dramatically. Coinbase, Google's
capital G, A16Z, and
paradigm, we're investing in this new, as well as Sequoia, we're investing in this new round.
And so by this point, everybody's sort of picked a side.
Yep.
And I would not want to be a net new prediction market company getting started today.
I think there's going to be an insane, the capital war is just starting in the category.
I mean, do you remember the capital war between Lyft and Uber?
there were, there were like three or four, probably 10 other companies that were in the ride
hailing industry. And they, like, they aren't public companies today. They either sold or pivoted
or found some other niche. But when you're in this like duopoly world and this capital fight
and there's maybe one that's running away one way or another, it's painful to be number three.
Colchie is on track to do $50 billion in trading volume.
Yeah.
And they did $300 million last year, so a pretty wild jump.
So competition is certainly heating up.
This will be an interesting one to watch.
Yeah.
Brandi Jacoby is putting another app in the truth zone.
What happened here?
Brookwell launched an app, I guess.
and Brandon Jacoby says, hey, Brookwell app, great design.
I was proud of it when we designed it for Capital in 2020.
So I guess this company, Brandon and I obviously worked together to design the app that you can see here.
Brandon is an incredible designer and spent hundreds of hours developing this experience.
And ultimately, I think Brookwell seemingly pretty much copied it to a T and then even doubled down and said, like, yes, and.
wait really like the founder replied was like yeah yeah basically saying yeah I mean I think it's like
it's sort of fair if it's not like it's fair game yeah fair game for to pull a design off the shelf that's not
actively being used as much like you know but but it's still it's nice to go further back in time like
you can still bring your own ideas to it you know I think Brandon's frustration is probably just that
you didn't bring many new ideas you just kind of copy and paste it yeah yeah
a lot of that going on
John Titer is quoting a post
that says this is a camera
it's 200 by 200 pixels
30 frames per second
I didn't know they made cameras
this small John says there are certain things
you just can't learn about if you're prone to paranoia
this is actually crazy
yeah so that I mean the
the community note gives a little bit more
context here it does say that
this is the camera module
it is capable of producing an
analog video output, but it needs a power supply battery or storage. And so you can't just drop that.
The implication is that this camera could be built into effectively just like a dot on the wall
and you could store the power. Oh, it's only 200 by 200 pixels. I was saying should we get these
and put them all around the set? And so you just walk into the TBP and Ultrodome and you don't see any
cameras moving. Like we have a slider cam now. We have a lot of different cameras around and you kind of
trip over them and you know you got to cable manage them but imagine if we could just put one little
dot on that turbo puffer fish there one little dot on the microphone you can just get any any image from
any place uh maybe big debate on the timeline over whether you should have shoes on or on in the
office ben lying over at cursor says no shoes at cursor nyc will o'brien says if ulysses ever ends up
like this you have permission to shoot me in the face very aggressive uh...
I can see why companies that are just, you know, want to be cozy, want to have a, I think wearing
shoes in your home is insane. Yeah. I'm very against walking around the house with shoes that
you wear out in the world. Sure. Plenty of studies that just show you're just tracking in all sorts of
things. Makes sense. Do you do slippers in the house then? I enjoy slippers. I feel like if you if you don't do
slippers, then you need to keep the whole house warmer. You need more carpets. But I wonder what else
went into the plan to make sure that Cursor HQ in New York City is fully cozy. Because you don't
just want to take off your shoes and be around. Like we have concrete floors here. We are shoes
on facility. No one takes off their shoes. But if we were to go to shoes off, I think we would
need to get some carpets, keep the place a little bit toastier. Yeah. Right. Or maybe,
give everyone a pair of slippers. What's going on here? This account Toys X, Y, Z is sharing a
nanobanana watermark. Have they, how, do you know how this works functionally? Yeah. So,
um, you have to like, turn, like, uh, do you have to basically increase the saturation of the
photo in order to see it? So this pattern that you see are, are subtle changes in the saturation. And if
you go to the next image, you can see what it looks like on an actual nanobanana image, um,
not just the watermark. And so this is,
This is a black and white image.
This was generated as black and white,
but Nanobanana uses slight variations in the colors
to just have a little bit of saturation.
So normally, if you're looking at like a gray scale image,
basically the saturation is turned down to zero
and there is no color whatsoever.
There's only brightness, right?
You're going from zero to one just on the black scale.
nanobanana, even if you ask for a black and white image, it will output an image that does have a little bit of color, and it will vary this pattern.
So there's little bits of red, little bits of green, little bits of red, little bits of green.
And so this is being put in every nanobanana image.
Of course, as soon as you discover this pattern, there's probably some ability to remove it.
Even just a slight edit might change this.
You could just go in and actually reduce the saturation to zero, and then the watermark's gone.
And I'm sure people will do that.
But somebody will make an app where you just upload an AI photo and then it figures out which model generated it and then figures out how to remove whatever hidden watermark is included and then you have a clean image.
Totally. There's already a ton of SORA watermark remover tools out there. I think this is still just more useful for having a reality check on like, you know, was someone dumb enough to not even remove the watermark? At least you can just automatically flag that.
and a lot of, and at least it injects an extra step, an extra cost into generating, you know, like spam images or whatever you would want to do that's, like, malicious that you'd want to discover the watermark. But fortunately, I feel like even with Nana Banana, you can still just look at the image and tell. But if you want to generate some generative media, head over to Fall, the world's best generative image, video, and audio models all in one place, develop and fine-tuned models with serverless GPUs and on-demand clusters.
Let's fall.
Jared Kushner?
Jared Kushner.
Matt Steeb said in an article a while back,
Jared Kushner claims he can solve Israeli-Palestinian conflict
because he's, quote, read 25 books on it.
And, of course, seems like that was hopefully...
No, the real reason is what Wilmanaitis said.
The New York real estate.
Yes, yes.
He's been doing New York real estate deals.
And so he's ready to broker another real estate.
estate deals effectively.
But, I mean, we haven't really covered the peace deals, the journals writing about it a little bit.
There's, I guess there's going to be a vote, but there's plenty of...
Another news, Barry Weiss asked everyone across CBS News to send her a memo by next Tuesday
explaining how they spend their work day and what's working, not working.
Is this a what did you get done this week, basically?
It's a, what exactly do you do here?
You think it's that?
I think, I mean, it's great asking, hey, what's working, what's not working?
Yes.
But as a manager and you're coming into a new organization or a leader, you're coming into a new organization,
you want to get a pulse on, okay, what are people actually doing here?
Yep.
Because I think the question is with everything that David Ellison is doing, is he trying to turn these
into media companies that can create
massive cash flow
is, or are they strategic enough?
Like, I don't think when Jeff Bezos
was buying the Washington Post,
he was thinking, I'm buying this to make money
necessarily. And so the question is,
I think Max Taney here,
the way that this has been written,
I think the question is like,
are they going to let a bunch of people go?
That's kind of how I would read into it.
Yeah, I mean, at the same time,
like if you're coming into a, if you're coming in as CEO or, you know, editor-in-chief of a new
organization, and you're like, my view on it is that they're actually severely understaffed.
And the first thing I'm going to do is triple head count. It's still reasonable to ask what
everyone does. So you understand, like, oh, okay, this person's doing five different jobs and they're
working 200-hour weeks. Like, maybe we need to get them some extra support. But I agree with
your general assessment.
And it certainly would be a little bit stressful
to get this email from Barry,
but, you know, she says,
please be blunt, just break it down.
Recommendation, don't use AI.
Any M-Dashes?
There is an M-Dash,
but we know Barry uses M-Dashes.
She's been using them for decades.
So there's no, maybe not decades,
but for, you know, her career.
It is, the reason that it's in the model
is because it's a popular writing tool.
Anyway, Cloudflare did a new,
rebrand, powering 20%?
And I guess Ty,
former member of
the party round team, I guess was behind
this. Oh, no way. And YLTB sharing it.
He also was co-founders with
Dylan on CTG, which they
Oh, no way. That's very cool.
A little bit of lore.
Ty is a legend, extremely
talented designer
when he was, he
had reached out to
us at Party Round, and
we didn't, I talked
once with him. I remember correctly. We didn't immediately make an offer. We were just kind of like,
yeah, let's keep talking. And then he built an entire game, like a simulation of a of a of a game
that you could play on your phone. And he just sent it to me. He like built it. This was like pre
vibe coding. He just built it and sent it to me. It was like, it was web based. It was, uh, no,
it was mobile. Okay. And I just immediately called him and I was like, okay, we're bringing on the team.
This is amazing.
Very cool. Very cool. I mean, it seems like good response. A thousand likes.
No one's, uh, people are very opinionated about branding, launches, uh, you know,
launch videos, all sorts of stuff. So yeah, he, it was, uh, I found the original post. Uh,
it was a Pokemon style game where you could build like a cap table, basically. Uh, collect
investors. That's exactly what you want for sure. Great stuff. Great stuff. Um, if you're just
tuning in, Sam Altman will be joining in about 10 minutes.
He's on for half an hour, and then we're talking to Elog Gill.
Before we move on, let me tell you about turbopuffer.
Search every byte.
Serverless vector and full-text search, built from first principles on object storage,
fast, 10x cheaper, and extremely scalable.
You see this Reddit post circulating that lists OpenAI's top 30 customers by token consumption,
and apparently dualingo.
Number one.
Second is open router, but of course their platform is routing.
Routing.
routing
consumption
surprising to see
indeed at the top
of this list
do you see number nine baby
number nine
let's go it's ramp dot com
you warp dev on there
Shopify
sure also
what so I
when this came out
because of their
I don't know if there was
this table is like a leak or something
but at Dev Day
open AI put up a list
of names of people
that had been using over a trillion tokens, right?
And people kind of reverse engineered that
to understand what the people,
like what companies they work for, right?
And I was trying to make a meme that I was sending you,
and it wasn't quite hitting,
but it was like the Atlas holding up the world meme,
and it was like the entire global economy,
but instead of like Open AI,
which is the current meme,
it's like 30 companies in wildly different markets
that are all using AI.
And so that, like,
you would be more worried, I think, if this was more circular.
And this is the Martin Screlli take, which is that if it was, if you looked at the top 30 customers
and it was all like AI, chat GPT wrappers or something, something very circular, you would be worried.
But instead, it's companies like Indeed and Duolingo and Ramp and Shopify and all these companies
that are touching very different pieces.
These aren't competitors.
Like Duolingo is not a competitor to Shopify.
And so it feels like evidence that this is like less circular. I don't know.
Yeah. I mean, it is the GROC. C of GROQ, GROQ, recently said that 35 to 36 companies are
currently responsible for 99% of token spending in AI right now. Even among those 35 companies,
two are by far the most significant spenders and they're open AI and anthropic.
So it's crazy.
that's generation, that's buying inference.
I'm talking about companies that are buying from Open AI and buying from Anthrop.
So one more step, one more step.
Because it's like, if I'm fine with, like, it's scary when you hear like Open AI is buying 99% of AI stuff.
But then when you look under the hood and you see like duolingo and ramp and Shopify, it's like, okay, well, that's actually like pretty diffuse in the economy.
Yeah.
So, yeah, there's two significant spenders, but in those spenders are thousands of other
companies. Exactly. Yeah. And I wonder just this idea of like, there's a trend. We're in a
trend right now, the AI wave. And it's holding up the global economy. Like, have other trends
held up the global economy successfully? Like, if we go back to industrialization, was that holding
up the global economy? Did it successfully hold up the global economy? Did it successfully hold up the
economy or like global trade, the containerization, that held up the global economy. And like,
there were certainly like ups and downs, but like it kind of successfully held up the global
economy. Yeah. And certainly the, I mean, going back to that clip from Ken Griffin earlier this
week, he was basically saying that in 1999 and 2000, it was incredibly obvious that the internet
would change everything. True. But it still took 15 years. Right. So I think,
even, I would say, most of the bears, like true AI bears, still believe in the potential of the technology.
They just believe there's going to be some sort of winter.
Like a hiccup, yeah, winter.
Yeah, we haven't heard a lot of talk about AI winters.
There's been many of those, and we, I had a hot take that 2023 was an AI winter, which is, like, of course, like the most bullish insane time possible.
But my riff on it was that like chat GPT launched in 22, Waymo launched in 22,
and then 23 was more just like the adoption of chat GPT.
And I think at Dev Day they launched maybe GPs and it wasn't like a wild use case.
We didn't have reasoning models yet.
And so it was like this magical technology launched in 22 and in 23 everyone was kind of like processing it.
But there wasn't like a massive jump in 23.
I mean, I guess we did get GBT4.
What do you think, Tyler?
LG, by the way, is quizzing you in the chat.
John Coogan, how many total tokens have been used on Open AI year to date?
Name every token.
Name every token.
Well, it's odd.
It's $6 billion a minute.
I think we did the math on this.
It's in the trillions.
It's a lot.
So, yeah, when I calculated it, I had like around one quadrillion a month.
One quadrillion a month.
That was also the number, I think Demis a couple of weeks ago.
He said, Kamenai is doing it.
one quadrillion.
Wow.
But yeah, because Open AI was like six billion per minute, but that's just on the API.
So if API is like 25% of the company.
Exactly.
Yeah, yeah, you have to do a lot of like dancing.
But yes.
In 2023, I mean, GPT4, I think is like, I don't think you should be following product
releases.
You should be following actual.
But GPT4 was was trained in 22 and was released in Bing in 22.
So it doesn't count.
I'm kidding.
Of course, 2023 was a phenomenal year for AI, not, not, not,
Not a winter at all, but it is interesting to see, like, where the growth spurts come,
how much of it is just a smooth curve of adoption and diffusion into the economy.
What's the rate at which it's diffusing?
Where are companies and individuals actually getting value?
Should we move over to the huge news in creatine?
Yes.
Dan McCormick says, work with your brother.
Go into debt if you have to, because Pachie McCormick is giving a shout out to Dan,
the founder of Create.
He says, my brother, Dan, has.
been writing the weekly dose of optimism for three years. That's Packy's second newsletter,
aside from the one that he writes. Last week was his last. Dan McCormick is stepping down
from writing the weekly dose of optimism because his company is absolutely ripping.
He's ripping $85 million run rate. I swear, I swear gummy vitamins are just an infinite
money glitch. There's a couple categories that are just doing so, so well. Stick packs and
powdered supplements.
What's hard?
Hard is liquids, right?
Hard is...
Do not try to sell liquids on the internet.
That's hard.
But gummies must have a great...
I invested in create, I think,
at a six cap.
I met Dan before the launch.
He was raising it even less than that.
I didn't see the vision right away.
And his execution in the first five months
was absolutely wild.
And I capitulated.
And it's been a wild ride.
The execution is insane.
Well, Dan, if you want to keep a hold on that creatine monopoly,
you've got to get on profound and get create mentioned in chat GPT,
reach millions of consumers who are using AI to discover new products and brands.
This post from Frog is a banger.
Please make sure you are only drinking as much water as you really need.
We need that for the data centers.
If you're thirsty, GROC is thirsty, too.
Completely agree.
I completely agree.
Reply here, installing a low-flow showerhead out of concern for GROC.
I love it.
I saw someone else was trying to put the, yes, this is it.
Andy Masley, a couple slides later.
He said, every day I find a new way of trying to get across just how ridiculously fake the problem of AI water use is.
We've talked to a number of NeoCloud CEOs, data center builders on this show who have built data centers, and they've told us, yeah, we use a decent amount of water.
But once we have the water, we actually have figured out how to just recycle it in the system.
And so we're not actually using that much water.
Even the new iPhone has a single drop of water.
And they sell a lot of iPhones.
So, I mean, millions of drops of water, you've got to answer something.
No, but it just proves the point that.
Oh, yeah.
Yeah, you can recycle it for heat.
Yes.
Yeah, no, that's a great point.
I hadn't even thought about that.
It's not like your, I got to go refill my iPhone.
Can you imagine how upset people would be?
It was like, yeah, I need to charge my iPhone.
Oh, I forgot to refill it with water at the gas station.
So he, he shares some data here.
So this is a quote post from someone else.
Yeah, but the form of AI that uses the most water and electricity by far as chat.
You can start somewhere the whole I can't do it because I got cut off is just an excuse.
I don't care for.
And so here is some evidence,
some new ways to think about the amount of water used by AI.
Have you ever worried about how much water things you did online used before AI?
Probably not because data centers barely use any water
compared to most other things we do.
Even manufacturing most regular objects requires lots of water.
Here's a list of common objects you might own
and how many chatbot prompts worth of water they used to make them.
Leather shoes are 4 million prompts worth of water.
Smartphones are 6,400,000 prompts of water.
A single pair of jeans is over 5 million prompts of water.
This is such a silly metric, but I love these silly metrics.
T-shirt is a million prompts.
A single piece of paper is 2,550 prompts.
If you want to send 2,500...
Imagine trying to give up all the things on this list because they use water.
But you'd have grok. You'd just be naked using grok. But you'd have, you need a smartphone, and that's six million prompts.
Chad is going crazy right now. We're being told to not ask him anything about Trump or crypto.
Okay. It's because there's prediction.
Oh, no. Okay. We are not paying attention to the prediction markets. We will not be steering the conversation if you happen to have a bet one way or another.
Well, I believe we have our guests in the Restream waiting room, but before we bring them in,
let me tell you about Julius.
What analysis do you want to run?
Chat with your data and get expert level insights in seconds.
Julius is the AI data analyst that works for you.
Connect your data, ask questions.
Data superintelligence.
It is.
And we are joined by Sam Altman and Bill Peoples, Sam.
Bill, how are you doing?
What's going on?
Hey guys.
Great to see you.
Congrats on all the progress.
I've been enjoying SORA a ton.
Personally, I've been enjoying making them.
I had a ton of fun making the collab post yesterday.
And I was wondering.
And prompting your cameo feature.
John made it so that he always appears as a bodybuilder
if anybody is cameoing him.
So you guys got to experience.
And it led to some chaotic results.
Do you have favorite Sora posts
that you've been coming back to
or that have stuck out to you
particularly, you know, creative uses?
I mean, definitely all of the ones of, like, me stealing GPUs
or doing other crazy things to get GPUs have been funny.
In the last few days, at least in my feed,
there have been these, like, very beautiful sort of fantastic scenes
that are just not things that could have ever existed
without something like Sora, or wouldn't have been easy to make.
And watching people build those and watching is sort of the trends
flow through that has been pretty awesome.
What about you, Bill? Any favorite uses of soror so far? Oh, man. Mark Cuban came on the platform
a few days ago, and there have been some hilarious Shark Tank memes. Those are probably my favorite.
Pitching some Sora features. Also, leveraging the prompting function to always include an ad for
cost plus drugs, I thought was especially hilarious, considering he's been one of the most vocal
opponents of advertising
in AI he
is leveraging the feature to the
max. Yeah, I think there are going to be all
of these weird new dynamics
that we see emerge that just weren't possible
in previous kinds of video and
this is like a fun period
because it's all going to be so different every few
days. Man, I'm watching this polymarket
ticket go by, ticker go by and it's so
tempting to like say things to
yeah, yeah, yeah, to be clear
don't worry about the
don't worry about the ticker. I don't think we're
including, I don't think any of those markets are being featured in the ticker, but
yeah, again, this is the new world we're in.
Yeah, you can move the market live on TBPN now, which is very odd.
People, I'm sure, will be happy or disappointed.
We're here to talk about SORA, of course.
So none of the other topics.
But, I mean, I also want to know about ads.
Why no ads in SORA on day one?
I feel like you've laid out a really great, you know, mental model for how you think
about ads on Stratory on the Andrews and Horowitz podcast. I'm bought in. Is it a technical thing?
Do you need scale? Do you need to think about it more? Why no ads on day one?
This is like a 10-day-old product, right? Like, it's hard to get anything to work at all.
And we, like, we don't, we don't assume success. We got to, like, go hard-earned success.
And then we can think about monetization for it. But this is like, it's gone great so far. It's still very early.
there's still a lot of work to build something that a lot of people are going to love first.
What about surprising capabilities of the model?
You mentioned that you've seen some fantastical scenes.
I'm interested to know about specific breakthroughs that you've noticed that SORA to the model is particularly good at.
I noticed one about reflections being great.
Obviously, people love the cameos.
But what has surprised you in terms of just like technically the model can do something now that it couldn't do before?
This model is a hugely forward in terms of physics IQ.
So pretty much all past video generation models really struggled with prompts that involve
like backflips, gymnastics, routines, etc.
And this is really the only model that exists today, which can reliably handle these
kinds of really complicated dynamics.
One of the big features that people have really loved on the app so far is the steerability
of the model.
So if you give it like a really simple text prompt, that's maybe even only a few words,
this model is really good about kind of telling a coherent story with like a beginning, middle,
and end and doing this like automatically in a way that doesn't require like a lot of direct
steering from the user. If you want to like go into, you know, a ton of detail about exactly
how your prompt should be laid out and how the story should unfold, it supports that too.
So it can kind of meet you wherever you're at in the creative process. But really this model is just like
so hyperstereable. And it's like just vastly higher physics IQ just makes it able to do things
that were like not possible a few months ago. Is that all within the model or is there some
sort of like reasoning step where you're hydrating or unpacking my prompt and writing a bigger
prompt or breaking down the problem in some way? Can you share anything about that? Yeah, it's a
good question. So, you know, the intelligence for these text conditional video models kind of lies
both in the core model itself like SORA and some amount of it also comes in through the text
prompt. So, you know, however the user decides to kickstart a prompt, you can have like a language
model under the hood, add some details in. But for example, you know, when it comes to things like,
again, like doing these backflips or any kind of physical interactions, how refraction is modeled,
you know, when you're pouring water into a glass. All of these details have to be captured by
the core video model itself. So that's intelligence, which is really innate to SORA. And certainly
you can supplement it with intelligence from a language model as well. But it's not necessarily
a prerequisite to get kind of amazing results out of these things. Are there any areas on the
physics where you think that the model falls down and you want to improve? I mean, we went through
the era of like six fingers. It seems like reflections in water are solved. But someone
was saying something about doors being hard or I haven't noticed that one personally but a lot of
the stuff's great but what have you noticed is like the next version is going to be even better at
this is still very early yeah a thing bill said that I appreciated is this is this is the
this is like the gpt 3.5 moment for video I agree and if you went back to use the actual gpt 3.5
you'd be like okay signs of great promise can do the occasional impressive thing but it was really
not until gpt 4 where these text models started providing real value for people and
we know how to go make the GPT4 equivalent of video models and we will do that and then a lot of these things that are currently annoying like doors or you know once in a while something goes through something else it's not supposed to in the same way that the world you know love to complain for a brief period of time about where 3.5 fell down and oh it's never going to be useful it's never going to do this it's never going to do that and then we were able to just keep making it better and better and better the model physics IQ is certainly the best i've ever seen
but it is nowhere near as good as it will be in the future versions.
And I think, I hope we'll see a similar thing to what happened with the GPT text models,
which is people will always demand more and better,
and they will always find new and better things to use it for,
and the world will just make ever more amazing videos.
How quickly...
Oh, sorry.
How quickly...
Go for it.
Go for it.
For video here.
Yeah.
Like, GPT1 really was Sora 1 for this modality.
And the progress we've made kind of in the last 18 months, getting to this 3.5 moment, right, is really compressed compared to how long it took to go from GPT1 to 3.5 in the language domain.
So we're really expecting progress to continue to be mediarch here in the near future.
How quickly do you expect the cameo feature to be cloned?
That feels like an equally important part of the, you know, that the models made a leap, but the product is in the experience and the experience of creating these assets is.
wildly innovative. We saw stories get cloned. We saw, you know, Algo, video short form feeds get cloned. I expect many other
platforms to be looking at this functionality and realizing that this might be the future. You guys
certainly believe that it could be important. So how quickly do you think?
We're actually totally okay with the world where we do the product innovation and everybody else copies. And I don't think it works for them as well as they think.
I think it does.
Like the, you know, a lot of people have tried copy in chat GPT.
You can go look at some of our competitors' apps, and they even copy the mistakes.
They even copy the design decisions we really wish we hadn't made.
And maybe it's worked well for them.
I guess I kind of hope it has, but it's been fine for us.
I think like the key to this is not any one innovation, but it's repeatedly putting them out again and again and being first to come up with them and put them into a cohesive offering.
And, you know, that's what we want to be good at.
And if other people want to clone the stuff that works, we also sometimes clone stuff that works.
That's fine.
But mostly we want to be able to drive the innovation.
And I think Bill and his team have done an incredible job of figuring out how people actually want to use these video models, what the models need to do.
Really, they've approached us as a full stack problem from how do you train the video model to how do you make this enjoyable for users.
but cameos are one out of many ideas they have from here on their journey to like the product
that we hope to eventually build. And so if people take some inspiration from us and copy us
along the way, I'm sure they will. It's fine. How do you think about the like popular claim
that we want AI detection? I want AI content flagged. Is that a stated preference that's not
a revealed preference? Because personally, I don't want bad.
AI content, but I don't want bad human-made content either. I want great both, and I'm fine when
someone comes up with something genius and they instantiate it with a video model. How do you think
about it? I think that is the real thing is you don't want slop. You want great content. Different
people, one man's slop is another man's treasure for sure. But what you care about is like good,
original, thoughtful, new, helpful, whatever content,
and whether that is generated entirely by a human or entirely by AI
or what I expect will mostly happen in the future,
which is tool-assisted, human-driven generation,
I don't think you care that much if the content is great.
There's a lot of, like, you know, stuff that is technically written
or drawn or filmed by a human, but is completely derivative
and much less original than what an AI has generated.
And I think that will be what people really care about long term.
You just want great content.
Now, I also do want some human connection with it.
When I read a great book, first thing I want to do is read about the author that wrote it
and what life experience went into that.
I don't think that'll go away.
But if they're using an AI as a tool to help them make the writing better, sign me up.
That sounds great.
Similarly, I would rather watch a video about someone I know than some random AI-generated
character, which is part of why I think this was cool to offer.
One design decision the team made that I thought was really great, and I was actually
pushing them in a different direction earlier on, and then I decided they were
totally right, and I thanked them and dropped it, was the fact that the
feed is AI only, and not a mix of AI plus some uploaded videos, I think,
is a subtle but extremely important design decision in how people are relating to
Yeah, it was a very weird experience for me. I was thinking about the collab post that I was making, announcing this interview. And my initial thing was like, well, I'm going to have to think of a script or I'm going to have to think of, you know, what I say, I should record a piece of this and then I'll use it. And it was like, no, I just typed the prompt and then I get the front facing videos. Remarkable.
What are you, what kind of indicators are you guys looking at as SOR can transition from what it was the second it launched, which was a creative tool.
into something that's more of a consumption platform,
traditional social media platform.
Talk about what you guys are pushing forward to,
because obviously you're seeding the network with the tool,
but it's certainly much harder to turn it into something
that people are spending hours a day
and purely consuming content and not creating content.
You know, we really wanted to design this from the ground up
to be centered around creation.
And a lot of the metrics that we've been focused on optimizing here are really aligned with making sure as many people as possible are actually like getting their hands on the SOR2 model itself and, you know, able to create content with their friends and like for the rest of the world.
One metric that we're really proud of with this launch so far is that 70% of our users are actually creating content even to this day, you know, a week and a half after launch.
And that's like vastly higher than on any other social media platform.
And I think it really speaks to just how fun creation can be with the right tool set, right?
If you look at any of these kind of legacy platforms, there's just like so much friction from like getting off the feed and like into some creative flow state, right?
You have to like put the phone down, you have to go get like a camcorder, start recording yourself, find your friends, like do a dance, et cetera.
It's just like a lot of work, right?
On SORA, like you can just pick up your phone, find a like any video you like in the feed, remix it, you know, cameo any of your friends.
And I think one insight that was not obvious to us at first, but we've kind of clearly seen as an emergent behavior of this product, is just like there's all these people out there who would not necessarily want to be like, you know, influencers or something or have like a big social media presence.
But the fact that like all of their friends can just access their cameo, right, put them in all of these crazy situations, actually like kind of gets them into the playing field in a way that felt really high friction before.
And so, you know, we're closing in on close to like two million weekly active users now.
we're really excited that such a huge percentage of that user base, to this day, is like still
creating with SORA. And we're going to continue pushing on that direction and making sure
people have even more powerful tools in the future. Yeah. So 70% of SORA users are creating
content. The typical benchmark that people kind of quote randomly is like 1% creation, 99%
consumption, something like that. And that certainly feels like my experience on Instagram. I
post a photo every once in a while, but most of the time I'm just kind of scrolling. And I'm
wondering if you think that that 1% will be much higher on SORA in terms of actual time in the
app, time prompting versus time scrolling. If you have any data, that'd be super interesting.
But then also, does that make it more of like a competitor to video games than traditional
social media? Because it's such a lean forward experience versus just lay back. What do you think?
Yeah, it's a great question. We still need to study this more exactly how creation versus consumption
habits kind of change over time for folks on the platform. It's still pretty early days.
I do agree with your point, though, that I think over time, this is going to feel much more
immersive in a way that, like, video games kind of do. Like, you have more agency when you're
actually using the platform, you know, not just kind of like mindlessly scrolling a feed,
like hours a day. And like one interpretation of this product, which I think is kind of
interesting, especially from the research perspective, right, is cameos in some way is like
the simplest way where you can kind of like inject yourself into the model, right? So it's a
It's a very low bandwidth communication channel right now.
You know, you're only giving like a few seconds of video footage of like any given individual
like into the app.
But like over time, right, you can imagine like these models know more and more about
your life.
They really like deeply understand your friends, how you want to like show up in the world.
And like over time, this can almost become like a little mini like alternate reality, right?
So like you're not just generating like videos of yourself with your friends.
Like you actually just have like digital copies of yourself running in the model on the
SORA platform interacting with other people with agency.
And so I think over time we're really going to see this platform evolve into something
that feels kind of familiar today and just something that really leans into like the
full intelligence of SORA 2 in the future and like really leverages all the world
simulation capabilities that we're working on internally.
Yeah, I would add to that if if you think of this like spectrum of the kind of entertainment
you can have in front of a computer, at one end you have like watch a two and a half hour movie
and you hit play and then you lean back and you don't do.
anything at all.
And then at the other end, you have like a very intense video game and you're like, you
know, sweating and your heart's racing and it's like super, super active.
AI is going to push things to be more in between there.
So you'll have, maybe you're still watching that movie, but now you can like say something
a few times throughout the course of it and it changes what happens as the movie plays out.
Or with SORA, you're seeing this amazing new phenomenon where most users are creating
in a world where traditionally only 1% of them did.
And so, yes, you're watching a video feed,
but you're doing a little bit more.
And it, at least for me, really changes
how fun the whole thing is and how I feel about it.
Then maybe you'll do what Bill said,
and you'll be way more actively participating
in the solar feed.
And I think you're just going to see that continuum blur
a lot more.
Did you see Bander Snatch by any chance, Sam?
Have you seen this Netflix?
It's like a Netflix, choose your own adventure.
And it was really cool idea.
But ultimately, people,
it never really took off and became
like something they do again and again.
and again. And I'm wondering if it was because it was like not customizable enough or people
just want to just sit back and see a director's vision. I don't know. I never heard of that,
but it sounds cool. Yeah. How do you think, a question for Sam, how do you think about
allocating compute to SORA versus the rest of the business? I imagine Bill is constantly
in your ear every other hour. But how are you thinking about it? You know, my real answer is I've
entirely changed my focus of how I spend my days to just go get more compute rather than have
to make the compute allocation decisions. I still do have to make some short-term compute
allocation decisions, but I hope we're heading to a world where I am instead telling
people you've got to find a way to use more compute. And we're going to be very aggressive
here. It feels like you're doing a great job of like bringing things within your control,
within the supply chain. What is outside of your control at this point? I mean, most of
But I feel like you have great, you have great partners all up and down the stack,
multiple partners in different parts of the chain.
Like when I think about scaling up SORA, I feel like it's crazy to bet against you.
Like you're going to get the chips.
You're not going to be GP4.
You go try to buy like 10 gigawatts and hour for delivery next year.
It's not so easy.
It's funny.
How are the conversations going with Hollywood?
Oh, yeah.
Oh, actually.
Yeah, you take it.
Yeah.
I was going to say, we've been chatting actually with a few, you know, very notable folks in Hollywood over the last week.
You know, I think people's first reaction to this is, like, very understandably going to involve a lot of trepidation and, like, anxiety.
When we've gotten to just sit in a room with these folks, though, you know, and really explain what we're building, I've actually been pretty struck by, like, how excited folks in Hollywood are about this.
You know, we were chatting with one actor recently who mentioned that, you know, on Twitter, like a year ago.
saw like a deep fake of her generated with one of these open source models, which really
had like a lot of nasty content created.
And when we really like we walked her through kind of all of our safety mitigations,
right, how we're making sure that we have this like very well defined model spec, which
dictates the behavior that that we allow on this platform and how we are really leaning
into like full control of likeness, right, more so than any other platform.
Like you have to come in through the cameo process.
You can't just like upload an image of yourself and just like generate.
a video of it, like, any person, you have to come in through Cameo.
I think it became clear that, you know, we're really setting the right standard here
in terms of making sure people are in full control of their likeness in Hollywood.
I think that's where, like, a lot of this anxiety comes from, right?
It's just feeling that, you know, some random person can just kind of take videos or images
of you and do whatever they want with them and create all of this, like, like, terrible
content that's, like, outside of your purview.
But we've really been, like, designing Sora from the ground up to put users in full
control of their likeness end to end. From the moment you sign into the app, to, you know,
giving cameo permissions to, like, access any of your friends' generations. So, you know,
I think we need to engage more with Hollywood, and we're going to continue to do that. But
once we really explain the story of SORA, you know, they're very receptive to it.
Do you think there's a world... To add something to that, like, you know, I, the team asked
me before launch if they could put my cameo in their open access. And I, of course,
thought about for a second and said absolutely yes. I had all these Hollywood celebrities then
messaging me on the first day being like, you're absolutely crazy. This is insane. This is like
the dumbest thing I've ever said. And then by about the third day, they were like, hmm, that was
really smart. You got like a lot of, you know, free publicity. Maybe we need to be doing that.
And I think you're now seeing actual celebrities say, okay, I'm going to do this. And I expect a lot more
of them will. Similar thing on other kinds of characters in IP, I can totally imagine a world
where our problem in a year or six months or maybe even less is not that people don't want
their cameos or their characters appearing, but they think we are not fairly having their
characters or cameo appearing often enough.
This may turn out to be a really big thing for fan connection.
Now, it may be that kind of the previous generation of celebrities don't want to do this
and the influencer celebrities all do.
I don't know how that's going to go, but I bet this will be like a pretty deep kind of new
connection.
Yeah, it seems like it's been good for DiCaprio in the memes.
Like, he's not directly monetizing those when you show.
the champagne meme or him pointing at the TV, but like, you know, it builds his aura in some
way. A friend of ours posted something yesterday. This is Jeremy Gafon. He said the reason we're so
upset about slop is because it's obvious we're all going to be going to love consuming it in two
to three years. It's not going to be slop for long. Do you agree, Sam?
I mean, some of it will be slopped to some people and some of it won't. I remember like
there was a real reaction like this in the early GPT days
where people were like I can't believe anyone reads this
it's like total crap it's full of hallucinations you know
it's like it's not useful to anyone
and then it became more useful to some people but they said I can't believe
anybody like ever thinks this thing writes a beautiful sentence that's insane
and then with GPT5 you have authors saying like wow this is a useful tool
it's sometimes like writes a beautiful sentence yeah and I kind of think it'll follow
a similar trajectory what do you think about the fact that people
feel at least. I don't know if they actually can, but it feels like you can still clock GPT5 writing.
You know, it's not this, it's that, the M-Dash. Like, will we still see these artifacts in
three years in SORA 5 that people are like, oh, if you know, you know you can tell, but most people
can't? Yeah, it's like, what's the MDASH of video? Because I don't think it's like six
finger. No, no, definitely not. That's the typo, which doesn't happen anymore. Yeah, I think right now
the m-dash is like this like slightly wired speech pattern in SORA where it likes to say a lot of words
very quickly. You know, these generations definitely have like a style to them. I think analogously
to GPT, we really want to give users a lot of control over exactly how their videos show up, right,
on the platform. Like if you really want kind of like a very soothing experience, right, not a lot
of shot changes going on, we want to give users the ability to generate that. We're going to continue
need to give more optionality to people. So, you know, there'll be some default kind of
behaviors and quirks of Soros, for sure. But we definitely want all power users to be able to be
in full control. Random question. Where did the name Sora come from? Yeah, this is a fun one.
So the original Sora came out in February 2024, the OG blog post. We did not have a name for it.
I think like up to two days before we like revealed the model to the world. We just could not agree
on the team what it should be.
Did you at least have a code word or something?
We just called it like video gen.
Okay.
And so at some ungodly hour,
I like just started pumping a bunch of crazy ideas into chat GPT.
And then like we basically ran out of like English words.
So then we switched like Japanese words.
Wow.
And then SORA came out.
I was like, wow, that sounds really nice.
It means sky, you know, linked with like imagination,
like all the possibilities of creation.
And so then we just like last minute ship Sora.
So yeah.
Yeah, it was kind of a mad dash.
Okay, speaking of Japanese stuff, Sam, you said you were looking for Accura NSX a while back.
It's kind of this throwback car very, it's not a Waymo.
What do you think the piece of content or format will be that remains loved in an age where everyone's taking the Waymo of video, the SORA video generation?
Well, first of all, I got that NSX and it lived up to all of the childhood hype.
I mean, just incredible.
That car is so fantastic.
And I don't know.
I kind of think there's going to be a lot of stuff like that for people that generated or not
where you still, you want the real thing, you want the thing that you have the kind of childhood connection to, you know,
someone like a kid today is not going to want the NSX, but whatever a cool car like that is, they will want.
And at some point, like, the fact that they can have, like, a crazy VR experience, they'll still want the real thing and the connection to it and everything they have.
So I think there will be a huge amount of that.
In fact, I think the future looks like much more of that kind of stuff, not much less.
How quickly do you want to create an economy on SORA?
It feels like there would be a number of ways that you could create incentives for creators to create things for IP holders, for individuals to just be passively monetizing their likeness.
Bill, what do you think for timing on that?
I mean, this is like a top priority for the team.
You know, there's clearly such an incredible value proposition for celebrities, for rights holders
across the board here.
We think cameo is like a great entry point for this, right?
You can imagine right now we have cameos for people.
Maybe you have cameos for like, you know, your character or like your brand or something.
And so we're actively working on the team right now coming up with like the right monetization,
model here to get this rolled out. But it's really important to us, right, that our creators on the
platform are rewarded and that they're clear, you know, financial incentives for like the
incredible work that they're already doing. So this is like top of mind for us and we'll have
updates here over the coming weeks. This is like something we're actively working on.
I will, I think it's super important and awesome. I will say I would like to know how many hours
of sleep bill has averaged for the last few weeks, but I bet it's not enough. So we got a lot
of stuff. The team's got a lot of stuff they have to do in a short period of time and it's going to
take a little while. Okay, let me put one more thing on your plate, Sam. I mean, earlier, like,
years ago, you built Looped, location-based product. Have you thought about how AI and location-based
content fits together? Like, on most of these social apps, you can tag a location. That wouldn't
even make sense in the current SOAR app, but what does the AI Maps product look like?
I haven't thought about AI and location that much,
but I've thought about how AI can really change the social experience for people.
We don't have like a for sure answer yet,
but we have a lot of interesting threads to pull on.
And I have thought back to like my days running that startup there more.
My instinct is it is possible to make a very interesting new kind of social experience.
connecting you to people, helping you find people that is intermediated by AI in an interesting
way. But, you know, we'd have a lot of exploration to do there.
What advice are you giving to startup founders these days? I remember in the GPT 3.5, GPT4 days,
it was like, don't build a company that assumes model stagnation. How do you think about
in the age of SORA? That's been really great advice. It really has. It played out exactly
like that. There's a bunch of great companies that aren't built that way.
and they've done great.
But if you were just,
oh, I have a special prompt
that tunes up GPT4,
yeah, bad times.
But how are you thinking about it now
in the context of video and SORA,
specifically, you obviously do have an API,
you have Dev Day,
there's people that will build
on top of this.
Is it a different shape
of the problem?
Totally.
The reaction to the API
has been nuts positive.
At least the fastest ramping revenue
I've ever seen for one
of our new models in the API.
I mean, maybe there was something
faster than I'm not remembering, but
the demand there has been just incredible
and people are doing
awesome stuff with it.
Bill and I have not had a chance for a one-on-on since launch
because it's been so crazy. We're doing one later today.
But one of the things that I was going to suggest to him was that
we, given how much excitement there is to build
on this stuff, that we do something we don't usually do and put out
our intended roadmap of the things we're going to prioritize
because I can
imagine really cool new startups that simply were not possible that will be possible at each of these
new things will ship. So I had a question when you guys released the SORA2 via API, which was that if SORA has
a potential to be a Instagram or YouTube scale business, why release part of your edge for the entire
world that they can integrate into other creative tools and then use the model to generate
content that doesn't have a watermark
that's not in your feed, that you're not able to
get that feedback loop on
that you guys do with the SOR app.
For ChatGBT, we also
put out a great model in the API
and people can
theoretically compete with us on chat
GPT and some try to, but like we are willing
we're never going to build
every cool use of the technology and we want
the world to get all that stuff. We're delighted
to also get paid on people using our API
but like we just want AI to
flourish out in the world.
we're not going to build every great use of what you can do with video models either.
We'll build one, and I think it's pretty awesome.
But people have a lot of other ideas of business and products to go build, and we'd like to enable those.
Okay, last question.
Back to cars.
What's wrong with the Porsche 9-11?
Yeah, you said earlier the timeline was in turmoil.
You said if you were worth, somebody said, if you're worth $5 million, when you buy a 9-11, you said, no, you agreed with PG.
What did you mean by that?
I mean, maybe it was like a tasteless joke.
It was kind of like late at night.
I was, you know, whatever.
But I have an unfortunate proclivity for expensive cars.
And the response was like, would you ever spend $250K on a car?
And I took that literally.
That's amazing.
Hit the size gong for taking it literally.
No time for 250K cars.
But I probably, that was not my best tweet.
You know, I was like, I enjoy it now.
We all enjoyed it.
I enjoy it now.
I have the context.
Congratulations on all the progress to both of you.
Thank you so much for taking the time to stop by the show.
Really appreciate the update.
And very excited to see where this goes.
Thank you so much.
We'll talk to you soon.
I don't think anyone read it.
No one.
No one got it that way.
That's amazing.
250K?
How about two and a half?
Very, very good.
Anyway, we have our next guest joining in just a few minutes.
In the meantime, let me tell you about linear.
Linear is a purpose-built tool for planning and building.
products, meet the system for modern software development, streamline issues, projects, and product
roadmaps. We have a lot of Gil. You all know that OpenAI builds on linear. Yes. Oh yeah,
that's right. They're a customer. Well, we have a lot Gil coming into the TBPN Ultradone from the
Restream Waiting Room. Let's bring him in now. Thank you so much for joining us a lot. How are you doing?
Finally. Thanks for having me. Good to see all. We have wanted to do this interview since probably
the very first week that we got guess. Took us a while. But you have your own show.
Yes. But thank you so much for taking the time.
What this week has stuck out to you, I'd love to just get a state of the union on how you're thinking about the market broadly, and then we can zoom in on individual startups and trends and subcategories that you've been focused on.
But have you had a reaction to this bubble talk that's going on?
Have you been thinking about this?
How have you been processing the information?
How do you even research whether or not when something is going viral?
like that. Yeah. I mean, I've been looking at this stuff for a while, because if you look at the
90s as a sort of precedent or antecedent, the 90s internet bubble, I think there was something like
450 companies that went public in 1999. There's another 450 that went public in the first couple
months of 2000. And so about 2,000 companies went public. And then you ask how many of those are still
alive, like how many survived? And there's probably a dozen, two dozen that are still up and running. There's
probably two or three of those that are really important to Amazon as an example, et cetera.
And then 1,980 out of 2000 probably died, right?
Went to zero.
And they were being priced on eyeballs.
Yeah.
They were being priced on eyeballs, not, not even account creation.
It was, it was such a different time.
Like, IPOing was like doing your series B.
I remember there was a guy, Bill Gross out of DIA Lab in Pasadena, my hometown, and I believe
he took a hundred companies public.
And he ran an incubator.
It was like the Y combinator of the day.
One company, I believe, was AdWords that went to Google and became the backbone there.
And he had a bunch of great outcomes, but it was like a bit of a machine.
If the IPO is no longer the metric that we should be watching, is it these revenue ramps, is it churn?
Like, how can we dig into understanding like where true value, durable value moats are accruing versus froth?
We often call it like the barnacle economy.
Like if you're a toilet cleaning startup, but you have Anthropic as a customer and they 10x their office footprint, you 10x revenue, that's not exactly the type of business we want to see long term.
Yeah, I think durability is a great question, and it's a really hard one for this era.
For two reasons.
One is things are changing so rapidly from a model and underlying capability perspective that if you look at every prior technology wave, you look at, for example, Microsoft OS, right?
They forward integrated into the office suite up of using.
Windows OS or Google Ford integrated into vertical searches, so they killed a bunch of companies
or really heard a bunch of companies or providing those services. So we should see the same thing
with the foundation model companies, right? It's most likely if they're going to Ford integrate,
they're already doing it in code. Maybe they end up doing it in customer support and sales,
all the big categories. There'll probably be some effort at some point. Now, they may or may not
succeed with that, which is a different thing. But there's durability in the face of competition
from the big folks. There's durability in terms of like, well, people keep using your product or
we get subsumed by a startup. And then there's just things that are just running.
up that clearly are never going to work. And the real question is, you know, how do you
identify each one of those classes of companies and how do you think about them as either a founder
or an investor? Right now, we've been, we've been noticing there's sort of like three types of,
three buckets of companies that are trying to like, you know, craft an AI narrative around
whatever market they're in. If we're talking vertical markets, smaller markets, not the
foundation model layer. You have the legacy Fortune 500 company, you know,
career CEO in the seat who's maybe paying a consulting firm for some AI transformation plan and
maybe the stock's not doing so well. Then you have the startups that are, you know, we go to YC Demo Day.
We talk to five companies that are building the same space. And it's their complete greenfield
project, amazing place to be. It must be super fun to just have, be puppeteering 25 Claudecode
instances and codex agents to build your thing. But then we talk to a lot of founders that have,
they started their company five years ago, 10 years.
ago they have a serious business but they're still in founder mode and we always find it a little bit
hard to bet against those guys who are like coming back in re-energized they have the balance sheet
they have the customers and they can kind of take a second crack at it um do you like what nuance would
you add to that framework do you think it's on a per industry basis is it all about the founder how do you
think about that yeah i think there's basically two of your points on that um i think there's a very small
number of singular founders who just make amazing things happen. And that's Elon Musk, right? Like,
who else would go to space and build cars and do all these things? Honestly, I think Arvind
a perplexity is one of those where in anybody else's hands, I think perplexity would be a dramatically
smaller business. And I think most other companies in his hands would do better. He's very good, right?
But that's very rare. So I kind of put, you know, amazing founder aside because even great founders
with their terrible market tend to get crushed. And so I think there's a second piece of it,
which is there are a bunch of these AI markets that have recently really crystallized, where
You know, I used to say a year and a half or two years ago, the more I learned about AI, the less I know.
It was the only market that I ever felt that way because, you know, you learn new stuff and you know more, right?
You do better. You can predict stuff.
And I think that changed over the last six to nine months where suddenly, at least for certain areas, it's really clear who the finalists are.
We may not know the winners, but we know who the final contenders are.
We know that for the foundation model market.
We know it's anthropic, open AI, Google, perhaps XAI, meta, a few others, mistraw, whatever.
But, you know, it's a small list.
We know for coding, it's cognition, cursor, and then the foundation model companies in Microsoft.
And you can go through sort of vertical by vertical.
There's a bunch of verticals now we know, a bridge for healthcare and maybe commier.
You know, there's a handful for each thing.
But then there's a bunch of markets where it's clear the market's going to be important.
And there's tons of players, but we don't know who the winners are.
That's financial tooling.
Maybe that's sales enablement.
Maybe that's accounting.
You know, you can come up with the list.
legal feels like it's already solidified except a handful of these more vertical specific
specifically we were joking there's people doing injury you know personal injury law agents
you know ambulance chaser agents but it feels like the categories are solidifying i guess the
question i have is you've backed winners and basically all these categories where do you feel
underexposed from an investment standpoint. What do you think you didn't quite anticipate? Is it like
energy possibly? I'm sure you have bets there, but where do you feel under exposed? That's a really
good question. I feel like the two big trends of this era so far have based, and by era, I mean like two
years, you know, it's not in your errors, you know, of recent times. The last two weeks. The modern
millennia. The last two weeks. Epoch. Yeah, exactly. I think that there's the two big things.
are basically defense. And, you know, I was very early involved with Anderil and led their D
and it participated basically in every round of that company. And then I'm an investor in Seronic
in Helsing and then Kayla and Israel. But very little defense actually over like a 10-year span
of investing, right? I did Andrewville only for like seven years because it was like the only
company that I thought was just going to keep going forever. And I think it's the, you know, a generational
winner there. But and then there's AI. And AI means everything.
now. It means consumer. It means roll-ups. It means vertical fast. It means, yeah. Natural gas,
turbines are AI indexed. Yeah, exactly. Yeah, trains have to move GPUs across the countries.
Yep, yep, yep, yeah. FedEx, maybe. Throw that in there. Yeah, I love it. Yeah, FedEx is my favorite
AI company. So I think, you know, those are the sort of two obvious trends now. Six or
seven or eight years ago, they weren't obvious. Now they are. And, you know, honestly,
obvious trends often go longer than you think. I remember with the social networks, there was
a bunch that didn't work out of me
in MySpace and Friendster
and eventually had Facebook and LinkedIn and Twitter
and then at that point everybody said it's over
everything and social saturated
but then we had WhatsApp and we had
Instagram and we had TikTok and it just
kept going. AI's in a much earlier version
of that right now where
I think we're at the very, very early days of this massive wave
and so to some extent I'm under-exposed to AI in general
because I think it's the biggest thing that's happened in
20 years or longer.
says he's under-exposed AI you're very very humble the chat says everything important a lot is
in what is what is what's not AI when do you get a pitch where they use the word the letters
AI on their website a lot but you're just like hey guys this is this is just this is just
well I actually bring this back to like what's durable in the face of AI and a good example
that is Ripling right Ripling is an amazing company they uh
cross sell a dozen different HR products.
And AI can make some stuff better, but nobody's going to do the AI first rippling and suddenly
win, right? Now, the main threat maybe to a rippling or deal or sort of related companies
is if company headcount actually goes down because of AI, then they have fewer seats they
sell, right? And so that's maybe how there could be a headwin from AI for these companies.
But maybe that means more companies. Maybe that means we just get a lot more companies,
smaller teams, right? Yeah. It's quite possible. Yeah. So I just think like that's the
when you see that, you're like, okay, this is very durable in the face of AI, and that's great, right? And so a lack of AI means AI can't displace it. And so as long as it's working, it's actually more interesting in some ways. Yeah, the question I sort of asked myself is, you know, using a company like Rippling, for example, even if companies start needing less people, there's still, they can, they, I could see them transitioning to kind of value-based pricing around what is it, what's the value of like running your HR department, right?
Is it 3% of revenue?
Is it 5% of revenue?
Is it 1% of revenue?
Either way, they're going to make money if they're providing infrastructure for that function.
Yeah, it's a great insight because I think there's two or three things that are underappreciated about this AI wave.
I think that the first thing is that the capability set has shifted dramatically, not just in terms of what these models can do,
but the fact that you can just ping them with an API and something's accessible to everybody.
And I think that's actually very under discussed, right, relative to the prior.
world. I think a second thing is that the markets are oddly open. Like legal never bought any
software. It was really hard to sell into legal, but because of AI, suddenly RV can exist, right?
And then the third thing is that a lot of this is about what you're saying, which is the
tams of markets are shifting from seat-based pricing or seat-based value to labor. You're
replacing human labor. And so you're looking at, for example, customer support. It's not Zendaz,
How many seats can you sell the customer support reps?
It's how much can you augment and do work for customer support reps?
It's the labor market versus the software market.
And I think that's very underappreciated when you think about market size for some of these things.
You're really going to miss the size of these markets and how big they are.
The services economy that we looked at on my team in terms of where AI could intervene is about $5 trillion.
So it's a lot of GDP is accessible to this.
And so then you ask, okay, is it a workflow that's a workflow that's,
specialized to customer support legal whatever is it a roll-up where you're buying assets and changing
them is it a different approach like how do you sort of span all the change that's coming because of
this uh ken griffin gave a talk earlier this week and he was saying that in 1999 and 2000
it was very obvious that the internet was going to change the world change the way that our economies
run yet it still took 15 years for it to actually have an impact and he was comparing that
to today, the difference of today is that we have the internet so we can deliver these products
instantaneously to the entire world. Do you think that this time can be different and we can
as an industry unlock the value of this technology on a shorter timeline than the internet
took because we just didn't have, you know, the internet is the greatest distribution engine
in history? Yeah, that's an excellent question. And I think both things can be true simultaneously,
which is we're seeing real revenue for these companies, right?
Cursor is rumored to be in the high hundreds of millions of revenue.
You know, Azure added something like two or three billion of the AI revenue per quarter
from sort of a cold start two or three years ago, right?
That's amazing.
That's like $10 billion run rate plus to stuff of AI revenue, right?
So it is working.
It is being adopted.
But the flip side of it is it'll probably take a decade, right?
And so I think both of those things are true.
And I think the biggest impediment to adoption isn't the technology.
We could do so much stuff with the technology right now.
It's organizational process.
It's workflow management.
It's all the stuff that happens when a big enterprise uses anything.
And they're like, you want me to change my tooling?
You want me to change my people.
You want me to, you know, my processes.
And that's what's going to slow it down.
And that's slow down every technology way.
But to your point, we have massive distribution.
It's already everywhere in some sense, right?
I don't know that you guys probably know the number.
You just talk to Sam Alman, right?
What's the number of people using chat TPT per month?
but that's a huge impact already.
It must be around a billion.
It has to be north of a billion
because they're reporting 800 weekly active use.
If you have 800 weekly,
you have to have over a billion
and that feels like such a new cycle,
but maybe he's just keeping it in his back pocket
for when it needs a good cycle.
A bit of a wild card question,
and I didn't plan this,
so I didn't mention it beforehand.
No, it's not bad, but I just think it's interesting.
If you couldn't be an entrepreneur
and you couldn't be an investor,
what hyperscaler would you want to work at?
where, you know, be an executive app.
That's interesting.
Oh, that's so interesting.
I don't know.
I could make arguments for two or three of them because I think there's such different
problems to be had and different assets.
You know, Google, for example, just has such amazing assets relative to this era, right?
They have the most data.
They have the most compute.
They have amazing cash flow.
I mean, they're just like in a great spot.
Deep mind.
Yeah.
It's a really crazy stock over there.
Yeah.
Yeah, amazing stack.
So there's amazing things they could do.
Obviously, there's crazy stuff Microsoft can do on the business side, plus with GitHub and co-pilot and everything.
So they should really be driving a lot of the coding future, in my opinion, if they make the right moves over time.
And so you can kind of go through one by one and say there's really interesting things to be done with meta in terms of social.
I think there's opportunities everywhere.
Give us an update on AI roll-ups.
You have some investments here from my understanding, but how do you see the category evolving?
We see new teams coming together to attack various markets with this strategy almost daily now.
But what's your view?
Yeah, I think so it's back to if you look at services in the U.S.
It's three and a half to five trillion a bit is sort of labor that to some extent could be augmented or displaced by AI.
And so the idea is, can you, there's certain types of companies that are going to be very slow to adopt software or AI.
And so there's two things you can do with that.
You can wait and build a software company that will take a really long time.
You can actually buy those companies, implement the AI changes and dramatically change their margin structure.
And that doesn't mean letting people go.
It could just mean you make people five times more productive for certain types of roles.
So you can look at different businesses where 80% of the cost of that business is repetitive white collar labor.
and so you can help augment or automate stuff for people.
And so I looked at a few dozen teams or companies doing this.
I ended up backing two of them.
And really, you need three things to make this sort of strategy work,
which is truly transforming a business with AI and then scaling it up.
The first is you need a great AI person, obviously, right?
You need to build one of the technology.
Second, you need a great PE person.
You need to buy assets properly, understand your envelope.
Just like a SaaS company has its ICP or customer profile.
It was after you almost have your M&A profile, like what fits in my pocket of stuff that I want to go after.
And then last, you need somebody who's operationally great who can rework the organization against the AI because that's often the hard part, right?
You actually have to get people to use this stuff in order to be implemented.
And so very, very few of these teams have all three of those things.
And many of these teams are basically doing traditional P.E. roll-ups.
They're not really using AI, but they're raising at AI prices and then they're buying at P.E. prices.
And so this arbing.
And so I've tended to avoid arbitrage.
Yeah, it seems like a great deal with the founder.
In another world, they'd be doing a private equity fund with two and 20,
and then here they can go out and raise and dilute 20, you know, raise 20 on 100,
and then they own 80% of the business.
Yeah, remarkable.
Yeah, it's a very smart thing to do.
And if I was a PE person, I'd totally go do that and say I'm doing AI.
But most of these things aren't doing AI, right?
But a handful of them that are going to be massive, right?
Imagine an AI Danaher, right?
It's just, it can really be transformative to big sectors.
And it changes something from a services margin to a software margin business with software leverage.
So it changes the characteristics of the business.
Sort of flashing back in your career.
One of my questions I've always had on my mind is that you kind of like created the solo capitalist idea.
People have kind of, you know, put that label with you.
Was that just a happy accident?
Were you deliberate that you didn't wrap what you were doing in a firm?
There's obviously people that start with similar scales, but wrap it in a firm with a brand.
Like, how thoughtful was that?
What were the considerations?
Do you like how that played out?
Yeah, I think, you know, for a while it really was just me.
So it wasn't some strategic move to, you know, do something.
It was just I was on my own doing stuff.
And I, you know, and then eventually I brought on people for back office and finance because, like, I think that's really important, right?
You want compliance.
You want things to be proper and all that.
And then I got this moniker, and I never asked for it, right?
I actually am happy to be called whatever as long as I get to be involved with the most interesting technology and technologists in the world.
You know, they could call me, I don't know what, a carpenter.
They could call you big VC, big venture capital.
That's the one thing I don't want to be called.
Other than that, I think I think what we do is different from like traditional VC too.
You know, like I don't, I, we do traditional investing and we do traditional venture, but I actually think we do a bunch of other stuff and we do interesting.
projects around, you know, things like one person on my team who's working as an investor
as a technical background is actually driving AI-driven translation of the world's thousand
most important books that are off a copyright. And we're working with a few really big
foundation mobs on that. So we do stuff like that too, just because it's interesting. So I hope
it's never just a venture fund. But do you think when do you expect AI to transform venture capital?
I think it's notable that the firm today and the activities of the firm look quite similar to pre-chat GPT.
Maybe you can write an investment memo faster.
Maybe you can seem like you prepped for a board meeting better, you know, if you just drop the deck in and ask for a summary.
But it doesn't feel like it has changed the profession at all yet.
It's still finding and winning allocation and, you know.
Yeah, I think you can help with some aspects of diligence, to your point.
Like, it can pull competitors and things like that, to some extent, it depends on the market.
You know, there may be weird uses that nobody's done yet.
So an example would be, have you ever done the prompts where you ask the AI to, like, cold face read somebody and tell you about their personality?
No, you upload anything like that?
Yeah, I mean, just analyzing somebody's personality with a picture, even just any picture of their face.
Yeah, it's pretty, I mean, this is like the schizzo is called his physiognomy.
Sure, sure, sure.
Yeah, yeah, yeah.
But there's stuff like that where I've done that just for fun with my friends, right?
I'm like, hey, what is this person like?
And my friend's sitting there with me, right?
I'm not secretly trying to psycho-hachshund or something.
And then I'll ask it to give me a detailed breakdown of those characteristics and why,
and I'll say, oh, this person looks like they have a genuine sense of humor and they're warm
because of the way that the crow's eyes around their eyes exist in this way versus
somebody who fake smiles because it doesn't get to the eyes so there's no wrinkling and you're like
wow that's actually like super interesting right and so it'll break down the sense of humor it'll break
down uh how likely that person is to be louder quiet the likely aggressiveness like all this stuff
yeah you can imagine there's there's a somebody could create an EQ co-pilot for the new like meta
display glasses you can just walk around and i and if i'm maybe i'm really high IQ but i don't read
people that well i could look at john and say uh which is probably probably inverted
But I could look at John and be like, oh, John is, John's very interested in the conversation.
And he clearly wants to be friends.
So I think there's more to build there.
Give us the update on your company with Jared Kushner.
I know he's been very busy.
But I'm excited to hear the latest.
Oh, sure.
Yeah.
So we recently launched a company that's called BrainCo, which is focused on using AI as basically a platform to help transform the world's largest institution.
And so we've been working with a number of large enterprises, some private equity, and other firms around this.
And so this has been a fun project to do with him and with Eric Wu and Louis Vittigray and a few other people.
Eric was the former CEO of Open Door.
And then Lewis is the former finance minister and foreign minister of Mexico.
So it's kind of this interesting group of people coming together to try and solve really big AI problems.
So that's been really fun.
So is this realizing how much the Accenture?
and the McKinsey's of the world,
we're getting paid to make pitch decks on basically,
here's what you should know about AI for your business
and realizing, hey, we could probably do that a lot better
and then ultimately build software within these organizations.
Yeah, it's much more focused on the software side of it.
So basically there's a common platform that's involved
in terms of dealing with different forms of data,
dealing with e-vals,
dealing with a lot of the things that every enterprise needs to build
in order to really adopt AI.
And then we build vertical-specific applications on top of that or in some cases for horizontal applications that can be reused over and over by similar companies in the same vertical.
So you could imagine, for example, for a financial industry company, there's like a dozen things that every single one of them needs to build and there's some customization around it.
It's kind of funny because if you look at very large deals, right, if you're Dell or your VMware or your Oracle and you do like a tens of millions of dollar deal with a customer, you're going to have customization against that customer.
You can afford to do it, but also it's important enough to do that for them.
And so it's similar in that regards where we have common infrastructure, common platform, the same vertical applications.
But then there's going to be some customization per client, just like any other giant, you know, enterprise company.
Have you thought about slicing the target customer either across vertical?
Like, we're not doing health care because of HIPAA just yet or we're not doing defense because of Fed ramp just yet.
or we think we have a lot
in industrials that we can go after
or are you more focused on
slicing by market cap
or size of business like yeah we're not
going to work with mid-market companies
how do you think about like where the wheelhouse
customer will be?
Yeah, it's very much
the goal is to work
almost solely and there's going to be
some counter examples of this
with companies that are truly the
world's biggest institutions in terms of
revenue market cap and then
potentially impact which means sometimes you work
with somebody a little bit smaller, but the goal is to ask, how can you use AI to really get
leverage on things that are important at sort of a massive scale?
Yeah, there was a report that J.P. Morgan is spending $2 billion a year investing in AI to
effectively save $2 billion a year by automating. It's like when there's that much. Yeah, yeah,
they're breaking even, basically. I mean, presumably like some of those savings are durable, but
but certainly there's a lot of money.
What do you, how good do you think you've gotten at clocking
AI pilot revenue as non-durable?
Because I'm sure you saw that headline.
An MIT study came out that said basically 95% of pilots are not actually delivering in value.
This felt like the year, the year of the pilot next year is maybe the year of reality.
But I don't know how you see it.
Yeah, I just viewed that as a standard technology cycle. I thought that was a very overstated article. So, you know, this happened with mobile. You do the kind of crappy mobile app. I don't know if you guys remember the first B of A mobile app. It was basically like a, yeah, it was just like a web page. Yeah, but everyone was just wrapping it. Well, the current B of A app is still pretty rough.
I actually think it's pretty good. Like you can go an ATM. You can take out cash. I think I'm the only person who still does that. You can take pictures of checks. You can pay with Zelle. You can do all these things, right, that you can do.
before. But you started off and you tried to log in and the thing would crash. So I just feel
like we're kind of in that era of AI implementation. People will get it. It'll take a decade to fully
sort of propagate to your earlier point. But it really is the big wave that we're living through
right now. And I think it's truly transformative. Would you ever, would you ever, have you ever
considered an LBO of any of these companies that are in the SaaSpocalypse and the public markets that
clearly have some, you know, super meaningful customer relationships and a ton of potential
important place in their market, but just aren't evolving their business model quickly
enough? Yeah, we've looked at that, actually. I think there's a few really interesting things
to be done at scale. And to your point, I think part of it is just driven by, can you actually
implement AI? And I think if you look at the private equity industry in general, they've talked
a lot about tech transformation. That was a prior wave, right? Like 10 years ago, and you had all
these tech-based roll-ups, like Compass was supposedly a technology company. And it's a great
company, but it's not really a tech company, right? And so I think we've kind of lived through
the cycle before where people do almost like fake tech implementation, where they claim they're doing
it, they get a higher valuation, and it doesn't quite happen. They still load up the company
with debt. They still run it a certain way. The drivers are different. The CEO is the wrong person,
etc. I think there's a good version of that to be done. I don't think it's easy, but if you do it,
I think you can unlock an enormous amount of potential in companies that won't make it otherwise or won't go there.
And so, yeah, I think that's a super interesting area.
And we've looked at a few things over time.
And part of the decision sometimes is, like, do you want to try and do that or just fund a startup that you think we'll get there instead?
And it's a little bit of that.
It's kind of easier to just find a startup because buying a company and transforming it is quite hard.
Yeah, it has to be a company that is, I mean, is at a sufficient.
scale. Obviously, we just saw that
the EA, LBO, you don't need
to go that big, but finding something that's
like really a whale. Can't hurt
to go that big, though. Yeah, I would like, we would like
to see you go that big. I would love to see you. I feel like
that's the next. That's the next. I feel
like you've done it all at the early stage.
You've done it all in growth. I feel like
just get into the... How let an Activision
spin out? Activision spin out.
Take Microsoft Game Pass.
Xbox. I know. I'm not.
Moving too slow.
I know. You're like my mother. You're putting all those pressure on me.
I know. That's our small ask is set the record.
Wait, wait. Do you have any note? We like to ring the gong for people around here when they share a number. Do you have any number you can share?
What's your favorite number? Number of deals, number of AUM, number of, I don't know, anything. What's a number that quantifies your corpus of work?
Number of startups founded. My corpus. I've started, well, I've started two companies directly and there's two I've incubated. So, that's a lot of business.
It's a relatively modest amount for the amount of EV created.
Yes, yes.
It's a good, good hit rate.
Well, thank you so much for stopping.
This was a lot of fun.
Really glad to do it again.
We'll talk to you soon.
We'll talk to you soon.
Have a good day.
I appreciate it.
Take care.
Before our next guest joins, let me tell you about numeralhq.com, sales tax on autopilot,
spend less than five minutes per month on sales tax compliance.
I hate to pick favorites.
I hate to say it.
I was more engaged for a lot than a lot.
It was great.
A lot was great.
But his book, High Growth Handbook.
Yes.
Fantastic.
It's a series of interviews.
It's my, yeah, is my favorite, favorite business book.
Yeah.
No, it's a great.
High Growth Handbook.
Scaling startups from 10 to 10,000 people.
You interviews, some hitters for that.
Timeless, a bunch of great interviews.
And, yeah, you should go pick it up.
I need to re-listen to it.
Well, without further ado, we have Robbie Stein from Google in the Restream Waiting.
room. Welcome to the show. Robbie, how are you doing? Welcome. Good to see you. Hey. Hi. Can you guys
hear you? We can hear you. I know people are going to be confused. So why don't we just get out in
front of it and explain your role at Google relative to Gemini, relative to AI? Take us on a little
Game of Thrones, HBO intro of the map of Google and where you fit in. Sure. Yeah. So I work on the
Google search team. So that's the search bar. You type things in. Yeah, I was going to ask,
could you explain Google. Yeah, it's a thing. You can type a question in. Sometimes you could
use a camera. I don't know if you've used Google lens. Oh, yeah. And also Google that way, too.
There's this app. It's also called Google. All that kind of stuff is, it was where I focus my time.
Consist. And the don't forget about the I'm feeling lucky button. Yeah. Yes. Yes. So how do you think
about integration with the DeepMind team, integration with the Gemini team, how do you think
about bringing AI to search? Yeah, so we work very closely with the Google DeepMind team,
DEMIS, KORI, that whole group. And the way you think about it is we want to have front tier
models right in search, so you can really ask anything, and have the ability to use all of searches,
incredible knowledge, real-time information systems, and context of the web to help give people
this incredible information. And that's really where the two come together. Yeah, there was this
question, there's like, you know, chattering class being like, oh, well, Google's, you know,
it's such a different paradigm chat versus the search, 10 blue links. But have you drawn on the fact
that Google's search started with two modalities? The I'm feeling lucky button was a different
way to interact with Google search. The 10 blue links was one way. How are you thinking about
how you like kind of level up or educate the consumer to use all the different tools,
since now there's not just search results and AI overviews,
but there's so many different things.
How do you think about ramping those up?
Yeah, so there's always been many ways to use search.
Actually, Google Lens is a good example.
You can take a picture of something.
You can ask what is going on with this plant that seems to be dying,
and you can get information from that right from the camera.
And that happens in the app.
So there's always been different ways that you could access and tap into.
to this search knowledge base.
But I think increasingly it feels like you want to go to search, ask whatever you have in mind.
You only want to think about where you're going to ask that question.
And then if you have something where AI is really helpful, you get this little AI preview,
it's starting to show up now around AI overviews.
And if you click into that, you're in this AI-driven experience.
And we've now, through a new project we launched called AI Mode, allow you to follow up,
go deeper, and have a full generative end-to-end chat-like experience right within Google Search.
Yeah. Walk me through the international expansion. I'd love to know if legal or engineering is more rate limiting there. It feels like it's got to be incredibly complex to check all the boxes when you want to expand. You've obviously expand really fast. So what's the secret to taking over the entire world so quickly?
Well, our newest product, AI mode, which is the thing that lets you really ask anything within Google search using Frontier.
state-of-the-art models. We launched in the U.S. and then quickly in India, a couple
countries, UK, over the summer, May, June, July timeline. And then just a couple months later
now, we're at over 200 countries, 40 languages. We moved really fast to ship that. And so
we're now basically everywhere, except for a couple countries. And there's certainly a bunch
of considerations, policy, and infrastructure. Honestly, they both affect the timeline.
Oh, yeah, because there's actually inference going on, so you need local compute, basically.
more than you want to make sure to do quality checks because in every
language you have different permutations or you have multilingual people moving between
English and other languages just want to make sure everything is doing what you
expected to do you know this is also a multi-turn conversational experience so when
you evaluate it you want to make sure that it's dialed before you go and so each of
those just takes time I know I know everyone's always frustrated like why can I use it
today it's the main thing I see on X but hopefully now almost everyone can how are
Are GPUs allocated at Google? You have TPUs. You have TPUs in the cloud. You're selling them now. Obviously, DeepMind
wants a bunch of research. Everyone gets one rack. You're split it equally. But I imagine that, you know,
is there a spreadsheet? Like, what's the process to actually figure out where to allocate GPUs or
GPUs? Yeah. I mean, there's an allocation process. I mean, everyone needs TPUs. It's just compute is by far the
most important thing in driving infrastructure right now.
I mean, there's lots of needs, but they're important things.
We want search.
They search is one of the largest ways people interact with AI, so that's like a very important
one.
Obviously, we're doing frontier modeling work.
We've got a bunch of things happening in cloud.
So that's, there's a process by which you do those.
It's funny, I did an event and a Google team actually gave me like an old ironwood like
prior gen single TPU in this little case.
That's cool.
And I was joking that somehow I could like crack it open and like refurb it and like
get it up and running, I can somehow, like, improve my standing on the team, but I don't think
it's going to happen.
A couple of blocks.
How often do you guys come back to Google's mission when thinking about product decisions?
We've talked about this on the show before.
There's always, you know, I'm sure you wake up every morning.
There's a new headline.
What is Google doing in AI?
Why haven't they released this faster, et cetera, et cetera?
but I you know we were never we never really stressed about it too much because when you look back
I have an AI overview here I said what is Google's mission my AI overview says Google's official mission is to organize the world's information and make it universally accessible and useful and it feels like LLMs are just so aligned that it's a perfect technology to to carry out the mission and so it's like relax everyone I think this is this is like a natural evolution for
the company. Yeah, I mean, we talk a lot of internally actually about how the mission has never
felt more relevant. And it is really incredible to work somewhere. I worked to Google in 2007 for
a while, did some startups and worked in some other companies too. I'm back now. And it feels that same
level of entrepreneurialism in 2007 where it's like you're building all these new things for
the first time, except you're kind of building them again because AI allows you to say, what does
search look like if you could really ask literally any question and have created an AI? That's the most
knowledgeable AI out there that could understand all of Google's information, the context of the
web, and you could talk to it. And by the way, you could talk to it live. We just announced
search live that's available. So if you're driving, you could just talk to Google, literally
like in your car. You could take a picture and have this multimodal conversation back and forth now.
Like, this is all stuff that talked about a long time ago, but was limited because of technology.
So that is incredibly exciting. It's very motivating. And I do feel like it's one of the reasons
people on the team are fired up. How do you think, I mean, it's so interesting that,
But as LLMs boomed, AI search overviews made a ton of sense, were baked in, adopted, loved.
But now we're already in the next phase, which feels like agentic purchasing, agentic checkout.
How do you think about evolving the product even further to go from knowledge retrieval to taking action?
Yeah.
We have a bunch actually active there.
And we recently launched in the U.S.
an Agenic experience where you can book restaurants and local services through Agenic.
So it's actually really neat.
Through AI mode now, you can just have a conversation, hey, what's a good date-night place?
It'll do all the thing.
It'll tap into the knowledge of Google.
It'll look up Google places.
It'll do research.
It'll do whatever.
But then if you want to start a task, it'll also go bring back availability across talk
and open table, like right in the experience.
And you can just book it.
And it's awesome.
I've been using that.
It's just a small example of what's possible.
you know, people come to Google, not just for information, but they get things done.
It just materializes itself as a query, but you're not like, I don't like want to just know
restaurant reservation availability and they're like, oh, sweet, I'm glad to know there's
a table available.
I'm going to go back to my day.
Like, you're trying to do something.
We think about that a lot.
And that's just the, you know, the surface that there's so much people are trying to do,
but they're just kind of getting started with those journeys on search.
What could we do to really help you?
Shopping's a big one.
So we just launched a new visual way to do AI, which,
is one of the first ways where AI can be helpful
with inspirational tasks. So now in AIMut,
if you ask to design a bedroom or look up
landscape lighting, it actually finds you
beautiful inspirational imagery and
products in a grid. You could click on
it, you can imagine getting much more help
finalizing those purchases,
doing, you know, being reminded of price
changes, and it's much more of this
interactive version of search that can
do things for you and you can really
connect with versus just a pure
informational experience.
Right now, my
my mental model for is like Google.com, the search bar, then AI mode almost as a vertical product
like flights, like images, like shopping, where it's sort of a portal or subproduct that I get,
you know, I go down a funnel and I wind up in. Do you see that holding or do you think that
AI mode acts as a wrapper on top of all the different sub-search products.
Yeah.
I think what's going to happen is you have this AI mode, which is going to hopefully be this
most knowledgeable AI possible.
It knows everything in Google, billions of products, hundreds of millions of locations,
all of the web, and it has access to all of it, knows how to use Google as a tool,
and it's super powerful.
But not necessarily the best thing for all things.
Like if you just need a specific phone number, you'd probably get that in like 50 milliseconds
right at the top of the page.
You just want to know a sports score, what's literally the sports score right now, just works.
You just, you know, you put it in Google.
Or if you're just looking up a musician's name for the first time, you're trying to get a browsier experience.
Like, you actually want to kind of see images.
You want to see what's going on at.
What are people saying on X, which shows up in the search page?
So I think what happens is you have this incredibly knowledgeable system that we feel like is designed for more complex tasks, more of this like, how do I do this, like, how do I do this trip?
I need this restaurant.
I'm trying to buy some jeans.
How do I get started with that?
and that if you have knowledge baked into that, that's really powerful.
But then people need, how do you bring that to people?
And there's basically me two ways.
One is you just search and through AI overviews, we will show AI where we think it's useful.
And for many queries, it's not useful actually, which is why it doesn't show up.
The system learns that.
But for these longer queries, we have a specific question.
She typically shows up there.
Then the other ways for power users, we feel like they kind of have this mental model of like, oh, like this, I'm doing this planning thing.
You're like, oh, I'm really curious to know, like, what a stock price difference between these three stocks are over some period of time.
We wish you could just type that in natural language and have the thing generate a chart and use Google Finance as a tool, which it will do.
And for that, you can go right to AI mode.
So if you can do that through the mode, you can do it on mobile through those direct kind of buttons to go right to AI mode.
You can go through Chrome now.
We announced like a way to just type and go right to the eye mode in Chrome.
And you could also just go to Google.com.
AI now which is kind of fun what anomalies are you seeing uh have you seen any of these
screenshots of uh of google trend data people are are posting you know people forever have been
posting screenshots of effectively search data and uh using them to infer what's happening in in
the world right and so over the past few months we've seen people posting uh search queries like help with
my mortgage and it's just like a crazy ramp up into the right. My intuition is that it's potentially
a bunch of different keywords are seeing these crazy ramps because there's potentially
agents sort of like leveraging Google search to drive a higher volume of searches on potentially
a search that's happening maybe in an LLM. Have you seen any anomalies there? Is that something
you're aware of?
Haven't personally seen any anomalies there.
I haven't really heard of that before.
So I wouldn't look, I wouldn't buy too much into that.
We do have protections for those kinds of things.
I think in general, what we're seeing is people who are using Google very differently
and at a very fast growth.
So people are asking very specific questions of Google.
They're using Google lens and asking multimodal questions.
They're asking follow-ups.
I mean, those are kinds of things that we're seeing in such a broad way.
I think that's the thing that we mostly focus on.
But yeah, I can't speak more to some of the trends things that you're mentioning.
How do you think about advice for brands?
I've run brands and, you know, grinded my way up the SEO rankings.
I never did a ton of optimization.
Most of my strategy was just try and make something eventually that people talk about
and it gets written about and those websites have, you know, ranking power and then you kind of
rise to the top of that keyword. Is any of that changing in terms of in the AI shift? What advice
are you giving to brands that want to perform on Google these days organically?
Yeah. But what's really interesting is I think the core Google search ranking is more relevant
than ever. Because it turns out that one of the best things that every AI model does now,
is they kind of like search the web.
It's like, I don't know.
Like, what are you trying to do?
Oh, I don't know.
I'm trying to figure out if, like, I should go to this hotel.
All right.
Well, like, it's not a parametric knowledge.
Do you, like, know the rates of those hotels?
Like, I can't, okay, I'm going to search the web, right?
And even AI mode is special in that we're Google.
And so it uses Google really effectively.
And it creates these query fanouts.
It does dozens of queries.
But effectively is Googling stuff, right?
And everyone's Googling stuff all the time.
So for a given question, what are the things that show up as high,
relevant to a given question, those end up getting absorbed into the context window and have
a high probability of being displayed to the user.
And so if you are just thinking, how do I build great original content that's trusted
and authoritative specific kind of query, turns out that's still going to likely be very
valuable.
And you can go read the Google guidelines on content and Human Raider guidelines.
I think they're super interesting.
There's lots of detail in there on how Google evaluates trustful, high-quality content.
and scoring systems that are used.
It turns out that's a really good investment
because every other system is kind of proxying
for the info that's most useful for a question.
Yeah.
So that's my main advice is to kind of like dig in more
on understanding how those systems work
because it's largely going to apply later.
Yeah.
And then the second one is what are people using AI for?
Those are going to the growing kind of needs.
Oh, sure, sure.
And there's a disproportionate amount of use case
in different types of domains now with AI
because it allows complex needs.
And it allows for things like advice.
It allows for things like really nuanced troubleshooting with stuff.
It allows for these emotional needs to be satisfied differently in mental health.
So those are areas that are probably growing markets of use cases.
And I would be a student of those as well.
What about, sorry, can I have one more on that?
So what about content that was previously buried to Google that is now available for search rankings because of artificial intelligence?
I'm thinking about like literally this show, it will be a three-hour video on YouTube that, you know, a buried mention previously probably wouldn't be perfectly translated, indexed, et cetera, et cetera.
But I would imagine that the strength of like video content and audio content gets relatively better over time in the AI era.
I mean, honestly, you guys have been doing this for probably a decade, but take me through a little bit of that.
Is that a reasonable thesis?
Actually, it is a reasonable thesis.
We have been seeing an increased diversity of the kinds of pages and sites that show up within AI.
Because people are asking these nuanced questions.
A lot of times there isn't even like a single web page that has this information.
But if someone, I don't know, sometime in the future, this video gets segmented and scanned and understood by Google.
And someone asks for like, I don't know, an interesting conversation on Google's AI journey, re-creating search for the AI era.
Oh, sure, sure.
Maybe it's like, here's a cool conversation you could check out.
And this, like, clip will show up now in a way that would be very difficult for that to happen
unless you search for, like, TBPN, like, interview of whatever, right, which was, like,
very specific keyword based on the content.
Or we'd have to go manually create a transcript and then get that into, like, the text SEO world.
So, yeah, very different era.
Sorry.
What are, what are the plans around giving, if there are any giving publishers control over whether
or not their content is used in various AI functionality.
Yeah.
We have a bunch of publisher controls we have.
So there's an overall opt-out training side.
You know, in search, you can opt out of crawling.
You can opt out of this other thing called snippets where you can show up in Google,
but you won't show up in these rich experiences if you want.
And so there's a bunch of things that, you know, publishers can do and can look at there.
But, you know, I think ultimately the belief I have is that to the prior conversation,
you know, AI should be this massive discovery engine over time.
Because if you think about it, these complex needs, we're getting growth.
Like we're seeing 10% growth, for instance, in large markets like India and the U.S.
for these really specific questions.
Which at Google scale is like enormous, enormous number.
Where if you have a really specific question, people are doing that more and more and more and more
because you can get AI to go deeper.
Multimodal, right?
You're asking you taking a photo of something.
and you want to shop it, I'm seeing 70% year-over-year increases and those kinds of questions.
And these are billions and billions of queries.
Like, so these are huge numbers.
Wait, how many queries?
Billions?
Billions.
Yes.
Oh, that's so good.
The sneaky guy is.
I'm sorry.
No, that was totally worth it.
I'm glad you did that.
Thank you.
So, like, these are big numbers, and each of those generate AI experiences.
with links to go deeper on stuff, every single one of them.
And so theoretically, you should have this, like, unique opportunity to say,
oh, did you take a picture of your bookshelf?
What book should I read?
Oh, well, here are cool reviews of other books that are like things you've liked.
And it's like, I could never Google that before.
And so theoretically, you should have, because it's an expansionary moment,
we're seeing that this is an expansion more than anything.
It's like the old, like the way people Google, they're Googling,
and they're using it in all of these new ways.
And so hopefully over the long term, that produces great.
growth. I have a lot more questions, but we'll have to follow up. Yeah, yeah, we could go way
deeper here. I would love to even even just dig into how TBPN shows up on Google. It's such a
fascinating content because we create so much content all over the web. But thank you so much for
taking the time to hop on the show. Thanks for having me. Thanks for fantastic. And congratulations on
the progress. We'll talk to you soon. Thanks so much. Cheers. See, guys. The great rest of your day.
Before we bring in our next guest, let me tell you about fin.a.i. The number one AI agent for customer
service, number one in performance benchmarks, number one in competitive bakeoffs, number one
ranking on G2, and we have Morgan Housel in the Restream waiting room. We're going to bring
it into the TPPN Ultradome. We're very excited to catch up with you again. One of our earliest and
just most enjoyable guests, I had such a fun conversation.
One of my favorite conversations ever across a thousand plus interviews. Remarkable. So thank you so much
for taking the time to hop on the show. Especially in a huge, huge week. Congratulations on the
lunch. Big shoes to fill. Thanks, guys. Nice to see you. Yeah, give us the update, set the table.
What's going on this week? Tell people, get that gong ready. Yeah, so my third book,
The Art of Spending Money, came out this week on Tuesday. You know, it's a tough thing with,
there it is. Thank you. Thank you. It's a weird thing with books. I feel like it's almost like
a startup where I've been a writer for 20 years, but you get like three shots on goal when a book comes
out. And when you're writing a blog post, if it sucks, and at times they do, there's always
next week. It's not that big of a deal. When you write a book, you really got to be like,
this is it. You really got to put your best foot forth. So it's always a stressful thing to go
through. Was the process different for this book from the other ones? Do you, we've heard from
authors who like go lock themselves in a cabin. Like, what's your process like and has it changed?
It's usually roughly this. It's about a year of very informal noodling where it's like,
I'll be going for a walk and be like, oh, that would be a cool chapter and I could use this story.
It's a year of that, like, just no effort.
And then three months of part-time writing and three months of full-time writing, during the last two weeks of the full-time writing, the world does not exist outside of my keyboard.
That's usually how it works.
Yeah.
And are you, like, combing, like, front to back of the manuscript, like, every day?
Are you focused on, like, a single chapter for a full day?
Like, how do you actually, like, chop through, like, what becomes a full book?
It's usually the latter.
There's not much going through everything end to end until the very, very end of the process.
So it's usually just focusing on one chapter.
And very roughly, this is not a hard and fast rule.
But when I was writing it, it was like, I want to focus on one chapter per week.
And normally, I'd say if there's one thing that I've gotten a little bit better at over the years,
just a little bit better at, not perfect by any means, is that I think my first draft
is closer to my last draft than it used to be, not necessarily because I'm a better writer,
but because I'm better at knowing what writing is not going to work,
and then stopping it very quickly.
And so I think when I go through a chapter,
by the end of it, I can go back and scan it and be like,
oh, this is pretty good.
I'm going to set that aside.
And then when I do my little self-edit at the end,
that's usually where most of the work happens.
So it's much easier to write a book now that we have AI.
Yeah, what was your prompt?
I'm kidding.
I'm kidding.
Here's the thing.
Share the prompt.
I've talked to share the prompt.
Just give me the prompt.
Yeah, come on.
Just scared to show your prompt?
I was talking to a guy the other day
who just finished his manuscript
and he said without ChatGBT
GPT he would not have been able to write the book and I'm like
I love hearing that. I love that
if we can have a tool now
we're going to have more books being published because I think there are
people who have very good ideas who have a story
to tell but are too intimidating to write
a 50,000 word
manuscript which is not an easy thing to do
so if we can just get more people out there because they have
chat GBT to get them through writers block
awesome I think it's wonderful
I'm still old school
because I've been doing it for long enough
that I want to write every single one of my words
for better or worse
even if I could have done a better job
with some LLM like getting me through those blocks
I'm still going to try to power it through myself
I'm sure you saw David Simon
the creator of The Wire
there was a screenshot from an interview
someone asked him
okay you've spent your career creating television
without AI and I could imagine today
you thinking boy I wish I had that tool
to solve those thorny problems
David Simon says what
And the interviewer says, we're saying, dot, dot, dot, David Simon goes, you imagine that?
And the interviewer goes, boy, if that had existed, it would have screwed me over.
Simon says, I don't think AI can remotely challenge what writers do at a fundamentally creative level.
And then he says, I'd rather put a gun in my mouth.
There you go, yeah, just get right to it.
Here's what I think.
I've always thought that writer's block is actually a symptom of your idea sucks.
Sure.
And it's not working.
And the reason you can't find the words to get through
is because you know in your soul that this idea is not working.
Well, yeah, you fundamentally don't care about what you're writing about, right?
And I think as a, like, when I think about the points where I've been writing
that I cannot get, get myself moving, it's like writing that essay.
I had to take a class in college about dinosaurs.
Yeah.
I had to write a paper about dinosaurs.
You studied dinosaurs in college?
It was an actual class that fulfilled some sort of like science, some sort of requirement.
now your son is obsessed with dinosaurs.
Apple doesn't fall far from the tree.
That's incredible.
But you're writing about a topic
that you don't care about.
The words do not come easily.
You're not, if you don't care.
Of course.
Jordy's secretly a PhD paleontologist.
I'm finding this out for the first time.
Sorry.
No, I would say the flip side of that
is when you know you have a good idea
and it's a right idea,
the words just tend to fall right out
and it's no problem to get them on the paper.
And so I bring that up
because I think if you have writers block
and you're like, oh, let me use Chat,
GPT to get me through it, it will find a road through and it'll help you on to the next
paragraph. But then you're probably ignoring the signals of your idea not working. And you're
much more likely to get to the bottom and finish the essay or whatever it is, even if your idea
sucks and it didn't work. Yeah. I've noticed. Writers block is just this divine presence that's
telling you, you don't need to make this. Yeah. Yeah. It's not needed. It's not needed by the world.
And you can force through it. What did you actually, what did you actually do? I've been writing a
I think there's a, I think there's a similar analogy with music where I've heard from
many musicians, I am not one of them, of course, that their best songs were the easiest to write.
And like the tune, the lyrics just flowed right out.
And if they are struggling to figure this out, figure out the tune, figure out the lyrics,
it's probably because the song's not working.
It's usually the same.
Yeah, I've been writing a daily newsletter for this and to prep the show, about 500 words.
And I've noticed that I haven't been using AI for anything other than knowledge retrieval.
If I have to look up, what's the market cap of this company?
Of course, I go to chat GPT.
And then I also notice that a lot of times I'm kind of just reiterating, like a discussion
that I had with Jordy earlier in the morning.
And so I'll use dictation sometimes to just get some of the words down and then I'll
kind of write from there.
But I'm never crafting a prompt for what I'm writing, which I think is just interesting
because the models have gotten so much better and yet there's still something about,
like, I've got to come up with the own idea or like the seed of the debate.
Yeah.
What do you think?
Yeah.
It's also very difficult to really make it right in your voice.
So you can prompt it and say, write it like Jordy, like do it exactly, but it's not.
It's just, it hasn't gotten there yet.
I feel super grateful that it's still easy to clock AI generated text because if I'm scrolling on social media, maybe I see a post.
And then I'm in the comments, like, interested to see what other people think about it.
And I can just easily clock, okay, AI generated, I'm just going to skip it because it's probably just like summarizing it and asking a question.
but I worry we'll lose that ability to filter
like in the next iteration of the models.
It's definitely made me a sloppier writer
and I'm like deliberately not trying to craft
a perfect sentence structure constantly
because I feel like the rigidity
is just an extra layer that I impose on myself
and if I take that away,
it just kind of feels more stream of consciousness
and is just actually a better product.
I don't know.
Shifting gears.
Yeah, yeah.
Sorry. Go ahead.
I was going to say shifting gears to the book itself.
Yeah, yeah, I want to hear the thesis.
Do you think, well, maybe a kickoff question.
Do you think tech has figured out how to spend money?
Because there's always this critique that tech people don't know how to spend money.
And I think part of that was the tech uniform was not maybe like the East, you know, the West Coast tech uniform, jeans and a t-shirt and sneakers.
people sort of came, you know, participated in this industry in a very sort of plain way.
Patagonia, Jack, it's like 200 bucks, okay? It's reasonable.
Well, let's compare tech spenders to Wall Street spenders. The major difference is most tech
wealth is not liquid and Wall Street was paid in cash every year. So, so I mean,
that's one of the biggest, like tech wealth is a lot of paper wealth relative to Wall Street
wealth. That was so much more liquid. You can go buy the Rolex. You go buy the House and the Hamptons
cash. And so I think that, that's, that's,
That was probably part of it.
Yeah, there's a culture of, like, buying the watch based on, you know, a banker buying,
deciding what watch to buy based on the size of their Q4 bonus, right?
It's just like, it's going to be some percentage of that.
So the watch I get, well, you know, maybe it'll be a submariner, maybe it'll be to Daytona.
I don't know yet.
Yeah.
I do think there's something to be said that on Wall Street, your value and your success was how much money you made.
And in tech, it is much closer towards the product that you built and the intelligence that you have and whatnot.
And so there is less desire to show off wealth in tech because that's not what people get valued for.
And I can't think of hardly anyone in Wall Street outside of maybe Warren Buffett, who is very well respected and admired and wears a T-shirt and lives in a modest house.
It doesn't happen.
But you can name 100 of those people in tech who do that because they're valued for their ideas, not just their annual bonus.
On that illiquidity question, Paul Graham had a take recently that a lot of tech people, they're locked up,
and then by the time they can afford art, they struggle to get up to speed on the art world or something.
Does that resonate with you at all, just the fact that if you come on Wall Street and you can afford like the Rolex and then the AP and then the FP genre eventually, like, it just ladders you up the luxury ladder easier than just having all this money and being like, well, do I really want to jump to the top of this luxury?
ladder, just put the hedonic treadmill on 15 miles an hour on the first run?
Yeah, I think it's very difficult for people to know what they want.
They're very good at knowing what they need, and they're very good at knowing what they
don't want.
Knowing what you want is actually very difficult.
And part of the reason is because what I want might be totally different from what you want.
People have completely different needs and whatnot.
I think if you are thrust into wealth very quickly, there is knee-jerk reactions of what
you think you should want.
I want a mansion.
I want a fast car.
I want art.
I want the plane.
whatever it might be. And sometimes it's true and sometimes it's very not. And I think if you,
I think if I can predict all of your spending habits based off of your income, there's a very good
chance that you're not doing it right. Because there's a very good chance that you are just buying and
spending your money in the way that society told you to do. If you earn this much money and your
net worth is this, you should have this house and this car and this art and travel this way and
whatever it might be. And most of the time it just doesn't work that way. People have very unique
spending preferences. The people who I've seen, the wealthy people who I've seen, who have done
the best have a lot of really extreme quirks in their spending where they spend they're very wealthy
but they spend no money on cars or no money on travel no money on food whatever it's very unique to
them whatever it might be uh you're i'm i'm not a wine person in the slightest i'm not i'm not even
necessarily a travel person but a lot of people would be the exact opposite and that's fine so i think
it takes a lot of looking in the mirror so to speak to figure out who you are and to go down the
path of trying to figure out what you want which is not easy i i i think
feel on a personal level that my relationship with money has been very distorted because the business
that I started building in college ended up, you know, is cash flowed every month for my entire
adult life, which has been a tremendous benefit, but it's also completely, it's just distorted
the way that while in tech, the primary way you generate wealth is you get a measly salary
for a long time and then you get a whole lot of money at once or maybe you'd sell some secondary
along the way and get some liquidity but it's been this weird dynamic where it's like I remember
the first time I took a meaningful profit share from from my company I bought a nine I took the
entire amount and I bought a nine 11 because I was just like well I'm going to get the same amount
next month and then I'm going to have this 9-11 for a long time and so I had to kind of like
It took me a few years to kind of like learn that.
It's such a fascinating psychology.
Learn that lesson, whereas I wouldn't think like, oh, that's a lot of money.
I would just think of money in increments of basically months of cash flow.
Yeah, yeah.
I think there's good mental accounting there of like rather than thinking about the 9-11 costing 120 grand, you think of it as one month.
It costs me one month or something like that.
I think that's actually a smart way to do it.
And even I value a month even more.
now even though monthly income has like increased throughout my adult life because like I'm like a
month as a kid you're like I got all the time in the world now I'm turning 30 at the end of this
year I'm like oh time is a real thing it goes by you don't it's not you don't have a infinite
supply do people come how do you how do you think that makes me feel when you say times times like
running out because you're turning 30 how does it make everybody else feel I would I would kill
almost 30 well are you are you are you are you spending a lot of money on your health because
you looked younger than the last time you came on the show.
Maybe I just hadn't showered last time I was on the show.
I don't know.
But, you know, I do think there is a real thing where it's a fine balance between spend for
today, live for today, and save for tomorrow.
Both of them are really great ideas.
And it's never as simple as YOLO or, you know, save and save for the future.
It always just comes down to what are you going to regret?
What are you most likely to regret at some point in your future?
future. And it goes both ways for people. You could easily imagine looking at yourself 20 years
from now and regretting the trips you didn't take, the 9-11 you didn't buy, the house you didn't
buy. You can so easily imagine, too, looking back at some point in your life when you're tired
and your career is not working out, whatever it might be, and saying, I am so grateful that I
saved the way that I did. It gave me a sense of independence that I value more than anything
right now. What are your quotes?
Yeah, you're going to give your take on the, oh, sorry. You said a lot of successful people
have, you know, quirks in their spending. Do you, I imagine you understand your own at this point?
Yeah, I mean, this is a trivial and small thing, but I love this heuristic by Rob Henderson. He's a great
academic. And he says, rich people food looks better than it tastes and poor people food
taste better than it looks. And on that spectrum, I love, I love cheap food. I love Taco Bell.
I love Jimmy Johns. I can't get enough of it. And I've had, I've had some very expensive meals,
whatnot. And I have enjoyed them marginally at best. The best meals I've ever had tend to cost
the cheapest. And so it's such a trivial thing. But never what I want to be like, oh, I can
afford to eat this way. So let me abandon all the food that I love and go eat some food that
is subpar, because I'm supposed to like this stuff better when I don't. Did you cover private
aviation at all in the book? We had a funny conversation with a friend this morning. He basically
he said, my house is going to be paid off by the end of this year. And after that, I'm giving
all my money to Net Jets. He's not getting a second home. Which is a quirk in itself. He finds
commercial aviation to be very dehumanizing. I would, if you had a choice between two houses
and commercial or one house and Net Jets, a thousand times out of a thousand, I would do the latter.
Absolutely. Totally agree. Two houses are a giant pain in the ass anyways. But to answer your
question I do cover private aviation in that because I made this this observation that like having
a private plane is like the ultimate luxury if you talk to wealthy people they're like that's the
only thing that you get pleasure out that the house the yacht the car doesn't do you much the
plane will change your life forever and I think part of the reason we love it so much is because
the vast majority people in that situation remember what it was like to fly commercial now here's
the observation is nobody thinks it is an ultimate luxury to have a private car but virtually
all of us do. And the reason we don't think about it is because we've always had private cars.
And so there's nothing to compare it against. Now, you could imagine that if you spend your
entire life on a train, on a public train, or a public bus, and then you got a quote-unquote
private car, it would feel like the ultimate luxury. But we have nothing to compare it to.
Well, another example of, so much of their lure. Yeah, if you're, if someone's lucky enough to be
born into a family that only flies private, can you imagine their experience of flying?
They're like, oh, I don't want to fly.
It's going to, you can imagine they don't even have a positive feeling associated with flying private because it's all they know.
Because if you actually, you know, it's like, okay, I'm going to be up in the air and like the bathroom's small and I don't have that much access.
There's not that much.
There's some food, but it's not my favorite food.
Can't get Taco Bell delivered?
Yeah, exactly.
Exactly.
Right.
Right.
Do you think people, oh, I want to hear your reaction to Jordi's take that buying physical things.
is actually an experience, false dichotomy between, I just want to spend money on experiences.
Yeah, so I, growing up as a kid, I always loved brands, and I would get obsessed with different
things, whether it was mountain biking or snowboarding or surfing or anything.
And I would get fixated and obsessed with like a certain kind of surfboard, right?
As a kid, I wanted to surf mayhemes, but I couldn't really afford them.
they were super expensive and I worked at a surf shop I could get these other boards for a lot cheaper so I'd always get them now as an adult I only surf mayhams and I always we grew up in this era our generation was told constantly don't spend money on things spend money on experiences I never understood that because in my view it was like when I put on a jacket that I love and it's a thing and I wear it for the day it's an incredible experience or if I take this surfboard that's incredible
and I go out surfing with it.
That's an experience in itself.
So what do you, what's the verdict on things?
Can things make you happy?
I've found that things have and continue to make me happy in my life.
Yeah, totally.
Because I think what you broke down there is if nobody were watching and nobody could
see your surfboard, nobody could see your car, you would still buy them.
And therefore you're doing it for something that actually makes you happy rather than
trying to signal for the attention of strangers.
If you use like a fancy sports car, for example, there are some of something.
Some people who own Ferraris because they love the artistic engineering of it.
They love the line.
They love the beauty of it.
They love the growl.
They love the engine.
They work on it themselves.
They wax it themselves.
They love the art of owning it.
They love the acceleration.
They love driving it.
That's one group.
Another group just wants to get the attention of strangers.
And they just rip it down the road,
just trying to turn as many heads as they can.
The former is going to get way more happiness out of it than anyone else because they
would still do it if nobody was watching.
I think that's the framework.
is like, if nobody was watching how you lived, what would you spend your money on?
And as you just described it, I know you would still buy that surfboard.
And so it's the right thing to do.
I think the stuff versus experience tends to go astray to because particularly in the social
media world, a lot of experiences that we want to spend money on are literally just to impress
other people.
It's where should we go on summer vacation that's going to generate the best Instagram pick?
This is John's thesis on Europe.
He's like, I don't need to go to Europe.
We have lakes here.
We have oceans here.
Are we have mountains here?
Why would I leave the great United States?
You know what?
My example of this is Bali.
I don't know if you've ever been to Bali.
It's a dump.
Thank you.
Thank you.
My wife and I took our honeymoon to Bali, and it's a dump.
So I went there on multiple surf trips, and I only cared about the waves.
But the funny thing is people go on there on surf trips,
And, like, the actual best surfing in Indonesia is really not in Bali.
There's a handful of solid waves.
The downside is there's actual trash in the water.
You were just swimming and just, like, supposed, like, idyllic reef break.
And you're just swimming through plastic bags.
It's just absolutely disgusting.
On half the island, the water is just, like, brown and dirty.
And people surf in America, too.
Yeah.
And it's like, you want to say that you want to take the picture and say,
look at me, I'm in Bali in my trash water.
I think that's it.
I think Bali becomes a popular tourist destination
because people love to say I went to Bali
and post that on social media.
The whole time I was there,
my wife and I kept saying,
we could have flown to Maui,
which is a five-hour flight.
Instead, we flew 20 hours to Bali,
and it's 97% worse.
But I think, honestly,
we were attracted to it back in the day
before we knew better
because it sounded like a cool thing to do.
Like, oh, we could tell our friends
are going to Bali.
We didn't know anything else other
than it was a cool,
it sounded like a cool thing to do.
I don't want to, I don't want to, I don't want to say too, dunk too hard on Bali.
Part of why it's not as great as the hype is that there's too many people there.
So the hype sort of like created the problem.
I think it is, you know, probably is as nice as Maui just physically.
But the challenge is, again, the infrastructure, the traffic is a number of times have almost died on a scooter in Bali too.
Oh, yeah.
I'm surprised I'm surprised I'm here on this podcast.
Safety is real.
Right.
And so then it's like, if nobody could, if nobody got to hear where you're going on vacation,
you can't post it and you can't tell anyone else.
Never would I want to go to Maui.
I'd be like, ah, let's just go to Santa Barbara or let's go to Maui or something like that.
It's so much better and easier.
Yeah.
Totally.
I want to talk about like the, the, maybe the frame is like, do people ask you more questions
about or how do you see the job to be done by the book?
Is it more about how to, is it more about money or just happiness?
It's definitely more about happiness.
And one of the big points in the book is there is no formula for how to do this.
And so that's why when you have a formula like spend money on experiences, not stuff,
it tends not to work because I'm different than you are.
And people from different generations, different countries, different backgrounds,
totally want different things.
And I think it is immature to say that because I like spending my money on this,
you should too.
Or because I don't value this, you shouldn't either.
It's not, but it's an innocent mistake to make.
And a lot of people make it in finance.
assumption that there is a right answer to earning, saving, spending, investing.
It's a very individualistic endeavor. And so a lot of this, the question you ask, like,
do people ask me for advice on this? The advice I have, and people don't like to hear this,
is like, you need to figure it out for yourself. And so the book is about the psychology of envy
and contentment and social aspiration, which tend to be universal. But there's nothing in this
book that says you should spend your money like this. And so it's not called the science of
spending money because I don't think that exists at all.
Yeah.
What about, what do you, what kind of things that you can spend money on have the
worst value because when I talk about, when you, when you look at, uh, luxuries,
like maybe staying at an Amman property, Amman is maybe 10 times as expensive as like the
average four seasons. But I think it's probably like five times better in my opinion.
Yeah.
So, so it's not, it's not, it's not, it's not, it's not, it's not,
like a perfect trade, but it's at least if you only have a limited amount of vacation time a year and you want to have the best possible experience, I think it's a trade worth taking. You know, a trade worth making. But where do you think maybe is on the opposite side of that, things that are 10 times, do you think it's, you think it's, you think it's, you think it's, you think it's, you think it's, you think it's, you think it's, you think it's, I was a, I was a ski racer. And I'll say one, like, a little spending quirk that I have. This is slightly off topic. But I think it's, when, when I was a, I was a ski racer. And I, and I, I was a, and I
always felt that everyone else in my team had better gear than I did. They had, they had nicer
skis. They had a nicer jacket. They had all of that. And it drove me crazy. And so when my son, he's nine
now, when he started skiing to kind of make up for the, the hole in my soul that I had when I was a kid,
I was like, I'm going to buy you the best of everything. You're going to get, you're going to get
the nicest skis, the nicest everything. And the quirk is he could care less. He could not care
less about any of that, about having the nicest stuff. And so that too was like a realization of
like, that would have meant more to me than anything that I could have ever had.
And he could not care less because everyone has their little spending quirks about them.
Totally.
Last question from me.
I obviously were here.
I want to celebrate the book.
I want to promote this book.
But I'd love to know about another book that you think serves as just something you enjoy,
something that you, an author that you respect, maybe someone from the 20th century or 21st century author.
someone who you've pulled influence from or just have respect or just a book that you keep
coming back to.
Yeah, I mean, two nonfiction authors that I think are the greatest of modern times, they're
both still living, still writing.
One is Eric Larson and the other is Robert Carson.
They've both written some very famous books and some very successful books, and I think
their ability to craft a sentence and tell a story is unparalleled.
And even if I were to compare them of all the writers of the last 200 years or so,
I'd put them near the top.
It's just so, it's effortless to read their work.
Never do you have to reread a paragraph and say,
what are you trying to say here?
You can just kind of glaze your eyes over the page
and completely understand what they're saying.
And what I love about what Eric Larson in particularly does,
so he's a nonfiction writer,
writes books about like World War II and all these different events.
Some of his chapters are half a page.
And so some of his books can have 200 chapters
through each a page or two.
Because he's so good at just being like,
here's my point, I'm going to make the point,
use an example and boom I'm done
I don't need to ramble for another 17 pages
I'm just going to move on and that to me is
the key of good writing it's like the person
who can say the most in the fewest words wins
and he's the best at that
yeah I read devil in the white city a while
maybe a decade ago
fantastic book loved it
and perfect example of that thank you so much for coming
on the show so fun it's always a great time let's do it again
soon we're gonna this time we're just going to
send a recurring slot
your calendar you can move it if you want
but we love we love talking
It's always fun.
Hit the gong again for being number one in the business section on Amazon.
Business decision making.
I see you at number one.
And I'm sure many other charts to come.
Thanks, guys.
This is fun as always.
We'll talk.
Great to see you.
Before our next guest joins, let me tell you about Adio.
Customer relationship magic.
Adio is the AI native CRM that builds scales and grows your company to the next level.
CRM, super intelligence.
And we have another gong worthy guest.
Let's bring in Misha from reflection.
How are you doing?
Boom.
Hey, guys.
Good to see you again.
Good to see you.
You've been busy raising billion.
Jordi has this habit of telling people when they come on and they do a great interview.
We'll see you soon.
But you delivered.
I think you're the first person that if we roll the tape,
Jordy probably said, we'll see you back here.
We got to roll it back.
I bet you've said, knowing the progress you've made and the progress you will make,
I bet you'll be back on here with more news.
But quickly, give us a reintroduction to the company and, of course, give us the news.
A quick reintroduction to the company.
I'm Misha.
I'm the co-founder and CEO of Reflection, and together with Janice, we started the company
about a year and a half ago.
And we were formerly at DeepMind.
Janice was one of the founding engineers at DeepMind, contributed to a lot of projects
like AlphaGo and Gemini and recruited a team of about 60, I would say.
researchers and engineers from Frontier Labs.
And the charter of the company has opened up since we last spoke.
We've raised this capital to really build out the frontier open intelligence based in America
and exported to the rest of the world.
So before we get into the-
Yeah, before we get into the details, how much did you raise and who did you raise it from?
We raised in total of $2 billion from a syndicate of investors.
Oh, this has a gong hit from a syndicate of investors.
Everyone's excited.
Two billion.
Disruptive, DST 17-9, B Capital, a bunch of existing investors as well, like Lightspeed, Sequoia, and CRV, and so forth.
So it was quite, you know, we're very grateful for the support from the syndicate.
Okay, get, uh, get, uh, even more kind of granular with what the focus is today.
Yeah, my read on it is open, open source is the focus is that, putting deep seek out of business.
That's what I want to hear.
That's right. Uh, yeah, maybe the shorter is that, uh, it's a U.S. Deep Seek.
Yes. Yes. Yes. That's what we want. Thank you.
Yeah, frontier open weight models. Uh, that we trained here.
in America and export to the rest of the world.
So this is meant to be a global technology.
We have a big presence in the UK.
We have a team there.
And so this is not just, you know, even though it's American built,
it's really built for the world more broadly.
Can you share anything that you think you'll be able to do to outfox deep seek and GPTOSS?
We're having Dylan Patel from semi-analysis come on next.
And he's talking about inference max.
He's benchmarking.
And I learned so much that, you know,
it's not just the model, it's how you run it, the batching, the different GPUs, sometimes
Nvidia is better, sometimes AMD is better. How are you understanding? Because I imagine it's
not enough to just say it's American deep seek. It's got to be better. So what's your plan to actually
beat them? It's a really good question. And I think it actually falls in two parts. First,
actually just having an American compliant deep seek would go a really long way.
Yeah. Because a lot of enterprises are basically locked out from
using those models because of various legal marketing, provenance, data provenance risks
that are associated with Chinese models.
So from a commercial standpoint, just having something that is as good but kind of compliant
and built here would be really powerful.
But of course, there is, you know, an aspect that you want to leapfrog and really be the
leader in open intelligence across the world.
And we do have some tricks up our sleeve.
obviously
They can't share them.
Probably can't share them.
Yeah, but I mean, hopefully eventually they'll be out.
Yeah.
Yeah.
But, you know, we have some great work happening on reinforcement learning within the team.
The other thing that, you know, the Chinese labs don't have access to is obviously the same level of chips that American companies have access to.
And so what I think Deepseek did really well is co-designing their algorithms together with the chips they had access to.
And so there's some really interesting stuff that you can do with code is.
designing algorithms with frontier chips that are going to be accessible to us as well.
Interesting.
Quickly, talk about the business model.
I can imagine this turning into sort of like a red hat Linux play where there's an open
source model, but you're implementing it, working with enterprise, working with the government,
and there's a contracting piece, a SaaS layer on top.
Is that logical?
Or are you thinking more like you nail open source and then you can do a closed source model,
sell API. You could go and own the whole token factory, the inference stack. Like, where do you see
the business looking in a couple years? I think that the primary thing you need to set first
is how do you build the kind of open intelligence, open models and the sets of tools around
them for, you know, you partner with some inference providers, you know, set up, you know,
make it easy to customize things. You make it easy to build agencies.
some of these models and ensure that that spreads like wildfire.
So I think that having some sets of open models that are really fully permissive is really
important.
But the pull for this kind of model really comes from large enterprise.
That's when does it make sense for you to move from close to hybrid to open models?
It's really once you're a very big consumer of intelligence.
And that's basically large enterprise, sovereign.
and scale up startups that are spending crazy amounts of money on closed APIs.
And so the way you kind of commercialize it, yeah, you want them to be building on top of your models.
And there's all sorts of services and products that you can build out on top of it to effectively solve their problems end to end.
Because just providing an open rate model is not enough.
These things are very hard to customize.
These things are very hard to build evaluations around.
They're very hard to do anything useful with if you don't.
help a customer end-to-end. So I think that there's a lot of opportunity for
commercialization, but you really need to be the core intelligence that others are
building on before you can really be useful at the next layer as well.
Why do you think the dialogue around open source, open AI models went from, you
know, up to a fever pitch, people demanding it and they release it and then now
you don't hear it talked about really at least online in the timeline much at all clearly clearly
and and and I would say like what I'm trying to understand is like clearly there's massive demand
for open source models but I have a feeling that developers would like to be leveraging
the technology of a company like reflection who's wholly dedicated to
open source and dedicated to commit you know and really committed to it whereas it's hard to
you know we had sam on today we've had a bunch of people on from open ai it's hard it'd be hard
for anyone at open i to say like open sources are top three priority right uh maybe it's in the top
five exactly exactly it's it's really hard for you to both be the world's open model and open
intelligence provider and for it to be the number two, number three or number five thing,
right, that your company is focused on. And the reason is that what matters is capability.
You want highly capable open models. And the only way to get that is if your commercial
incentives are fully aligned with open intelligence as the first and primary thing that you're
doing. Now, when you release something like this, you can't just release the model. I mean, I think
that that's one part of it.
And then, you know, inference providers can take that model and optimize their stock around it.
But these models are so big and hard to do anything with, unless you are an expert, that you really need to help with that as well.
The models seem to be exhibiting spiky intelligence.
Where are open source models particularly best or demanded to be best?
like the customers of open models, what did they want to do that might not be as relevant
in a closed source ecosystem?
I could imagine that agentic payments is maybe not the hottest thing in open source models
or IMO level math that might be, maybe that's really important in open source.
But what is unique about the customer of the open source model?
What do they want it to be best at?
Yeah, there are basically two things that as customer, you are looking at.
at, looking to do and achieve when you adopt an open model. The first thing is suppose you have
good performance on something from a closed model, but it's ludicously expensive, which is very
common. Then you want to drive down the cost while keeping the performance. So you want to
customize the model for those tasks. The other way around is that, yeah, you have some finicky
data distribution that was not represented when the closed model was trained and the closed model
is spiking, but not on the data that you need it to be good at.
Sure.
And so then you want to drive performance on that.
And so then you want to post-trained and customize for that.
So it's really you're customizing for driving extra performance or you're
customizing for driving down the cost.
But it's really important to have control over both.
Yeah, that makes a ton of sense.
Well, thank you so much for coming on the show.
Congratulations on the huge raise.
I'm sure we'll see you back here in a couple months.
Yeah, I'm so curious.
I imagine you guys are thinking about how you can create your own deep seek moment.
Yeah, I'm looking forward to it.
The time is right.
Come back on.
We'll pump it.
Play that eagle sound.
Thank you.
Have a great good idea.
Yeah, well, thank you so much for having me.
Of course.
Great to catch up.
Talk to you soon.
Congrats to the team.
How did you sleep last night?
I woke up way too early.
I woke up at four in the morning.
I'm physically unable of a three.
Oh, no.
This is so bad.
I have not gone.
You're still.
Back to back with a 90.
What you got?
I got a 79.
I got a 69.
You beat me.
You beat me almost every day this week, or maybe the last two or three.
But I got,
I got your three-peat.
You got your three-peat.
So play some sound effects, do something.
Let me also tell you about public.com investing for those that take it seriously.
They got multi-asset investing, industry-leading yields, and they're trusted by millions.
Please take it seriously.
Did you see that Marginal Revolution is calling for Vitalik Buteran, the co-founder of Ethereum,
to win the new.
Nobel Prize in economics.
I think that'd be very, very cool.
It's a wild card.
Tyler Cowens mentioned it a few times
that Vitalik would be kind of the
outside the box pick, but in terms of
advancing economic theory,
designing a theory, I mean, it would be
remarkable. And
he also advocates for
Robin Hansen, the father of
prediction markets, to win the Nobel
prize. I don't know. We'll see.
It'll be fun to track the Super Bowl
for economics grads, I guess.
I want your take on this.
Luke Kawa is quoting the Pepsi CEO.
I think fiber will be the next protein.
Consumers are starting to understand
that fiber is a benefit that they need.
We put creatine and everything.
We put protein and everything.
Is fiber the next thing we're going to put?
We put caffeine and everything?
I mean, why not just add them in?
So the thing here is that
Polypup already leaned heavily into fiber.
Okay, so it might already be happening.
Maybe the Pepsi CEO is a little behind the times, actually.
He might also be.
Did Pepsi buy
Ollie Pop's competitor?
I don't know.
I mean,
Kyla Scanlan in the replies
says,
didn't we already do this
with the rise and fall
of fiber one?
So, I don't know.
Maybe it's too late.
So Pepsi Co.
acquired Poppy.
I think Poppy includes fiber.
Yes.
Oh, I have a reaction for...
You want to keep going on that?
You have anything else?
No, okay.
I have a reaction to Rune
who put us in the truth zone.
So on a previous show,
we said that,
we said incorrectly
that during the
AlphaGo game between Lisa Dahl and DeepMind. AlphaGo dropped the 37th move, Move 37, that iconic
moment that kind of scrambled Lisa Dahl's brain. We told the story such that move 37 happened.
Lisa Dahl was so racked by it that he stepped outside to smoke a cigarette. Apparently that's
not true. Apparently he smoked a cigarette before Move 37. And so it's just more cinematic to tell it
that way. I think it's, uh, I think it's actually maybe even more dramatic because potentially
Move 37 was so crazy that he couldn't even bring himself to smoke a cigarette. You think
that's what happened? Maybe. No, I don't know. But thank you, Rune, for doing the fact check.
Obviously, you are correct. You know. True sound. Story more. And we always appreciate the
truth sound. Um, well, we have our next guest, Dylan Patel from semi-analysis with some massive news.
Dylan, how are you doing? That is a cinematic shot. Is this AI or something? Where are we?
called you're oral farming i've literally in america bro that's amazing out of the back of the truck
you're the bald eagle you're the bald eagle he's not a china hawk he's a bald eagle this is proof of work you're
you're out rural america at the back of a truck bed your inference maxing your podcast maxing thank you so
much for taking the time uh give us your breakdown quickly on uh on the launch today inference max
the launch yesterday. I went on your Zoom call at 1030. I was laying in my bed listening to you.
It was very interesting, but I'd love to hear you kind of break it down first.
Wait, first, that wants a, can we get a, are you, do you have cowboy boots on or what?
We need the full fit check. We need the full fit check. Oh, okay. There we go. Looking good,
but cowboy boots. Cowboy boots next time. Okay. Anyway, sorry. Please, give us the, give us the high level.
So I'm going to, this is a fire station behind me, by the way, just so you, you know, but in Tennessee.
Anyways, yesterday we launched inference max, which is a humongous release for us.
It is running, it is a benchmark that's doing cost per million tokens and how many, you know, costs per, tokens per megawatt across all major AI infrastructure, AMD, all the newest GPUs.
and on all the latest models, GPT open source, Lama, deep seek, et cetera, right?
And so the reason why this is so important is, you know, throughout the industry,
people are always like, oh, our chips are great at cost this way, our chips are more efficient that way.
Well, it turns out to actually measure inference you have, you know, a variety of different metrics.
Like you can always just cherry pick something, right?
It's some vendor saying some BS.
And so there ends up being a cherry picking.
And then it's also on some super hyper optimized software stack that's not real, right?
It works for that one specific cherry pick use case.
But guess what?
When I'm running inference at a major company, sometimes I have big requests, sometimes I have
small requests, sometimes I'm outputting a ton.
Sometimes it's like an agentic workflow.
Sometimes it's this model.
Sometimes it's that model.
So what really matters is the real software that people are running.
And it's on, you know, the latest drivers, the latest open source, you know,
PyTorch version, latest VLM, latest SG-Ling.
All these things matter because at the same.
end of day, software changes every day, performance changes every day. Models change all the time,
right? And to actually get, hey, there's trillions of dollars of infrastructure investments
being made over the next few years, how do you actually measure what's the best hardware?
What's the most efficient hardware? What's it cost? And that's what we're aiming to do with
inference max. And so we're supported by Nvidia, AMD, Microsoft, OpenAI, Oracle, CoreWeave, Dell,
Super Micro, HPE, and all sorts of vendors that I can't remember off the top of my head.
Well, you're not making any money on this, right?
It's all open source, but there was a ton of capital that came together,
a ton of people that did put up money with the scale and the scope of the project.
Yeah, so semi-analysis has multiple engineers that I'm paying full-time.
So I'm losing like, you know, a million dollars a year on this or a bit more, obviously,
because engineers are expensive.
But on top of that, it's, you know, the vendors are contributing, and the cloud companies are contributing tens of millions of dollars of GPUs.
And there's no.
Congratulations.
That's fantastic news.
So, you know, the thing is, I'm not necessarily like sure how I'm going to make money on it, but I am aura farming as I am with this background, right?
All that matters is, you know, what's, what, what, you know, how do we deploy AI efficiently across the globe?
And, you know, perhaps by aura farming in this way.
We'll figure out how to, you know, people will buy our other stuff, right?
Is the hope, you know, not exactly sure.
But this needed to exist, and there was no way for it to exist unless we did it.
Yeah.
What's your life been like the last few weeks?
How often are billionaires calling you, asking you specifically for financial advice saying,
hey, I'm thinking of putting, you know, a billion into this one.
What do you think?
Did I do it?
Do you find yourself having to push back and say, like, well, I can't actually.
The second trillion dollars of debt to flow into this.
Yeah. What do you think?
You know, the crazy thing over the last few weeks is that, you know, companies that you
would have never expected to need debt are in the debt markets, right? You mentioned debt.
You know, people like Meta and Oracle, you know, who three years ago, you've been like,
these are the most profitable companies on the planet. Well, they're in the market for debt because
they're building. As far as like how often are people in the DMs or calling me, you know,
that's what the company does. We provide services around this. So, you know, I'd like to say the company
in business is taking off like a rocket and so
you know the whole point is inference max aura
will increase the aura of like other people
like you know uh you know doing
this but I will say it's just like
we've hit terminal velocity right
it feels like we're building a motherfucking like
matriosa brain
um you know like I don't
I don't know what people are trying to invest in besides god
that's great uh what's the biggest
debunk that's come out of the results of inference max
is there some narrative out there on the timeline
or in the AI community that you
feel like you've kind of you're able with this data to turn things around yeah so i mean there's there's
tons of people like oh amd's best oh invidia's the best oh this is better that's better um it turns out
like everyone's statements are sort of like you know there's got to be a lot more nuance to it um and so
my favorite thing is yesterday i saw twitter war between two accounts of like 5 000 followers each so
these weren't like small accounts per se and they were going back and forth posting data
from inference max saying no you're wrong you're cherry picking no you're wrong you're cherry picking
and it's like the reality is it's a little bit more complicated and they're debunking each other
yeah um but i think what's relevant is that you know invidia's not the only game in town
a lot of people uh thought that they were um you know between the opening i amd deal uh that happened
and then the results that we've shown and we've been working with amd and vina on this for
many many months um it's clear opening i i mean invidia is definitely ahead right
But there's certain use cases where AMD is better, right?
If you're running GPT open source, that model's exploding in usage, then, hey, guess what?
Actually, AMD may be a better hardware for, on a dollar basis.
It's not better on a watts basis.
And, you know, those are the two things, right?
So why maybe I'm in test is, you know, there's a lot of watts here that we can put on AI infra.
But it's a challenging sort of, you know, thing is sometimes your capital constraint, sometimes your power constraint.
and what you should do, maybe you do actually think, you know, maybe you should deploy AMD, right?
Maybe you should deploy Nvidia.
The default is Nvidia, but actually in many cases, it makes sense.
And the software works, the open source software works.
It's not buggy completely.
It is if you're training and doing other things, but if you're running inference on specific models, it works.
What's the biggest risk to the overall buildout?
Is it energy capacity?
Like, what's top of mind for you?
over the next 12 to 24 months all these deals have been announced but a lot of people are
asking where is the energy going to come from once you once you start talking about you know
gigawatt scale clusters yeah so it's it's not even it's not even uh you know like you've got
all of these like dudes and suits like you you know in in their little cushy little offices
signing these big checks of thick money on bank accounts but the reality is is
like, hey, I can buy the GPUs, I can get them made and import them from overseas, I can buy, you know, like the sheet metal.
I can buy all these different things, but you know what you can't do is there's not enough motherfuckers in cowboy boots in Middle America, deploying and building these things, right?
Like, it turns out electricians' wages are skyrocketing, right?
It turns out, like, plumbing wages are skyrocketing because data centers need liquid cooling.
And so, like, how, I think that's the biggest risk is, you know, where is the same?
skilled labor are going to come from in in the west. Interesting. Because the West has not built
at this scale before. Yeah. Chat says that, Regov in the chat says, you're the only 10 IC. So he's
having fun that you're out in Tennessee. Is there any, is that, what does the long-term vision
look like? Is it relevant to think about adding TPU, GROC, Cerebrus, other systems? Like,
what is the shape of the of the roadmap? Are you sharing that yet? Or how can, or is that even relevant?
yeah so inference max is amazing because it runs every single day on the latest software but right now
we've only got tens of millions of dollars of GPUs you know we got it we got to hit the
hundred million number to actually get everything right so so what that means is more models are
being supported and we we've got that in the works we've got adding tpues and tranium um this is a real
big difficult engineering effort google and amazon are excited um you know we'll see how long it takes
us but it is a difficult thing but you know they've got to put up the capacity we've got to
get the capacity somehow and add those chips.
And then if you do that, over 99% of the flops around the world, maybe we add
Huawei, maybe we add grok or cerebris.
It's really a lot of engineering is going to be required.
And so that's all on the roadmap is to add more hardware.
Quality.
It turns out there's a lot of innovations that people are doing on model inference beyond just
quantization, right?
You can do 8-bit or you can do 4-bit.
But let's say everyone's doing 8-bit.
you can still do certain innovations that make performance better, but quality worse.
And so there's these tricks that people are implementing that, you know, actually,
it's completely unknown to people.
And so, you know, measuring quality as well is really, really important.
And, you know, continuing to run it every single day in an automated basis and continuing
to get more people pushed behind it so we can get, you know, TPUs, traniums, GPUs on as many models
as possible with quality as well measured.
Well, that's fantastic, Jordy.
One more question from my side.
It seems like the debate is heating up around depreciation schedules for GPUs.
Like, what's your framework on that front?
A lot, you know, NeoCloud wants to say five to six years, but maybe that's not realistic.
How are you thinking about it?
So every company, a major company in the world, the Googles, the Microsoft, Amazon's, et cetera, do six years, right?
That is the industry standard.
But that may also be erroneous.
And the reason why it may be erroneous is because the reason it got pushed up from, you know, four or three years to six years over the last decade was CPU, storage, you know, that sort of stuff was not advancing that fast.
Now, now we've got AI, we've got advancing like a rocket ship.
and it's faster than ever.
And so the question is, there's two points on useful life, right?
One is, does the thing still work in six years?
And the other one is, is it even useful to run it in six years, right?
And they're two very, very different questions.
You know, for will it still run in six years?
The answer is most likely, but these things are running super fast.
GPUs, etc. are way less reliable than CPUs in memory.
So it's a very high likelihood that I not work in six years.
versus CPU servers, they'll actually run like 10 years. It's fine. But maybe not, you know, GPU
may not last the full six years, especially the new ones that are super hot, liquid cooled,
et cetera, right? A lot more complexity, a lot more likelihood it could break down within the six
years. The other side is it economically useful. Well, if Nvidia is releasing a new GPU that
times it's fat for 50% more money every year and a half, well, then in six years you're at like
20x improvement in performance, right? And it maybe only costs like three times more.
So you're like, okay, well, yes, the old GPU still, even if it still works, is it even useful
or should I throw it out and with that power should I feed the new thing, right?
And so that's the big question is, you know, is it useful to keep using the newest GP or the old
GPU or should you buy the new thing, you know, as Jensen says, the more you buy, the more you
save, right?
And so maybe his argument is correct, right?
Yeah, and does that present a real risk?
You know, a lot of people are levering up and and raising, you know,
debt and against GPUs that and and assuming that that five, six year useful life,
how big of a risk is that is what I'm trying to understand?
It depends entirely on the company, right?
So for example, Oracle is raising debt and they're building out Stargate and all these
things, right?
You know, they've got this $300 billion deal with opening AI.
Their biggest risk is not that, hey, you know, our depreciation schedule is six years and
opening eyes contracts are five years, right?
And they still make money if they don't, they aren't able to lost stuff here, right?
Because they've got the contract of opening I.
The real challenge is, where the hell is opening I going to pay $300 billion, right?
You know, I'm a believer. I think you guys are believers, but a lot of people aren't.
For other folks, it's like, hey, I'm out here deploying GPUs.
I'm just putting them out there, right?
Hey, anyone want to rent them?
Please rent them.
And maybe you only sign a six-month contract, maybe sign a three-year contract.
That's where it gets more risky because at the end of the term, I haven't paid off my GPUs.
I haven't paid off my debt.
Where am I going to sell it?
Does the price fall?
Where does the price end up being in that after a year?
And so we saw that with Hopper GPUs, right?
The people who signed the long-term deals initially weren't making his money
because they were selling them at $2, whereas other people were out there like,
oh, yeah, six months, I'll sell it to you for $3.
That was amazing money for that first six months.
And then on renewal, it's like, oh, shit, it's only $250.
And then on renewal, it's like, oh, wait, now I'm selling it for less than $2.
And who knows, as NVIDIA's Blackwell comes out, as Ruben comes out, as the AMD's new chips come out, as Google starts selling TPUs, all these things keep driving down the cost performance and how many tokens you can get per dollar and per watt.
So then all of a sudden, is a hopper still worth $2?
Is it worth $1.50?
Is it worth a dollar?
For the people that are locked into a five-year contract, that's one thing.
For the people who are, you know, just you go and don't have a long-term contract, it's very possible that, you know, the GP works, but it's not able to produce economic value worth.
what you actually put into it. So that's the big risk. That makes sense. Oracle sold off earlier
this week based on reporting from the information. What was your immediate reaction to that piece?
There was a lot of pushback on it. Yeah. So they said that Oracle's margins were low.
Oracle's margins are not that low. They're higher than that. At that exact point in time,
their reporting is accurate, right? But what they deduced based on the reporting with the numbers they
while we're not accurate, right, which is that Oracle's margins are low for the deals they've
signed.
That's not accurate.
What's accurate is that NVIDIA's GV-200 NVL-72 has a lot of issues, right?
They're mostly being solved and have been solved, but there are a lot of issues.
It can be unreliable because of how complicated of a thing it is, so much power, liquid
cooling, it's got the back plane.
So there's a lot of difficulties with the hardware because of how complicated and how fast
it is that are being solved slash solved already.
The other one is, hey, Oracle has to rent these massive data centers before they fill them up with GPS.
So Oracle's paying all this money for these data centers for Stargate, right, like in Abilene, Texas, that aren't necessarily generating revenue yet.
And when your revenue goes from like this to rocket ship up because you've got Stargate, you know, what happens is you've got all this cost right before the revenue comes in, right?
You've bought the GPUs.
You're trying to figure out how to make them to work, you know, because they're a little bit unreliable.
You're replacing things.
You're building out the data center.
You're renting the data center.
All these costs are hitting their books, right?
That doesn't necessarily mean that they can rent them.
I might be getting kicked out.
You're all good.
This has been a pleasure.
Dylan, next time you're in Los Angeles, we'd love to have you at the TBPN Ultradome in studio.
Everyone's a huge fan here.
Congratulations.
And thank you so much for stopping by.
Yeah, massive launch.
Excited to see how it plays out.
All right.
See you.
Thank you so much for having me.
day.
We got to get Dylan.
Nick, reach out to Dylan, get his shoe size.
We'll get him some cowboy boots.
That sounds great.
I love that.
Good use out there.
You got something on your mind?
There's some big news going on.
Oh, yeah, what is it is it?
So one is about 30 minutes ago Trump put out a truth.
He said 100% tariffs on China starting November 1st.
What?
So since then, I think broadly today,
$250 billion has been wiped out from crypto.
Okay.
Yeah, Bitcoin is down 5%.
Oh, no.
Yeah.
We have to check in on our retail trader.
Oh, no.
Our retail trader in residence.
Another white pill, though.
Yes, give us the white pill.
Demis just said they did, last month, they did 1.3 quadrillion tokens on Jebini.
That'll fix the global economy.
That'll fix the great work.
Absolutely wild. Our retail trader and residence is probably put a hole through the wall by now.
Thankfully, the markets are closed for the week, but my portfolio on public is looking rough.
It's a rough day, but we're happy to see that.
Hey, it's a rough day, but Monday will probably be rougher.
Maybe. We'll see. It might be a white suit day. Everything could get resolved over the weekend.
We have to figure out what our bear market suits are.
Maybe suits that are like actually look like bear kind of like fur.
Ooh, fur suits.
That would be good.
Yeah.
You know, in Hollywood, they have, there's a certain synthetic tiers.
It's like propylene glycol or something.
That's what's in vapes.
But there's some sort of eye dropper that you can put in your eye.
They put in eyes of actors when they have to cry.
And so maybe we should just be applying those the entire show.
that we're just crying constantly.
Well, in some much better news, of course,
if you want to get away from all the chaos,
you can book a wander.
You can find your happy place.
That's right.
Book a wonder with inspiring views.
Hotel Great a Mennies,
dreamy beds, top tier cleaning,
24-7 concierge service.
It's a vacation home, but better.
Joey in the chat says,
fart coin is down 73%.
What?
I don't know why.
No, no, no.
That's got to be a joke.
That's impossible.
I looked it up.
I mean, I'm looking at a chart right now.
It says 60%.
So maybe it's rallied a bit.
Today?
Yeah.
I mean, I guess.
I can't believe that something that's like a household name and tech is actually down that much.
That's absolutely crazy.
Well, in some more serious news, we have a new partner at TVPN.
We're partnered with Gemini, Google AI Studio, the fastest way from prompt to production with Gemini.
We're very excited about this one.
It's built for everyone.
You've been a power user.
We're friends with Logan.
Logan is a dear friend of the show and works around the clock to make this product work.
He's done a fantastic job over there.
Supercharge your creativity and productivity.
Chat to start writing, planning, learning, and more with Google AI.
So you'll be hearing more about Gemini in the coming weeks, in the coming show.
Not tomorrow, because tomorrow's a Saturday.
We're going to be off.
But I can't wait for Monday, John.
Yeah.
What else?
Oh, Shiel had a take on SORA, which is interesting.
He says he personally got bored of Sora after a day,
but a surprising number of my friends are still posting 10 plus videos a day.
Maybe this AI-slop thing has likes.
I haven't been consuming a lot of SORA.
I've been generating a lot, but I haven't been posting a lot,
but I started posting.
And once I got over that threshold of like, yeah, I'm just going to put my camey up,
yep, I'm just going to post.
It's going to be fun.
I think I'll be experimenting with the actual feed.
I only have 20 followers now,
but I think that there is some fun,
creative stuff that you can do there.
It's definitely a different tool
to pull off the shelf
than the video camera
or the text post on X or the email,
but I've been having fun,
and I think I will.
Apparently, I didn't catch this
when you said it, Tyler,
the 100% tariff on China
is on top of all current tariffs.
Wasn't it already at 100% or something like that?
We had Ryan Peterson on a few times,
and the tariffs were like up and down
and up and down.
Get to the old.
Ultradome, Ryan.
Seriously, we got to check in with Ryan, for sure.
Monday, I'm back on.
Bucco Capital says, I legitimately cannot believe we are doing this again.
Tremendous nukes have hit the cryptocurrency charts, says Joey in the chat.
Did you read that?
It's very funny.
Thank you, Joey, for your service as the resident crypto bro.
One last note, you know what, hasn't changed with a tariff.
Out of home advertising in America, baby, out adquick.com.
Out of home advertising made easy and measurable.
Say goodbye to the headaches of out of home.
advertising.
Do not think about tariffing our billboards.
Do not tariff our billboards.
That is my line.
Yeah, single issue voter on billboards, honestly.
Liquidity says there won't be a second date, but at least she now understands why the
AI circle jerk deals are quickly becoming a major systemic risk.
Wait, wait, can we pull up this picture of this eight-year-old building in Kazakhstan from
offsite?
This is a, this post made me laugh out loud.
It's page 70.
Do you see this, Jordy?
Look at this picture of this eight-year-old building and off-site and off-site that
quote posted and says, that MF on Roblox left hand on AWSD.
Because if you look at his hand, it's like caught, caught gaming handed for sure.
Very funny post.
But that would have been me at eight gaming.
And, you know, who knows?
If he's on Roblox now, maybe he'll build a Roblox game.
Maybe he'll build a startup.
But yes, eight years old.
It might be a little bit young to take a company public unless you're a 23-year-old.
And then apparently you can spack a nuclear company.
Be fun.
Anything else you want to cover any other breaking news before we log off for the weekend?
I'm going to miss being here at this table with these mics, this team, with this chat.
We missed Dave Portnoy's mansion.
Dave Portnoy made the mansion section in the Wall Street Journal.
I'll read you one line of it because it is iconic.
Dave Portnoy adds record-breaking home to his $95 million property portfolio inside the Barstool Sports Founders' collection of luxury houses.
They break down all of his different houses.
They're all beautiful.
But this is what made me laugh out loud because it's printed in the Wall Street Journal in the mansion section.
Barstool Sports founder, Dave Portnoy, has been dogged by champagne problems at his Miami mansion,
from construction delays to losing his coffee because the waterfront home is too big.
Last year, a more serious issue emerged, and we've talked to some founders about this, mold.
And as he often does, Portnoy turned to social media.
Quote, I need the best mold company in the history of Miami to come look at my moldy-ass house.
And he wrecks, he posted on X in August of 2024.
I just thought that was hilarious that one of his ex posts made it into the Wall Street Journal.
So you can post your way onto a private plane.
You can post your way onto the Wall Street Journal.
You can post your way on the show.
So enjoy the weekend and stay locked in on the timeline.
So Trini says, can we change the channel?
I've seen this movie before.
Oh, uh, our retail trader just posted his portfolio.
He's down, uh, 12% on the day.
He says, I'm so cooked.
I'm so cooked.
You're cooked and chopped.
Cooked and chopped.
But we love you.
Get the Dylan cam.
Get the Dylan cam.
No, he doesn't want to be on TV.
Thank you so much for tuning in.
We're going to set up.
We're working on setting up a retail corner.
Yes.
We're thinking about it.
We're going to give Dylan, not Dylan Abruiscata, the other, Dylan.
We're going to give him a public account, some funds, and he'll just trade.
This is just crazy enough to work.
He won't be cooked or chopped.
Thank you, everyone, for tuning in.
We will see you on Monday.
Have a great weekend, folks.
Bye.
Bye.