TBPN - Meta AI Deep Dive, Jeff Huber, Sheel Mohnot, Leif Abraham, Samuel Hammond, Víctor Perez, Jai Malik, Pratap Ranade
Episode Date: April 8, 2025TBPN.com is made possible by:Ramp - https://ramp.comEight Sleep - https://eightsleep.com/tbpnWander - https://wander.com/tbpnPublic - https://public.comAdQuick - https://adquick.comBezel - ht...tps://getbezel.com Numeral - https://www.numeralhq.comPolymarket - https://polymarket.comFollow TBPN: https://TBPN.comhttps://x.com/tbpnhttps://open.spotify.com/show/2L6WMqY3GUPCGBD0dX6p00?si=674252d53acf4231https://podcasts.apple.com/us/podcast/technology-brothers/id1772360235https://youtube.com/@technologybrotherspod?si=lpk53xTE9WBEcIjV(01:09) - Meta AI Deep Dive (35:09) - Jeff Huber (55:21) - Jai Malik (01:06:18) - Samuel Hammond (01:34:58) - Sheel Mohnot (02:06:42) - Víctor Perez (02:20:16) - Leif Abraham (02:36:55) - Pratap Ranade
Transcript
Discussion (0)
You're watching TVPN. It is Tuesday, April 8th, 2025. We are live from the Temple of Technology, the Fortress of Finance, the Capital of Capital.
And today we are particularly in the Temple of Technology because we're doing a deep dive on meta's open source AI strategy talking to you through the history of Lama and how they built out that LLM and what their strategy is with it.
Also, all the teams behind it. There's some interesting internal dynamics.
Benchmarks hate this one simple trick.
Saturate your models, apparently.
That's the trick.
We will be as fair and balanced as we can about it.
No, we're excited about it.
There's a lot to like.
There's a lot to be skeptical of, and there's a lot of uncertainty.
But we are going to bring on a guest, surprise guest, Jeff Huber, who was not in the
announcement post, but we'll be joining at 1130 to break it all down.
But let's start with AI at Meta on X.
They post today is the start of a.
a new era of natively multimodal AI innovation.
Today, we're announcing the first Lama 4 models.
This dropped on the weekend.
Shout out to Zuck for grinding constantly.
You love it.
Lama 4 Scout and Lama 4 Maverick are most advanced models yet.
And the best in the class for multimodality.
Always funny when you say our most advanced model,
it's our most powerful iPhone ever.
Because if it was less powerful, you wouldn't release it.
Everything you do should be superlative in the context of your own business.
Anyway, it clearly did mark a step forward.
And they nailed some other superlative news because they had the industry leading context window of 10 million tokens.
Of course, that means how much information can you stuff into a prompt and still get reliable results out?
Google took it up to one million tokens.
And that was amazing.
You could upload a two-hour podcast.
You could upload an entire TBPN episode, start.
asking a questions and it would be able to find things.
It was pretty good.
At least Gemini, I saw some demos of them picking needles out of the haystack.
Hey, I changed one word in this entire book.
Can you go find it?
And it would do it.
Very, very cool.
A bit of a debate online about what that means for rag retrieval augmented generation,
which is where you load up a bunch of documents into something that the LLM can kind
process through.
And there's a debate now about does large context windows, do they kill rag?
Well, we're having Jeffrey Huber on from Chroma.
He's a rag expert and has built vector databases and he will defend his position.
And I think he'll have some interesting takes.
They also watch Lama 4 Maverick.
That's a 17 billion active parameter model with 128 experts.
So these are mixture of experts models.
So there's a little bit of internal routing to find what neurons in the LLM need to be activated to go after math or writing or poetry or whatever.
And then they also have image class, best in class image grounding with the ability to align user prompts with relevant visual concepts and anchor model responses to regions in the image.
And so a lot of these models are going multimodal so they can deal with images and text.
And that's very important because obviously we as humans can process both images and text.
So if you want to make something that's human level or AGI or even close to it, you've got to be able to do everything the human can do.
And so this is where it gets controversial.
they said we have unparalleled performance to cost ratio with a chat version scoring ELO 1417 on LM Arena.
That's where all the chatbots battle and humans score which ones they like.
Very controversial.
People are saying that the results don't tell the full story.
So we're going to dig into that.
But first, I want to go to a...
Who was it was saying that the vibes were way off?
I mean, Rune was talking trash about Lama when it dropped initially.
of course he's pretty aligned with open AI.
I think everyone knows that at this point.
But Rune was saying, you know, everyone was like, oh, open AI is cooked because
Lama's now open source.
And he tweeted just like, have you talked to that thing?
And it was this idea of like, who cares about like whether or not they have the same
number of parameters or it's open source?
It's like, do you have a good experience actually chatting with it?
And that's where the vibes are off.
But there has been more commentary about the vibes.
And we will get into that.
But first, I want to hear from Zub.
Doug himself, we have a clip from Zuckerberg explaining Meta's open source AI strategy.
So we're going to play that and then we'll use that as the backbone of this analysis
to really kick off how he's thinking about open source AI at Meta because it did kind
of come out of left field with VR, they're very close source, clearly going towards let's build
a platform, let's lock everyone in, but took a very different tact.
And to be fair, some of the open, some of the VR work is.
open source.
But, and they do want to build an ecosystem, but they're being much more aggressive about
open sourcing in AI.
And there's a lot of good reasons for that.
Ben Thompson has broken that down.
And when we've seen, Ben Thompson's made a very convincing argument for their strategy.
Yeah, basically why open sourcing this and just making it widely available for free will
benefit their ad business long term, which is the real, you know, cash engine.
It's a bad day to not be commodit,
Your Comptimpsesing your compliments.
That's right.
You always want to be commoditizing your compliments.
But let's hear it from Zuck himself.
Let's do it.
Do we have a chance to find that place?
My view is that open source is a really important ingredient to having a positive AI future.
And there are all these awesome things that AI is going to bring in terms of productivity gains and creativity enhancements for people.
And hopefully it'll help us with research and things like that.
But I think open source is an important part.
of how we make sure that this benefits everyone and is accessible to everyone.
It isn't something that's just locked into a handful of big companies.
At the same time, I actually think that open source is going to end up being the safer
and more secure way to develop AI.
I know that there's sort of a debate today about is open source safe.
And I actually take the different position on it.
Not only do I think it's safe, I think it's safer than the alternative of closed development.
A realistic aim that we should hope for is that we use open source to basically develop the leading and most robust ecosystem in the world.
And that we have an expectation that our companies work closely with our government and allied governments on national security.
So that way our governments can persistently just be integrating the latest technology and have a, you know, whatever it is, a six-month advantage, eight-month advantage on our adversaries.
And I think that that's, you know, I don't know that in this world, you get a 10-year permanent advantage.
But I think a kind of perpetual lead actually will make us more safe in one where we're leading than the model that others are advocating, which is, okay, you have a small number of closed labs.
They lock down development.
We probably risk being in the lead at all.
Like probably the other governments are getting access to it.
That's my view.
I actually think on both these things, spreading prosperity for more evenly around the world,
making it set there can be more progress and on safety,
I think we're basically just going to find over time that open source leads.
Look, there are going to be issues, right?
It's like, we'll have to mitigate the issues.
We're going to test everything rigorously.
We do.
We work with governments on all the stuff.
We'll continue doing that.
But that's my view of kind of where the ukule broom, I think,
we'll settle out, given what I know today.
I think it's fascinating looking back at that historical clip and seeing how incredibly front
and center AI safety was.
And then you look at the Lama.
four announcement today and no one's saying, oh, well, like, Lama 4 is like not safe or we should
be having a safety debate.
It's all about the benchmarks.
It's like, it's not superhuman enough.
It's not aggressive enough.
And so we've kind of blown past that.
But again, I do think there is a good AI safety argument to be had about open source.
And I think it's played out kind of like he said.
Like it's kind of good that, you know, at the very least, it's like when you open source something
like Lama, it very easily can get in the hands.
of a, let's not go to paper clipping,
let's just go to, you know, fraud on your grandma, right?
Sending spam texts that are LLM generated,
so they're a little bit more convincing.
We haven't really seen an epidemic of that yet,
and there's been just as much economic force
towards preventing that type of spam and scams
that the open source, like the net impact,
I think has still been positive.
You get plenty of
plenty of small companies
who or kids who
yeah I have a GPU rig
that I used to game on
that was my Christmas present
and now I can fine tune Lama
and make some app
or deploy it really cheaply
and that's a net benefit
and the scammers aren't really getting away
like I keep going back to the election
and it's very hard to make the argument
that AI swung the election
yeah right even though
I don't know both parties would probably have used
or Zuck has been accused
Zuck has been accused of doing that, you know, or being...
With the 2016 election, right?
Yeah.
But it's much harder to make...
Which is weird because it's more...
I just think it's funny. I love that he takes the position generally that he's like, you know,
it would just be...
I really think we should avoid having like a few big companies.
Yeah.
Control this, like, very important technology.
Except in social networking.
Meanwhile, meta-controlling, you know, 20% of the U.S. digital ads bet, you know,
not even including, you know, social networking, which I'm sure is significantly higher.
And also just this idea of like if you want to put something on the internet, increasingly, like this idea of like the open internet where everyone has a website and they all have their own style guides and it's all like this chaotic, you know, like what do they call it? Web 1.0, web 2.0 or something. I don't know.
That independent web has really like disappeared because of meta's like power over it. But, but, you know, I don't know. It still makes sense. And I think it makes more sense from a strategy thing. He's kind of making.
some arguments that sound good in theory, but maybe aren't fully motivated.
They're more motivated by just his business needs.
And I think his business needs are real.
Yeah.
I think they're valid.
No, there's there's two things that can happen simultaneously.
One, open sourcing Lama and allowing anybody to build on top of it and do what they want with
it is a net benefit for the world.
Yep.
It also very clearly is highly strategic.
He's doing it because he wants meta to be a much bigger company in 10 years from
today than it is, you know, now.
Yeah, no, 100%.
But if you are trying to look like Mark Zuckerberg, you got to get on Bezell.
Go to getbezzle.com.
Shop over 24,500 luxury watches, fully authenticated in-house by Bezell's team of
expert.
You know he's got a cubitist.
He's got a pejor.
He's got a pejor.
He's got everything.
He's got it all.
And now's your chance to catch up to Zuck by going big on Bezle.
So download the app too.
The Bezle app is fantastic.
Highly recommend it.
You can scroll.
filter, find what you like, create a little wish list, and then pretty soon start knocking those
down as you send wires off to get Holy Trinity watches.
Yeah, and I want to, I'm going to have, we're going to have a quay on again this week to talk
about the watch industry's reaction to the tariffs. Yep. Which has not been, you know,
Switzerland specifically has been targeted. But moving on to the reaction to Lama 4,
the headlines were generally glowing. Two mediums, two new mediums,
size mixture of expert open models that score well.
And a third, two trillion parameter behemoth is promised.
So they didn't launch that yet.
They're still training it.
That should be the largest open model ever released.
And again, openness is spectrum here.
There's open weights where you can fine tune it.
There's fully open source where you can actually see the code and all the changes.
There's open data.
You can have the data open source that they trained it on.
And also, this is open source, but all the big tech companies are
doing this funny thing where they're like, hey, anyone can use this, really anyone,
except for if you have over a billion, over like $500 billion in revenue or something like
that. And it's basically just to exclude the other big tech companies. And they don't care.
They set it like right whatever Snapchat's revenue is or user base is. They're like, if they have
10% less, you can use it. Yeah. Which is like, honestly amazing for a lot of entrepreneurs. So it's
cool, but it's very funny that they're like, you know, I would not actually help my competitors.
Evan might kick the bots off.
and be like, oh, we're a game now.
But it's funny because, like, the history of open source
has been, like, MIT license.
You can even just take this code
and just go and sell it immediately.
And if you can get someone to buy it,
you can make money off of it.
Now they are in, there's a whole variety
of open source licenses.
But anyway, meta just got a huge jump.
This is from L.M. Arena, from 1268 to 1417.
And that puts them allegedly higher than OpenAI,
higher than X-AI, higher than X-EAR.
but it was hotly debated as we'll get into.
And so there were a couple of takeaways here.
Lama 4 released on Saturday.
The blog post, so they didn't launch like the paper and there's nowhere near the level of
detail from the Lama 3 paper in terms of transparency.
And so that's another aspect of open source is sometimes people want to know, hey,
what other algorithmic tricks did you come up with?
What are you coming up with?
it was interesting, one of the most fascinating leaks, I guess, you could call it, from the Lama
open sourcing process, was that they had a bit of code in there that was just called,
do not blow up the power station or do not blow up the data center.
And basically what they realized was that when they're training Lama, they're running,
they're pulling so much energy from the grid that if they finish a training run and then
the power consumption drops, it will do something with the power.
substation and the transformers and the data center literally might explode or something like that.
So basically what they did was they just said, hey, when we stop training and we're not doing
all the matrix multiplication and all the math that you need to do to crunch all these numbers down
to create the weights, just do random math. Just keep doing random math because that will,
at least the energy will be the same. Obviously, it's not efficient, but we need to like wind
down the energy consumption slowly. So very funny. Yeah, it's like sprinting, right?
Yeah, yeah, yeah. If you're sprinting and then you try to just halt completely.
You want to slow down, you know, slower.
And so the smallest scout model is 109 billion parameters.
And this cannot run on consumer grade GPUs.
And there was this funny interaction between, oh, what's his name over at Google?
He's an absolute legend, I forget.
Anyway, one of the top, Jeff Dean, he's like the greatest programmer in history.
And someone was like, oh, this is such a bummer.
I can't run the new llama on my consumer grade GPUs.
And he was like, what are you talking about?
Like, of course you can't.
And somebody was like, oh, like, Google, like, GPU expert, AI expert, like,
discovers what it means to actually have a consumer GPU.
Yeah.
Because, like, whoever this was, clearly was talking about, like, an Nvidia gaming PC.
And I'm sure Jeff Dean's, like, consumer rig is probably like $50,000 because they're just like,
here, Jeff, like, why don't you just take the best thing of everything?
Yeah.
Even when you're training at home, you know, you want to be able to run this.
Cost as much as a house.
Yeah, exactly, exactly.
And so there's also this question.
about the claimed context token window.
They're claiming 10 million,
and it's certainly far above what the real context is,
but it might not actually be 10 million.
We're going to get into this with Jeff,
but there's this question of when you zoom out the context window
and you get so big, just like a human,
if you're walking around a library,
you might have access to every book in the library,
but you can't actually recall all of that.
So LLM seem to be, there's this debate right now
in this take that the really, really high context windows,
maybe you get fuzzier as you get lighter, just like a human.
And so that's where something like rag and search and deep research from open AI,
like it is a big context model,
but really what it's doing is it's like going searching a web page that's maybe 10,000 tokens,
compressing that down, finding the key insight, quoting that in.
And so when you get a deep research report,
it's not really that it's stuffing all of it into one context window.
It's that it's doing this thing iteratively like an agent.
And then there was a genetic search.
And then this is where it gets controversial.
So LM Arena, we talked about how they're scoring very high, but they used a special experimental
version for LM Arena, which caused the good score.
That's not the version that was released.
This discrepancy forced LM Arena to respond by releasing the full data set for e-vals.
And it does very poorly on independent benchmarks like AI Derr.
And so now there's so many different benchmarks out there that you can kind of gain one
or a few or the top ones.
but if someone comes up and says like, oh, well, you're actually doing worse on Arc AGI.
It's like, well, you didn't get a chance to fine tune on that.
So if you underperform, like a truly breakthrough genius LLM should just be better at every
benchmark, even my benchmark of tell me a joke.
And so, you know, it's tricky.
There's this game of like we got a, we got a rank on the important benchmarks, but now
there's such a long tail that you can't really, can't really optimize for all of them.
And then there's an unsubstantiated post on Chinese social media that
we covered on Monday that claims the company leadership pushed for training, for training more
aggressively to meet Zuck's goals. But this was categorically denied by meta leadership. And we should go
into what Ahmad over at meta is saying. He says, we're glad to start seeing Lama 4 in all your
hands. We're already hearing lots of great results. People are getting with these models. That said,
we're also hearing some reports of mixed quality across different services since we drop the models.
As soon as they were ready, we expect it'll take several days for all the public.
implementations to get dialed in. We'll keep working through our bug fixes and onboarding
partners. We've also heard claims that we trained on test sets. That's simply not true,
and we would never do that. Our best understanding is that the variable quality people are
seeing is due to needing to stabilize implementations. We believe the Lama 4 models are a significant
advancement, and we're looking forward to working with the community to unlock their value.
I think what's happening here is that we are hitting the pre-training plateau, as we've heard before,
we talked to Dorcasch about this.
And that's like underwhelming.
And then at the same time,
everyone has such strong opinions
about all the foundation labs.
Like you meet someone.
It's like, oh, you're an anthropic guy.
Oh, you're an XAI guy.
Oh, you're a meta-bull or whatever.
And so there's a lot of emotions that go into these things.
I think the correct frame of mind to evaluate Lama 4 in
is what will people do with this
that they couldn't do with a close source model?
And so when Google open source their dream studio, there were people that were able to fine-tune that and create those magic avatars, which are now kind of the studio Ghibli's, where you could upload a couple of photos, get a custom avatar of you looking like Superman or something.
And so what's cool about Lama 4 is that because it's open weights, it's easy to fine-tune.
And also, it's not from Deep Seek, so it's a little bit less politically controversial.
but there's still a lot that you can do with it.
It doesn't run on consumer GPUs now.
I'm sure that won't be a problem.
I'm sure that people are going to figure out
how to distill this and do a bunch of different things.
And when we go through the history of Lama,
we will talk about some of the ecosystem
that has actually cropped up
and is exactly what Zuckerberg was describing in that.
You want to hear a joke from meta-AI.
Please.
Tell me a joke like Theo Vaughn about Sam Altman.
Sam Altman is the ultimate tech bro.
He's out here trying to make AI
do all the work so we can just sit around and think about how great we are.
I mean, I'm pretty sure his five-year plan is to an robot that makes avocado toast
and brings it to him while he's meditating on a beach somewhere because that's the real dream, right?
Wow.
I can't.
AGI has been achieved internally, externally, everywhere.
Hang it up, folks.
Quit your job.
That's brutal.
And to be clear, I'm not actually, it's not clear that.
I don't think Lama 4 is actually running on meta.a.
I think you're probably using Lama 3.
These rollouts are always really staged.
And in fact, was that the style of Theo Vaughn?
I thought I was listening to Theo Vaughan.
You could have fooled me.
That is remarkable.
Was that a Theo Vaughan quote?
It's remarkable.
Spot on that is.
You listen to the Avivant's comedy.
Making an avocado joke is like very 2012.
2012 coded?
Yeah, like 2018.
It's like, hipsters are quirky.
Yeah, okay.
We're past that.
Anyway, so there are mixed quality reports across different services using Lama 4,
and implementations should stabilize in a few days.
This is kind of common when they roll out these big new models.
They've got to figure out how to run them on all the hardware,
get them into data center, swap things over.
Like, people say, oh, yeah, switching in LLM, it is just one line of code.
But there are more things to it, especially on the performance side.
We've seen this with Studio Ghibli, like the Ghibli,
like the GPU's melting, which I think we all believe is real because how many times, I mean,
this happened to be a bunch where I've said, hey, make this image studio Ghibit. It's just like,
hey, I stopped. And it's like, what? Like, no, like Instagram filters don't just stop halfway.
But we talked, we talked about this with Aiden. Yeah. Or was it Aiden or no, Swix?
Yeah. Swix was saying that the models are already showing signs of needing rest, right?
Yep, yeah, yeah. Anyways, it's crazy. And so,
There's a bunch more going on.
Let's move through this.
So there's a couple themes that are sticking out in the discussion about meta's
Lama4 performance.
The big one is just a general disappointment from the AI community, I think, based around
how much horsepower was going into this.
So the claim was that they trained on 100,000 H-100 GPUs.
Of course, Zuck and Jensen have done the famous.
James Jersey swap.
He's one of the biggest
Nvidia customers.
He can get the best.
He's not under any import restrictions.
There's really nothing stopping him.
And most importantly, potentially is the fact that
meta can really, really go full send on the CAPEX here
because Zuck knows that, hey,
if LAMA doesn't go anywhere,
we never, like, LLMs cap out, it's not important.
Yeah, we're going to use those 100KH100s
to train the Reels algorithm better or the new thing.
That was the whole thesis
behind.
Yeah, or at the very least, do our own Ghibli style.
Yeah, yeah, yeah.
I was thinking about this.
Like, if I wanted to, if I was like the PM, if I was like the PM at Instagram,
I would immediately implement the studio Ghibli filter and just send every Instagram user a Ghibli
of their most popular post or of their profile picture.
Just pre-render it all, just batch them all.
And then send them and just say, hey, do you want to try the new filter?
And everyone would be like, this is amazing.
It would be this amazing viral moment.
They could definitely do that.
but it would be extremely expensive from a inference perspective,
but they can probably afford it,
and it would be cool and delightful,
and I think they should do it.
Anyway, so despite having fewer resources,
DeepSeek claims to have achieved better performance
with models like Deepseek v3,
and there are some benchmarks where Deepseek is still outperforming Lama 4,
which you hate to see if you're duking it out in the open source world.
Jan Lacoon stated that Fair is working on the next generation of AI architectures
beyond auto-regressive LLMs,
And so this is a debate that we've been hearing for a while.
Like we probably scale is important and we need to continue to scale and we want to do big data center buildouts.
But we also need new algorithms on top of those.
The poster suggests that meta's leading edge is diminishing and that smaller open source models have been surpassed by Quinn with Quinn 3 is coming.
And then there's another debate about Meadows' Medo's Lama 4 fell short.
Scout and Maverick have been released but are disappointing.
Meta's AI research lead has allegedly been fired.
The models use a mixture of experts set up with a small expert size of 17 billion parameters,
which is considered small nowadays.
Despite having extensive GPU resources and data,
meta's efforts are not yielding successful models.
And so I think that there's a debate about,
George Hots was talking about this when GPT4 launched.
It was a mixture of experts model,
and a lot of that is defined by the actual structure of the chips and the interconnect
and what we talked about with light wave.
Light matter?
Light matter.
Just this idea that, yes, you can have 100,000.
GPUs, but if they're not networked together really, really well,
maybe their memory constrained.
There's all these different parameters that can constrain you.
And so you wind up having to fractionalize your LLM.
And that can be fine if 17 billion is enough and you can route.
And there aren't any problems that require multiple experts or bigger experts.
But clearly in this scenario, a lot of people are disappointed.
And so someone said, they left me really disappointed.
You hate to be disappointed.
the free magical intelligence that's true to meet her.
Show some respect.
So some respect for Zuck giving you something that cost a billion dollars for free.
Something that three years ago would have been groundbreaking.
No, but the expectations are extreme.
They're spending almost as much as anybody on this.
And ultimately, it's becoming clear that ability to spend is not all that, you know,
it takes finesse to.
And so it's like, okay.
medic and yeah and so people are people are joking i'd like to see zuckerberg try to replace mid-level
engineers with llama four and uh one commenter joke that perhaps zuckerberg replaced engineers with
llama three leading to lama four not turning out well brutal uh another commenter suggests he might
use he might need to use jemmini 2.5 pro instead i love that people are just like absolutely
trash talking with the most like industry jargon here like oh man like this is more like like you're
You're Lama 4 coded, not Gemini 2.5 Pro coded.
It's like, guys, having too much fun.
Anyway.
Yeah, this one was even more brutal.
Somebody's saying that calling it a complete joke and expressing doubt that it can replace even a well-trained high school student.
Oh, yeah, yeah.
I mean, in general, I think my takeaway is like, you know, Lama 4 might be underperforming,
but you can't sleep on AI even for a minute.
There's a new model every day.
You can't sleep on AI innovation, but you can sleep on an eight sleep.
So go to eight sleep.com nights that fuel your best days, turn any bed into the ultimate sleeping experience.
That's right.
That's right.
So this was the debate that was popping up from Sean who came on the show last week.
He says, unpopular opinion right now, but Lama's 4, 10 million token window will finally actually end the long context versus rag debate.
That's retrieval augmented generation, but not the way that other guy is thinking.
And so this was a very, like, I'm going to, we're going to talk to Jeff about this because I was like, hey, you got to come on the show just to explain this.
But I think what he's saying is that huge context window is not a perfect substitute for RAG.
And RAG still might have a place in the future of AI, agent development, AI implementation.
But I'm excited to dig into this because I didn't fully understand this post and I want to know more here.
Anyway, let's move on to another LLM Eval that happened with stagehand.
the results are fascinating.
What LLMs can actually do consist, can actually parse deeply nested structured data
like a DOM document object model, an A11Y tree, which is like parsing a website, basically.
And so this founder benchmarked Lama 4 against other models and found that Lama 4 came in maybe
eighth below GPT40 Mini, below Claude 3.5 Sonnet, and below Deep Sondet, and below Deep
seek v3 and then Gemini 1.5 Pro 2.0 Flash are all higher.
And so at least from his benchmarking, he thinks that, you know, given that this is the
latest and greatest and newest product from meta, it's underperforming stuff that's been
on the market for a couple months.
So not the best information.
Then there's actually an example here that from Vic that I thought was pretty good.
This is the clearest evidence that no one should take these rankings seriously.
in this example, it's super yappy and factually inaccurate,
and yet the user voted for Lama 4,
the rest aren't any better.
So this is what an LLM arena actually,
or LM arena like interface actually looks like.
So there's a prompt,
and then you see both of these.
You don't see the names of the models, I believe,
but you have to pick which one you like more.
And so the question was,
what is the latest season of Fortnite?
And Claude 3.5 Sonnet said,
Fortnite chapter 5, season two, titled Myths and Mortals, is the Current Season.
It begins on March 8th, 2024, and features Greek mythology theme with characters and locations
inspired by Greek gods and legends.
Then Lama 4 Maverick, experimental, says, a super timely question.
Fortnite seasons are very short-lived, and they last about 12 days, and it's like yapping,
yapping, yapping, and then it gets it wrong.
It says, the current season is Fortnite, season OG, also known as Chapter 4, season 6,
which I believe is like before Chapter 5, obviously.
I don't know enough about Fortnite to back-check this, but it seems
like it's wrong. And then there's a bunch of emojis. And so there's a debate from
LM Arena. And they go on to write, we've seen questions from the community about the latest
release of Lama 4 on Arena to ensure full transparency release. We're releasing 2,000 head-to-head
battle results for public review. So anyone can go see these and decide for themselves, hey,
did the folks at L.M. Arena get this wrong? Or are they happy? Early analysis shows style
and model response tone was an important factor demonstrated in style control ranking,
and we are conducting a deeper analysis to understand more.
Emoji control, because some people might just be voting, oh, I like the emojis,
even though that's kind of taking away from the facts.
Yeah.
Or they might just be like, hey, I like a more verbose answer.
Yeah, some people want a super short answer.
Yeah, exactly, exactly.
So there's all these like human biases that are coming in.
And at this point, we are in this, like, the open AI guys say, just talk to the model,
figure out the vibe of the model.
People seem to like Claude Sonnet and just the vibe of that model.
And so there's still more debate over company leadership potentially blending test sets from various
benchmarks during the post-training process.
Meta has denied that allegation, but there is a lot of debate raging.
And Ethan Molek says the Lama 4 model that one LM arena is different than the released version.
I have been comparing the answers from Arena to the release model.
aren't close. And so what he did was he was he looked at the the actual results that were posted
on Elamorina and then same query on the Lama 4 model that was released. And this is evidence that
they went to Elamorino with a separate model. Yeah. Which is controversial. It's not what you
want to be doing. I mean, it doesn't inspire trust. It's aggressive approach, cotton. Yeah.
But you got to be interested to see what Jeff thinks about all this. And so Amad says,
seems like there was a lot of truth in this leak from two months ago.
Lama 4 is beyond disappointing.
It's a model that shouldn't have been released.
And this is from probably blind or something.
MetageniaI organ panic mode.
It started with DeepCV3,
which rendered Lama 4 already behind in benchmarks.
Adding insult to injury was unknown Chinese company
of 5.5 million training budget.
And there was that meme of Iron Man being like,
they built this with screws in a cave.
Like, you have a trillion.
dollar budget.
But if you want to control your budget, you've got to go over to ramp.com.
Time is money.
Save both.
Save both.
Corporate cards, bill payments, accounting, and a whole lot more all in one place.
And so Jeff is going to be joining in just a minute.
We will run through some of the timeline and break down what happened with Lama and the
development here.
The most interesting thing that I found when I was digging through the history of Lama was
the company's notable foray into large language models was an academic tool called
Galactica, which most people hadn't heard about. That actually backfired months earlier. The
demo was pulled after only three days amid criticisms that it confidently generated false information.
And if you remember GPC3, like, you get some wild hallucinations out of that thing.
And so META's leadership was cautious at that point as generative AI fever swept tech.
And once ChatGPT came out and it became like, customers want this, then they started to push
forward. And so there was a team at Meta's Fair Research Lab in Paris. I believe this is the one
Leon Lacoon is involved in.
They were hard at work on large language model they believe could compete.
Lama 1 was the fruit of that effort, a set of models ranging from 7 billion to 65 billion
parameters, trained on a rich diet of text, which of course they have because they have every
piece of text.
Not only do they have everything in the Facebook ecosystem, but they also scrape every
link that's shared to Facebook, which is every link ever.
And so they have the entire internet scraped.
unlike OpenAI's headline grabbing GPT3, Lama wasn't offered as a public chatbot or API.
Instead, in its initial release, meta made the models weights available on a case-by-case
basis to academic researchers.
So you would just email them and say like, hey, I'm at Stanford.
Like, can I have the weights?
And they'd say, sure.
And then of course, that leaked immediately, which is awesome.
So it was a non-commercial license.
So they would send you the weights and then you could mess around with it and test.
But then, of course, someone, it was quote unquote,
open research, not open source, so you couldn't build a company on top of it. It was more like
a research paper with some downloadable code, but this leaked onto the internet, and then developers
everywhere had their hands on a GPT class model in raw form. And so that spawned these fine-tuned
models, Alpaca and Vicuna, which are derivatives of Lama. I think they're related mammals.
And so then people started fine-tuning with instructions and getting it more into a chat mode,
and then Lama became a product that had close to a chat GPT-like experience.
And so I'm excited to talk to Jeff about this.
I'm not sure if he's in the temple.
He's in the waiting room.
Let's bring him in.
Jeff, how are you doing?
I've gone.
It's great.
How have you been following?
Well, first, welcome to the stream.
Can you do a little introduction?
I'm too eager.
But then I want to hear your reaction to the Lama 4 news, how you're processing,
and what it means for your business.
For sure, yeah.
I'm Jeff Heber, the co-founder of Croma.
We're working on retrieval for AI and broadly working with developers kind of across the ecosystem to build production systems with AI.
A lot of it is focused on, you know, business applications, you know, good old fashion business process automation.
And so always super excited to like see new like open source model jobs.
Can we go to this post from Sean?
He says unpopular opinion right now, but Lama's 4, 10 million token window will finally actually end
the long context versus rag debate, but not in the way that other guy is thinking. What does he mean
by that? Yeah, yeah, for sure. I think, you know, Silicon Valley has a tendency to be sort of
extremely intellectually shallow. This is both a strength and a weakness of the valley, to be clear.
And in our view, like, AI is not this like deus ex machina, this like technical machine god,
you know, where all of the information of all times always going to be in the weights of this model.
you know, this is really just a new form of computing.
And so in the same way that we have a memory hierarchy in classic computers, right?
We have the CPU, RAM, disk, and network.
We are also going to have a similar memory hierarchy in language models.
And again, it already exists today.
We have the actual sort of transformer retention heads.
We have the context window.
We have the retrieval system and tool use.
And these things have different tradeoffs, right?
You think about kind of access, speed, capacity, and cost.
there are tradeoffs to all of these things.
You know, I think like, you know, saying something is dead, like plays pretty well on Twitter.
I've actually gotten myself into some trouble where I, some people who were allegedly ship posting
and not actually sort of sincere posting about this.
And I didn't know, right?
Because it's hard to tell, like, what's a shit post and what isn't?
Of course.
But, you know, the bait is strong on Twitter.
And so what Sean is saying is actually that, like, we've all been, there's a certain
class of people who are like long context is all you need.
Again, these people are probably like 21 years old.
That's fine.
We love them.
But they just haven't seen how like real systems depend on tradeoffs between speed, cost, and accuracy.
And like 10 million tokens is not a panacea.
You need to keep information outside of the context window.
You need to give developers and programmers control over what information is inside the context window.
You know, even these like needle and a haystack tests, like are not actually that representative of like real world utility and reliability of long context windows.
You know, they mentioned in the training for Lama 4 didn't even have passages that are longer than, I think, 250,000 tokens.
And so anything to pass 50,000 is just synthetic data is just made up.
And so what Sean is saying is that, like, well, what 10 million tokens is finally,
context window for Lama 4 is finally going to put to rest is that long context windows are all unique.
He's going, you know, the 10 million context window length is going to finally, hopefully, you know,
make people understand that like, no, there are different things here that are good at different things and we can put them together to create a good system.
Should we amanitize the Eschaton?
I don't know how you knew that I was writing about this this morning.
No, we actually should not.
Yeah, we absolutely should not.
It's always been a trail of tears.
Let's not do that.
You explain that to me a while back.
I had fun with that.
So let's talk about Lama 4.
How should startups be thinking about Lama 4 as a tool in the toolkit
against the other options that they have?
Yeah, I mean, I think like, you know, Twitter is equipped to, and research in general, right, is quick to sort of view state of the art as the only thing that matters.
And I think that actually, in many cases being first is overrated.
You know, we've seen, you know, going all the way back to sort of the slack in teams charts where you've seen the famous chart, Slack versus Teams, right?
Distribution is incredibly important as long as, you know, sort of the incumbents can wake up and can catch up.
You know, I would not bet against Zuck and $100 billion a profit per year.
You know, I think that, you know, Zuck also is in some sense playing a different game.
Like, he's not trying to build like the sort of very best open source, like chat experience for consumers.
What Zuck sees, I think rightly so, is that, you know, having an open source model, which is really good, is good for the ecosystem and is good for meta.
and most businesses don't love using closed source models.
They want to use open source models for all kinds of reasons,
you know, privacy, security, continuity, cost.
You can build your startup on DPD4 and it's amazing.
And then, you know, there's a new version out and opening I deprecates, you know,
the old version, right?
And all of a sudden, all of your prompts don't work the same.
And so, you know, open source models are going to continue to play an extremely important part
in the ecosystem.
Now, obviously, like, you know, the deep seek R1 launch a few months back, like totally took everybody from surprise.
You know, I think we're still in the early innings of this stuff where, like, good ideas can come from anywhere.
And oftentimes good ideas do come out of the sort of group think, you know, context of Silicon Valley, right?
So, you know, but yeah, I wouldn't, I wouldn't bet again suck.
Do you think there's an opportunity to build a company like Red Hat in Linux, but for LLM implementation on top?
of something like Lama or is that like a crazy idea that doesn't really match to the modern
foundation model landscape?
I mean, the bull case for Lama for META is that it's actually more equivalent to how
meta open source its data center kind of layout and tech pack, right?
And that's the bull case for for meta is actually in industry sort of forms around that and
become the standard, right? That's sort of why, you know, what argument is sort of why they did it.
In terms of like the Red Hat 4, you know, I think that like Red Hat 4 works well for operating systems.
But I don't think of an LLM as an operating system.
I think an LLM is much more like a CPU, right?
It's an information processing unit.
And so obviously it's a new thing.
It's not exactly like a CPU.
But yeah, I'd have to reason about that some more.
I'm not sure.
Yeah.
If you're running meta AI, what would you do from here?
Hmm.
Not to put you on the spot or anything.
Yeah, to be clear, I'm not running that AI.
I've not received that job offer at all.
I mean, I think that like, you know, you have to keep going.
You can't stop.
I think focusing on like the business use cases is pretty important.
I think focusing actually also what developers actually need and want out of models is also very important.
You know, you see a lot of like model drops that come out, but they don't actually provide the real hooks.
And they do very well in the benchmarks, right?
They do very well on like kind of the public leaderboards.
But they don't actually provide the hooks that developers need to do like good tool use or reliable structure data output or the practical stuff.
the developers actually want out of models.
And so, like, if you want to create a grounds style of developers that, like, love your tools,
like, do the developer experience part, like, meet them where they are and, like, give them
all the hooks that they need.
And don't just stop at, like, hey, look, you know, we hit standard of the art benchmarking,
aren't we special?
Yeah.
Is there a narrative here where maybe they're trying to do everything all at once and instead
should focus on, like, Lama is amazing at code?
Or Lama is, the next version of Lama 5 is, like, all about tool use or,
super great at reasoning or just like the best at deep research or just the best at image generation,
for example. Like it feels like there's kind of a bifurcation of the market and maybe the
opportunity is actually to to laser in on something that's high value, but then let the other
stuff kind of, you know, simmer out there amongst other teams. I mean, focus is probably always
a good, you know, lesson for all of us, right? Do less and do it better. And so, you know,
Presumably it's also true for meta.
I think also obviously unlimited capital can both be a blessing and a curse in that way.
Yeah, again, like focus on developers.
What some developers want.
I think that's the beachhead.
That's how you win the B2B market.
If you win the B2B market with your open source models, like you get all of the sort of down-insume effects that you want.
You know, you don't need to beat, you know, GPD5 on some bet.
Yeah.
Do you think that part of the narrative that we're seeing around Lama 4 is just pre-training, scaling,
hitting a wall, a need for new algorithms, a need for a deeper focus on reasoning and maybe
even whatever comes after that.
I mean, you know, I, you know, so you mentioned a moment ago sort of the, you know,
imitizing the Eschaton, right?
You know, in history, you know, every exponential that we've observed eventually results in a
sigma wave curve.
You remember early COVID, right?
Yep.
The fur of like, oh my gosh, you know, the Twitter guys doing their thing where they're like,
well, if doubled the amount of people get it every day, and everybody on Earth will have had it
seven times.
100 billion people will have it.
Yeah, exactly, exactly.
And so, you know, I think that there are laws of physics here.
I think that there are, you know, diminishing,
they're clearly diminishing margin returns, right?
We're sort of spending 10x on compute.
We're not getting 10x or better models, at least evidently not yet.
And so, you know, the transform is incredible.
It's amazing.
It's a, you know, technology is probably as important as the invention of electricity.
It will probably, you know, bring about a increase in GDP that is on the
of the industrial revolution or greater.
And so I think we should not minimize the technology
and sort of boil it down to,
oh, this is sort of just dumb pattern matching.
Right?
By the same token, you know,
we also should not believe that all technology,
we're gonna be able to rent seek on sort of forever.
Yep.
So yeah, new things are definitely needed.
And I think that like in an inference time compute,
internal change that thought is really promising.
And you know, I look at the stack today
and I think about how sophisticated computers are,
right, and how computer architectures are,
and operating systems and kernels, like a pilers,
and all of this stuff.
And we're just like in the baby phase today of AI.
Like it's just in its infancy and there's a lot to build.
From a recruiting standpoint,
have you run into some of these super aggressive non-competes that we're seeing?
There was a headline today about, you know,
Google basically paying engineers to not work at Chrome.
Not work for a year when, you know,
they could be working at Chroma or any of these other labs.
I mean, yeah, you know, airplane red dots.
PNG, right?
I guess like if I was affected,
By that, I wouldn't know it.
Yeah, yeah, yeah.
Yeah.
Can you take us through some of what Chrome is building today and where customers are getting
the most value?
I've talked to you a little bit about some of the use cases.
And I think they're underrated, potentially, and like how simple and obvious they are when
you explain them.
But I want you to take me through some of the modern context.
Yeah, I mean, you've heard left and right on the internet now for like three years,
all about this acronym RAG.
I don't know why anybody would ever name something RAG.
That's a good idea.
we just call it retrieval.
And of course, the idea you had with retrieval is that if you want to build an AI system
and you want to be good at something, well, you need to teach it.
How to do that?
You got to teach it about your data.
You've got to give it your instruction set, right?
And updating the weights of the model is not a very good idea because you cannot really
deterministically control that, right?
You can fine-tune, but what you're going to get the other end, you know, again, you don't
really control.
And so giving the system access to a repository of instructions or knowledge about your
organization, your business problem.
problems, that is something that you can control. And that's the problem that retrieval solves.
And so, you know, we talk to like enterprises and businesses building like useful applications.
I think like today, 90% of it in enterprises is retrieval of advantage generation or it's, you know,
using retrieval, it's sort of a chat on top of unstructured data. You know, I think if you
zoom out though and view like what is really AI, right? AI gives us the primitives and the ability to
process unstructured data in a common sense fashion. And you think about the scale of data, right?
even today, like inside of enterprises, like, unstructured data is like 10 times the size of unstructured data.
We have 10 times more unstructured data.
And then you consider like the real world, right?
If we were actually like putting robots out in the real world, like how much unstructured data they're going to be ingesting and needing to process and reason about an action on.
And like it's just sort of like, you know, going to be a thousand X, 10,000 X, X, 100,000 X data that we have today.
And so like that's kind of the direction.
I think is like not so much like sort of this, you know, sort of a simple like one human, one,
one AI talking at a chat stream back and forth.
But it's like real embodied intelligence, which, you know, you can call an agent, you can
call a robot.
You know, I don't love any of these terms.
But like really the goal here, ultimately, I think, for anybody who's built something
practical is building something that's reliable.
You know, you think about like we've been seeing self-driving touted as like this technology
for like 10 years.
And of course, if you live in San Francisco, you can use Waymo.
And it is actually incredible.
But it's taken 10 years.
The gap between demo and production has always been so great in AI.
And so if you're building something practical in AI, your big question as a developer is like,
okay, the demo is super sexy and cool, but how do I actually make it work really, really, really well
and reliably?
And the ability for these systems to sort of like self-improve or improve under human guidance,
I would say is like the biggest thing that's underrated today.
And of course, you know, we think that like retrieval plays a key part in kind of how that happens.
Can you concretize that a little bit by walking me through like a potential use case for us?
I mean, we stream three hours a day.
We're probably emitting, you know, I don't know, tens of thousands of tokens every day.
If I used Whisper, I transcribe every minute of our show.
I could search that through, you know, fuzzy search or deterministic if I want to just search.
Like every time I mention artificial intelligence directly, find that.
Or I could try and fine tune Lama Four on it and maybe it just hallucinates like, oh, yeah, John was talking about this randomly.
how would I use chroma to create a more definitive index of every time John or guest has talked about
artificial intelligence or Lama in hundreds of hours of video.
Yeah.
Is that something you could do?
Yeah, yeah.
I mean, we've seen some kind of fun things today where like, you know, people are taking the
corpus of all of their writing or all of their speaking and kind of like, quote,
teaching the model it.
They're loading it into a tool like chroma.
They're hooking the actual language model.
And they're getting end users the ability to like chat with John.
Yeah.
And like, you know, see what John thinks about artificial intelligence, right?
And that's exactly right.
So kind of all those transcripts get processed, they get broken into pieces.
They get indexed and searchable in various ways.
Yep.
And then when the user asks the query, you know, hey, John, what do you think about the latest, you know, Lama release?
Or maybe they don't say Lama, they say with the latest release, the latest AI from Facebook thing right?
Yeah, exactly.
Like the search is good enough that it can like, like, you know, like,
find all the relevant things that you've said.
And then the L can, like, respond as you.
Because it can kind of ground itself in the things that you've said before.
So, like, that's a...
And so it's basically taking, like, different blocks of text, different ideas and then
kind of vectorizing them into some way that's not necessarily human readable, but it can
still...
It's basically, like, better fuzzy search in many ways.
Not to degrade what you're doing, but it's amazing.
It's magical and super powerful.
Fuzzy, yeah.
Fuzzy search is really useful when people, like, are not, you know, experts in their
own data, right? Is that if your Google Drive, you know how to search for stuff pretty well, right?
But like your users don't know how to search for the stuff that you've said before. And so
that's the kind of the power of like embeddings and vector search. Yeah. Yeah.
Tool in the toolbox. It's not a panacea. Again, we're not amortemotizing the escuton here.
We're not too scenic, right? But it's like a very powerful tool and people are getting a lot of
value out of it. Yeah. I'm curious a reaction to AI 2027. Uh, if our point of view,
generally just from all the conversations we've had is that like sort of model progress,
and advancements could sort of slow and that would be fine just because there's so much value
to unlock out of the underlying models. I'm clear. I'm curious to think how you processed
just the forecast generally. Maybe take it from there.
We think the capability overhang we have in the model that we already have today and we
will have absolutely in six months is immense. You think about, for example, the possibility
of democratizing access to state-of-the-art services to
everybody on earth. Like, it is very possible the poorest people on earth today or, you know, in 10
years will have access to better health care, better league representation, you know, better financial
services than like billionaires have today. I think that's like entirely possible. And that's impossible
with the model that we have again today. And so the capability overhang is immense. You know,
every time an extremely long essay from a sort of effective altruist drops, right? You know, they clearly
tends to make waves. I think if you tell people that the world is going to end, they're going to pay
attention. And, you know, I'm just like not that, frankly, that interested in, like, secular eschatologies
about, you know, apocalypse in the end of the world, right? Like, like, there's a natural tendency
for all humans to believe that, like, we are the chosen ones living in their special time in the
last days, right? You know, even Fukuyama, right? You know, wanted to, you know, sort of like end history,
Right. And so natural human tendency, you know, this is, again, the immunitizing the Eschaton, we'll mention it three times now.
It's like, it's really dangerous, right? Like you think about like what's happened throughout the last hundred years in like really, you know, the hundreds of million people that have died, you know, across like different world wars and different, you know, dictatorships. Like it is oftentimes as like messianic complex that leads to a lot of that. And so I don't know. I'm just like, I think it's, I see it as entertainment more than anything else.
Yeah, on a more practical note, like I go to the Wall Street Journal's website.
I just try and search for an article and they say, oh, search is powered by AI.
It's clearly not powered by AI because I cannot fuzzy search at all.
I can't say, oh, I know that it mentioned this person and I think it was about this and it was in the last week.
It's not there.
What does it take to actually roll this stuff out?
Are these even potential customers of Chroma or is there another company to be built here?
What do you think about that?
Yeah.
Washington Journal, if you're watching,
send me an email.
Happy to chat.
Yeah, all that's very doable today.
I think that the reality is that,
you know,
your classic,
you know,
the future is already here.
It's just not evenly distributed yet, right?
Like,
you know,
any technology of consequence,
even if generationally important,
you know,
still takes decades to roll out.
And,
you know,
that's just the same industry here.
That's great.
Well,
thanks so much for stopping by.
We got to move on,
but this was a fantastic conversation.
We'll have to have you on again.
Thanks for coming on,
Jeff.
I appreciate it.
Talk to you.
And we got a big funding announcement.
We're shifting gears.
We're out of AI and into manufacturing.
Going to talk tariffs.
Going to talk industrialization.
Another theme we love on this show.
We have some big news.
And I just want to know was this fundraise announcement intended, always intended to go out today?
Or did they bring it?
Did they bring it up?
Oh, because of the tariffs.
Tariffs and everything.
It's entirely possible.
Just too good.
So Jay says, today I'm excited to launch the advanced manufacturing company of America.
We've raised $76 million.
Let's hear it for a massive round coming out of stealth.
From caffeinated capital, that's Raymond Tonzing, founders fund, Lux Capital,
Andrews and Horowitz, and others, the best time to build this business is right now.
Yeah, no joke.
But the real work began decades ago.
and they launched a beautiful.
And he just decided I'm going to get every big fund.
Yeah.
I'm just get them all.
Yeah, it's great.
You ran a process.
He says,
yes to everyone.
I'll take a bit from everybody.
And it's great.
They put out a four-minute video produced by Jason Carmen, story company.
It's beautifully lit, beautifully shot, and they brought in, you know, we've been hearing
for a long time that the legacy manufacturing companies are run by folks who are aging out.
and maybe they don't have the next generation lined up to take over the business.
Well, they sat down and interviewed one of those folks, and it's a fantastic video.
You should go check it out.
Anyway, is he ready to come on in the studio?
Let's bring him in and hear the news from him directly.
Welcome to the studio.
How you doing?
Congratulations.
Hey, how are you guys?
We're fantastic.
Thanks so much for taking the quick moment to chat with us.
Can you introduce yourself, the company, and what's the news today?
Absolutely.
So my name is Jay Malik.
I'm the CEO of the Advanced Manufacturing Company of America.
We call it affectionately AMCA.
And so, you know, what we do is we design manufacturer and certify the next generation of critical products that go into all airspace and defense systems.
So that's both existing and new systems, you know, the stuff that Boeing makes and the stuff that Anderl is going to make.
Okay.
Can you break down a little bit more of like what the first products that you'll make?
make will look like. We've heard about what Hadrian's doing. We've heard about, you know,
injection molding, plastics. Like there's a lot of different buzzwords. Obviously, everyone
kind of wants to do everything in the long term, but what are you focused on first?
Yeah. So first, let me just start a high level, right? Like when we talk about the airspace
and defense frimes like Lockheed or Boeing, they don't make anything today, right? They've outsourced
a lot of their manufacturing and engineering to thousands of suppliers. Some suppliers are
focused on high volume manufacturing, things like wire harnesses, machine parts,
with Adriens during injection molding.
There's a lot of great suppliers that are focused on that.
But there are also hundreds of suppliers that are focused on critical engineered products.
Those are the products that, you know, basically determined system success or failure
and are often, you know, very, very highly specialized.
So stuff like avionics products, power units, you know, specific engine products.
And so we're focused in those areas, in the most critical areas where you need to both engineer and manufacture at relatively low volumes for the end customer for their system to succeed.
So we're focused on a pretty different, I would say, part of the market compared to most of the sort of software-defined manufacturing startups that you often see today.
In terms of where we're starting, we're starting almost entirely on avionics, you know, the part of the plane or the ground control system.
that involves, you know, controlling it, right?
So the stuff we've seen in a cockpit, for example.
And so we're focused on things like switches, panels, displays, power units,
you know, things that are critical to the pilot if it's a manned system.
And, you know, if it's an unmanned system, critical to communication and executing on the mission.
So those are the areas that we're mostly focused on right now.
Can you talk about the timing of the announcement?
Was it just a happy accident you were always planning to go out,
this week or did you pull it forward due to the everything in the news.
A little minor news this week.
So we were supposed to launch this week anyway, but we actually had a few reporters that
I think got scared of the tariffs, you know, didn't want to cover anything.
And so we basically said, I'm not sure if I'm not sure if I'm on a curse of this podcast,
but after that and said that this is actually the best effing time to like, you know, take
our company public.
So we just did it.
And so yeah, it was planned, but obviously timing is definitely.
definitely in our favor.
Can you talk about, this is obviously a big raise to come out the gates with.
Can you talk about, you know, kind of the use of proceeds and kind of like, I'm curious about
kind of like how you're thinking of the structure of the business generally.
Yep.
So we're going to be, we've already acquired one business that is a critical avionic supplier,
which you saw video or some people may have seen a video about.
we're going to be acquiring probably another two to three of them over the next, you know,
12 to 18 months.
We're also going to be doing our own clean sheet, you know, design and development of adjacent
products in this space with our own manufacturing and engineering talent.
So it's a hybrid approach.
You know, I have a firm believer that especially in this, you know, area of the supply chain,
you can't, you can't just hack your way into it.
You also can't just be a private equity firm and buy and price.
it up. You know, that's not going to achieve what, like, you know, companies like Androll want to
achieve, you know, for their customers. And so we're taking a hybrid approach where we're
buying, you know, companies with products that we think are going to be hard, you know, to just
redesign from scratch and also developing ones that we think we can do a great job of ourselves.
And as part of your advantage over traditional private equity is just the time horizon you're
thinking about of saying, like, we don't need to come in and just like immediately cut costs by
50% and an increase, you know, pricing to, and then hopefully flip the business in three years.
Like, I imagine you're buying to hold. And that's part of why somebody would want to sell to you
in the first place, I imagine. Yeah, it actually goes deeper than that. So I would say the one thing
that I have learned building this business so far, I believe, you know, it's still early, is that
owners don't really necessarily care just about the time rise and your ability, obviously,
to underwrite, you know, the deal. They also care about, one,
not selling to MBAs, not selling, you know, to traditional finance people, you'd be surprised.
It's a big thing for them.
And that second, that you know what you're doing, meaning like, you know, you're not a bunch of, like, search funders.
You're not, you know, a bunch of people, you know, this is except from the MBA argument,
but, like, you're not a bunch of people that haven't spent time in manufacturing, you know, shop floor, etc.
And so our entire team are engineering and manufacturing folks.
So we spent our entire careers, you know, designing things for SpaceX.
manufacturing things.
You know, we're also young, which I think people like to see when they're selling their
business.
They know that just looking, you know, looking at the person across the table, that they're going
to be there for the next 20 or 30 years.
So I'd say all of those things combined make it a pretty strong pitch for wanting to
sell to us.
Did you have this idea in mind or a rough idea of it when you decided to go back, you know,
enter your next chapter?
I remember it felt like a year ago when you decided.
to move on from from active investing it felt like I just remember that like instantly you shared it
and it just was like everywhere yeah and because people at that time it was like every non deep tech
hard tech investor was like starting to pile into the category and then everybody's like wait
wait if he can't do it I'm screwed what are we doing it didn't slow anything down obviously but
I'm curious like you know kind of the origin what am I doing getting in this yeah I'm curious like how
the idea and the opportunity came together.
Yeah.
So, you know, I spent three or four years, obviously, my career at Countdown when I was 24
years old, you know, I started the firm.
I spent a lot of time, you know, with manufacturing startups and also with non-pop
suppliers.
Like, as part of my diligence for whether I should invest in companies, I would, you know,
talk to Mom and Pops.
And so I'd spend, you know, three or four years in the space.
And it didn't really click, I think, until after I shut down Countdown, that one,
the mom and pops, you know, have both the expertise and, you know, in some cases, the qualifications
that you need in order to develop, you know, and manufacture and, you know, bring the product
to market. And then it also didn't occur to me, obviously, when I was venture investing,
that, you know, maybe there is a path where you can combine, you know, the mom and pop,
you know, advantages with the spirit, the culture, the talent of a startup, right? Like, when you're
venture investing, you know, three or four years, you know, every single day, your mind is just
like, you know, startup, startup, new things, new things, new things. You're not even able to
think about what does the future look like using something that already exists, right? And so it wasn't
until I had actually shut down countdown, had like a month and a half to reflect, think about what I
have learned, wrote down some, wrote down some key, you know, themes, and then, you know, start to
iterate from there, you know, talk to people, talk to customers in the industry, talk to people at
companies that are already, you know, building very successful ones, both in startup world
and in mom and pop world. And that's when the vision started to come together. Like, hey,
I'm uniquely in the center of these two movements, right? Like, I helped, I think, start and
invest in a lot of startups in this space. And at the same time, I know a lot of people who are
in the traditional world. And I should use that to the maximum advantage that I can.
I have one last question. Then I'll let you go because I know you're busy today.
Charlie Munger criticized TransDyme for buying aerospace parts manufacturers and then locking primes and aerospace companies into long contracts, raising prices.
It was a little bit of a controversial strategy, but it's performed very well for that company.
What is your takeaway from the Transdime model?
Transdime is actually a phenomenal business.
And it's actually not the cause of any of those issues.
The cause of those issues, certification, lock-in, et cetera, et cetera,
has to do with decisions that were made 30 years ago at the top of Boeing,
which is a paper right here, you know, basically pilloring that decision.
But the decision of the top of Boeing to outsource every single thing that they do
from engineering and manufacturing at the component and at part level up to the product level.
And so Transzyme is just a recipient of the system that was instituted 30 years ago.
So if you really want to change things, we believe that you have to start from the bottom
with the critical products, build your way back up in partnership with the customer to reverse
that type of decision making and culture.
So, yeah, my answer to that is I think TransDime is actually a great business.
They have run businesses very, very well.
They're in an environment that was not created by them.
They have taken advantage of it, but it was not created by them.
And to fix that, it's going to take partnership with a company like ours.
Well, that's a fantastic Ganger.
Thanks so much for hopping on on short notice.
Congratulations on the round.
And we'll have to have you back.
Yeah, I have so many other questions I want to ask.
We can talk for a hour, I'm sure.
Yeah, very excited for you and the team and excited to have you back on the show soon.
Thank you.
Let's do it.
Take you guys.
Talk to you soon.
Bye.
Well, we are moving on to someone from FAA, the Foundation of American Innovation, I believe, is what they call it,
FAI.org, the FAAI.org.
I've been to a couple of their events, very fun.
Gary Tan spoke at one, Tray Stevens spoke at one.
Tray Stevens has been involved.
I went to one in San Francisco and there were actually protesters outside, which is kind of fun.
But they were like in very good spirits and kind of like taking pictures of everyone.
It was a lot of fun.
Anyway, welcome to the stream.
Boom.
How you doing?
Hey, man.
How's it going?
That's good.
What's going on?
Thanks for hopping on.
Your hair game is on point as usual.
Chill week for you?
Chill week for you.
Sleepless nights.
probably on maybe eight hours over three days.
Oh,
not good.
You should get an eight sleep.
Go to eightsleep.com slash TBPN.
I have a helix.
No.
No.
No, it's great to have you on.
What's running through your brain?
There's a bunch of things we can talk about, but where should we start?
Oh, just the contagion effects and potential collapse of the world economy, simple stuff like that.
you know, how bad is it?
US primacy.
Are you a, is there any element of cautiously optimistic about this for you or are you just totally black
filled on it?
Um, I mean, my white pills are Lucy's, so I do, I do have some of those.
Uh, but, you know, you're going to need a higher milligram for this week.
Well, yeah, I mean, walk me through why, why is it so disruptive to you and what you do?
And maybe just for the viewers, give a little background.
and yourself and the organization?
Sure.
So I'm chief economist for the foundation for American innovation.
Rep in the swag here.
FAI.
There we are a tech policy think tank in Washington, D.C.
originally founded to Bridge Silicon Valley and the D.C. culture.
Today we work on the intersection of national security tech and governance.
I focus on AI, but cover sort of all economic issues as well.
And, you know, I think we kind of, or at least associated with the sort of tech right with guys like yourselves.
Like, I'm rooting for y'all.
And hopefully Martin Scroly's Bloomberg terminal killer takes off.
So then we can combine you guys and completely disrupt Bloomberg.
So, you know, I think you see this in the administration too.
The Trump administration is a series of factions or coalitions.
And we are definitely, you know, in the mix.
but you know
Elon Musk today called Peter Navarro Peter Retardo
and I kind of you know
definitely hard to argue with
can you talk about the bridge between Silicon Valley and DC
it feels like that bridge is massive at this point
there was a moment where maybe tech was drifting away from
DC but now it feels like tech has taken
over DC. At the same time, you go back to the Obama administration. I always think about this
statistic that I believe the number one organization that was non-governmental that Obama visited
during his eight years in office was Google. And so there was a moment when Big Tech and
D.C. were tightly intertwined. It just happened to be with a Democratic Party. Now it happens to be
with a Republican Party. But what is the state of the bridge and how did we get here?
Yeah, I think it's almost like a qualitative difference.
So if you think like the last 80 years, the power structure in the U.S.
is being sort of either Wall Street or like West Texas oil, we either get like Rex Tillerson
or Jamie Diamond.
Sure.
And, you know, since the internet took off, you know, there's just new wealth on the
West Coast.
And as that sort of germinated and matured, it originally was just sort of like one interest
group among many, you know, they still still had those two main power elites.
I think with this last election, it was sort of an example of Silicon Valley, at least a part of Silicon Valley asserting itself as its own distinct power center.
Sure.
And that is very, very different.
Of course, all the other power centers still exist to some degrees.
And so it is sort of a constant struggle.
I think there's a lot that this administration is doing great.
You know, the stuff on energy, I think Doge at some point is going to turn to regulation.
And that's what I'm most excited about, you know, once we start cutting whole parts of the CFR.
You know, back in the day I used to do like supersonic policy and early, worked early with
boomer aerospace and it's good that they're getting hearing now and maybe I'll be able
to fly to either coasts and a couple of hours rather than.
I love that.
So there's a lot to like.
It's just, and I think there's also like a steel man case for like these trade actions.
You know, we participate with like the reindustrialize conference.
We have our own techno industrial playbook that will be coming out in a couple weeks.
so we're all on board for the like you know America needs to build again and you know that
especially as AI like deflates all the knowledge sectors like we're going to need more aluminum
smelting in this stuff like that is there any glimmer of hope that there's this Mar-Lago
summit I forget exactly what Chamath is referring to but the accords and you do see reciprocal
tariffs but they they actually have the effect of driving it down to zero
tariffs anywhere in the world, either direction. Are you hopeful for that? And would that be a good
outcome in your economic framework? That would be sort of the best possible world. There's also
risks associated that, right? Because, you know, I wrote a piece recently discussing the sort of
way the market reacted. And, you know, on the one hand, you could say, oh, Trump just likes tariffs.
And that's definitely true. It's a 40-year track record of just liking tariffs. But then you
have other people like Stephen Moran and Scott Benson and uh, uh, you sort of J.D. Vans himself as well,
who at various points talked about the, um, the curse of the US dollar being international
reserve currency. And there's a lot of truth to that. Like the fact that, you know, China wants
to hold our treasury debt and, you know, we, you know, they build cheap cars. We build
treasury bills is you know it does raise our living standards but means that we are not ready to
fight a war yeah um and so that is a core a core problem but then the question is like how do you deal with
that and if you do go all the way to a mara lago accord what you're saying is this isn't just
about tariffs this is about resetting global financial imbalances yep and you we need to do that
but you need to do that sort of gradually because if you do this all at once what that means is the
entire floor will fall out of the stock market and the real estate market and you know with huge
cascading effects through merging calls and you know i think i think mortgage debt is now back to his
2007 levels um so it's less to me about like the mood or the the ideas behind the policy but the
execution yeah but they are there this is a rugpole of you know rugged uh can you talk about
you know the value of the yuan has been uh dropping i guess it's at a record low
Can you talk about trade wars turning into currency wars and, you know, if that's what people should really be focused on?
Yeah. So, you know, China was a currency manipulator throughout a lot of the 2000s and early 2010s, but that really hasn't been the main way that they cheat.
They cheat by basically suppressing household consumption and, you know, having these 60% savings rates.
And so they end up building these ghost cities and, you know, whatever technology,
they enter, whether it's cars or telecom equipment or pick your poison, they just overproduce it
to the maximum, drive down the cost worldwide, and then have to find these export markets to dump
it. And the way that we're ever going to resolve this is, especially now that the U.S.
is going to have 100% plus tariffs on China and Europe doesn't want their shit either, they need to
build up their domestic economy. They need to reduce their own savings rate, raise the standard
living of their households, like introduce like some basic, you know, social welfare programs or
something so that they, you know, actually have a domestic consumer base. And if they do that,
like, that's actually the best way that they can retaliate in a sense because they're sort
shielding themselves from the tariffs. But it also is, it helps correct the big imbalance. And so that
is like, it's sort of aligned in that sense where like if China does the right thing, then it's a win-win
situation. If instead they double down on tariffs and trade war, you know, I don't see, I don't see,
we just exacerbate the, the contradictions in the economy and don't get to a resolution.
Ben Thompson has been advocating for a rethinking of the Chips Act, mainly shifting from export
controls, removing those, and instead taking a more Operation Warp Speed approach where the U.S.
government is potentially a massive buyer of domestic made three nanometer five nanometer chips
with the demand signal there the American market should solve it how are you processing the
the current chips act and what are you hopeful for going forward I'm not opposed to idea
the thing about like you know invidia's chips is their their demand is kind of saturated right
they can kind of pick who their buyers are because there's just so much demand for them
And at the same time, they've not been the most sort of like loyal actor in this space.
And, you know, there's any sort of big meta narrative or theme to a lot of the right,
the tech rights move into D.C.
It's been, you know, since from Project Nave and on that, you know, these companies have
had corporate social responsibility policies, but not corporate patriotic responsibility policies.
And technology is becoming geopolitical and you sort of have to pick your side.
And so, you know, every time we introduce an expert control, NVIDIAs two weeks later has a new chip that just gets under the line of what's being controlled.
And the latest one is the H20.
The H20 is an inference ship.
It's, you know, it will power these reasoning models.
If we're worried at all about search being competitive, I don't think we can give up on those.
And in fact, we should, we should be doubling down.
And that would be like a smarter kind of trade war than just across the board tariffs.
But that doesn't have to be hugely exclusive with doing a kind of indefinitely.
industrial push. And that's what I'd like to see. Because if we're going to do this big rebalancing,
you can't just pull the rug. You have to, you know, to mix my metaphors, you have to be the
Indiana Jones that like swoops in the bag of sand or something as you take the Holy Grail.
And what is that, what is that, like, new thing that we're going to be sweeping in? What is the
industrial bank that we're going to be using to bootstrap the industries that we need? Because
they won't just materialize on their own. Can you talk about, uh, putting the, the trade wars
in the context of like this race for super intelligence, right? In many ways, people are arguing,
like, hey, if we're making like transformers, like harder to get and more expensive, like,
does that hold us back from winning the AI race? And is that the only race that that really
matters? You know, we've joked on the show about this idea of like picking up pennies,
like in front of a steamroller, right? Like AI has potential to transform the economy in so many
ways. And like it's very possible that like that just winning AI matters more than like winning,
you know, there's trade war in the year 2025.
No, I 100% agree with that take.
Like, I can forgive a lot of stupid policy
because in four years we're going to have such powerful AI systems
that like really it swamps everything else.
And the, you know, we know what the bottlenecks are going to be.
Right.
Like the building these models only has a few basic ingredients.
You have like the data and algorithms, which the US,
you know, the algorithms are basically public domain.
The data, China maybe even has an advantage because they don't have privacy laws and they can just scoop up everyone's like genome or whatever.
And then it comes to like energy and chips.
The export controls exist because right now our only structural advantage is the chip and hardware stack where, you know, our install base of Nvidia data centers is, you know, a huge portion of the world.
China has been basically cut off since 2002 and 23.
Then when it comes to energy, you know, China added 446 gigawatts of energy last year.
There was a 20% year over year increase.
They're going to do that again this year.
We added zero net new energy.
We had a lot of renewables, but it came directly out of coal and other sources.
And so, you know, the chips are the chips is the short run bottleneck.
So that's why we need to lean into that.
And then the long run is like, how are we going to supply the energy?
And then as the stuff diffuses, you know, to the people who worry about the industrialization,
It's like, it's true.
The last 40 years, we've specialized in, you know, higher education, knowledge work, legal management services, Hollywood, you know, the creative class, all the stuff that is going to, like, be deflated.
And China will have the factories that will become fully automated and due course because they'll also have the workforce that they can extract all the, like, the tacit knowledge out of and put into their robots.
And so it's like a really urgent thing that we don't just like try to win on AI, but like win on AI plus heavy industry.
industry and robotics because otherwise our innovation in bits will be their innovation in atoms.
Yeah, the one point of view on the trade war and trying to bring manufacturing back to America
is like, yeah, yeah, we can bring the production capacity back, but will the jobs come back
in the same way, right? Just due to, if we actually want to scale production, we need to lean
into automation and robotics. How do you think about job creation as part of reshoring and an
increasing domestic production in the context of long term, a lot of production just becoming
automated and just because that's going to be the most efficient way to produce the most amount of
goods? Yeah, we need to bring back manufacturing, but it's not a jobs program. That's for sure.
In fact, the only way we're going to bring it back is if we automate significant amounts of this.
And maybe the guy who presses the on button every morning gets paid, you know, multiple six figures.
But it's not going to be this nostalgic vision of like 1950s where we're all going into the factory.
And that's just like a structural thing.
We're not that, you know, AI is going to do that for a lot of stuff, probably, you know, most stuff at some point.
And we're going to have to figure out what the new jobs are.
Like I saw on a, you know, I saw a video of like professional backscratcher.
you know in the VC world those exist already but like uh but this was like a woman of long acrylic
nails and so you know maybe we could start crowing her nails at um crazy so like cases that there's
like there's there's so much knowledge work to do around an advanced factory i mean we just talked
to jay from the advanced manufacturing company of america there's clearly a lot of high skill
labor that yeah yeah it's not getting displaced anytime soon that um could that's not millions of
people. Yeah. Well, it might be if we're manufacturing a Dyson sphere with a million robots or something. I don't
know. I could see a world where, yes, there are a million jobs in the manufacturing sector, but it's all at the
higher level. But if two million, you know, traditional like white collar jobs get evaporated,
you know, in the interim, maybe. There's clearly some big, uh, big questions we're going to have
to be thinking about. Do you have strong opinions on Unitri or any of these other Chinese robotics companies
that are trying to.
He's just like, I love them.
Yeah.
I'm curious if you've written about it,
if you've had policy recommendations that you or FAI have made around,
you know,
some of these more hybrid sort of dual use.
Well, everything's dual use in China.
But what do you think about unitry?
No, the unit tree is really impressive.
And, you know, I've seen it do like Kung Fu.
And it does brick dancing better than that Australian lady.
Oh, yeah.
Not that highest bar.
Yeah.
And like, you know, if you, you know, Shenzhen is like, you know, it's like going to a flea market
where every, you trip over like baskets full of microelectronics.
And we need to be building some of those like ecosystems in the U.S.
That's number one.
And number two is like, yes, we have the data centers and the better models, but China, you
know, has the batteries, right?
They have like that that's one area where they, they have leapfrogged us.
and whether it's electric vehicles or robotics or drones, like we need to have our own battery stack.
And maybe, you know, we do need like a chipsack too, but we also probably need like a batteries act
to compete with that because that will be the thing.
It's fine if, you know, Anderil builds a drone factory, but where are these batteries going to be coming from?
Yeah.
Not asking for financial advice, but where are, where specifically in America are you long, you know, areas that could be that sort of American Shenzhen.
or maybe it's multiple places.
I'm curious what areas, you know, you know, different regions in the United States
are, do you think, benefit from reshoring most intensely?
In recent history, it's been sort of the South and South Atlantic, you know,
the North Carolinas, the Tennessee's, Nashville, you know, partly because those all
of the best housing markets, right? It's so much easier to build when you have greenfield.
That longer term, this is also not something that the US can do alone. Like, we're going to need
almost like a North American plus like production, you know, frontier where, you know,
let's figure out the thing with Canada. Like, do we need their lumber? Don't we, you know,
do we want their bags of milk or not? But like we do need their aluminum, right?
And we will need to have some kind of integrated production ecosystem to be kind of competitive and stand up to China.
Because China, you know, already in purchasing power parity is larger than the U.S.
And, you know, they want to gobble up their neighbors to and get even bigger.
So, but I do think there is an opportunity here because when you do have like, I'm not a technological unemployment guy.
You know, I think new jobs get created.
They'll just be very weird, not necessarily in the sectors that matter.
the most. The purpose of heavy industry and robotics is like more military and like do we
control the supply of core goods and services. On energy, what do you think the lowest hanging
fruit is in terms of energy deregulation? Should we be focusing on the NRC, nuclear? What's the
biggest opportunity to help us jump from I guess zero percent to 20 percent where I want to be?
maybe 40% would be nice, maybe 200%.
Yeah, you guys should definitely have my colleague Thomas Hockman on to talk about this for a full half hour
because he's been putting up the winds lately.
We've helped pass a bill in Utah.
There's activity in like Arizona, Montana, other places.
There's a huge appetite to unlock America's energy.
In the short run, especially for these data centers, it's going to be natural gas.
It's going to be a bridge to more permanent.
based load energy.
And then the next bottleneck is like the grid itself.
Because if you want to do a,
even if it's just like natural gas generators are rolling in,
that investment makes way more sense.
If you know that after that, you know, GPT7 is trained,
that you get to put your energy back into a grid and have,
have customers for it.
So that needs to be fixed.
Other energy sources, you know,
I think enhanced and advanced geothermal are,
they were underrated.
I think people are starting to finally wake up to the potential, you know, with like really advanced geothermal.
We could make like everywhere in America kind of like Iceland where like, you know, you have energy under your feet.
And then with nuclear, you know, there is this case before the courts that, I think it's Texas, Utah versus U.S.
pro government that the intersea that argues that the inner sea doesn't have jurisdiction over small modular reactors.
And I think there's a good chance that this.
that Pam Bondi and the Attorney General settle that case.
In which case, states could then stand up their own licensing boards.
And I think there's actually already movement in Utah
to have their own nuclear regulator.
And so that could happen sooner than people realize.
Do a bunch of young founders building small nuclear reactors,
is that scare you?
Does that keep you up at night?
Or do you think the technology is, you know, it's solved?
Doug Burnout, Reddradian, isn't that young?
He's got kids.
I trust him with my life.
Yeah, basically, I think it's a requirement you should have to have kids to be a nuclear founder.
He worked at SpaceX.
He's got a pedigree.
I love that company based in Elsigundo.
The big problem of nuclear is it, it's, it doesn't really pencil out without like large government support.
Yeah.
And, um, and so I would love to see like the 600 billion in tariff revenue, you know, be given to Doug Bergum to like build a reactor template and build 200 of them all around the country and like make this a, uh,
you know, use every national security in national emergency trick in the book to get it done
as quickly as possible. But it does need, it will need like some kind of, you know,
fixed capital backstop to make those investments, at least with the current technology.
I mean, given what you're, like, you're kind of optimistic about Doge, you're,
it seems like you're pretty bearish about the tariffs. Like, are we in a regime where you
trust the government to do mega projects yet? Because I think everyone was excited about the moon landing
And then since then, a little bit less excitement about the big projects.
High-speed rail in California has been a little bit of rough go.
And I don't really want to see California high-speed rail of 600 billion get burned on a nuclear strategy that doesn't produce a single watt of electricity for, you know, 70 years or something, which would be like the bad case.
Yeah, 100%.
You know, the state capacity and competence is really, you know, it's the jagged frontier.
Yeah.
There's places that have a lot of it, places that have little of it.
You know, I would have more trust in a Bergum or like a Chris Wright of actually, you know,
executing on something like that.
It wouldn't be the Pete Buttigieg-slush fund where it's just filling potholes in Indiana.
They would know how to cut through the road tape.
They wouldn't make it like this, you know, everything bagel, you know, we're going to build
TSM chips, but then also like,
you know, rehabilitate justice involved individuals.
You know, we need to eat our potatoes and our gravy separate.
Got it.
How are you thinking about the Deep Seek versus Mehta's Lama strategy?
We were talking about that earlier on the show.
And it's kind of hard to, I think a lot of people on the vibes of Deep Seek.
They're like, I don't like this.
But then it's difficult to formulate an argument because are you anti-open source,
in which case are you anti-Zuck and meta?
How are you thinking about kind of the intellectual property that's being developed in America around large language models and then makes its way across the Pacific Ocean?
I think what I find most impressive about DeepSeek is less that the model they put up, but just that they sort of have imported a kind of Silicon Valley model of like.
And that came from their CEO being like a hedge fund manager of doing this as a side project.
It's very, you know, Sam Altman wasn't a hedge fund manager.
He was a VC, but sort of analogous.
right yeah um and that that that's striking because uh it's just a different model of corporate governance
than you're used to seeing and i think there's a question of like how long the does deep seek
become a victim of his own success and like you know they are the tall poppy and it's not that
china tries to hurt them because of that but actually tries to help them and makes them a national
champion and thereby sort of perverse it and uh
But, you know,
it's a fun take.
They've been great to, you know, publishing what they're doing and everything sort of has checked out.
But they don't have the chips.
And they've said that.
Like their CEO said their biggest bottleneck is hardware.
And so we shouldn't help them on that front.
Like there's $16 billion of orders for age 20s just sort of sitting in limbo about to go at the door.
The Commerce Department has, Howard Lutnik has said that he's going to export control.
old age 20, but they're so distracted by tariffs, they haven't prioritized it, and the time
is kind of running out. What's going on with TikTok? We've been following the polymarket around
a new ban before May. There's markets around, you know, potential buyers, things like that. Do you
have any insight that you can share around the latest there? It feels like, again, one of those things
It's just like not getting the attention and the focus because obviously, you know,
if we are entered into the greatest global trade war of all time, like, yeah, it's rightfully
people should maybe be sort of focused on that.
But at the same time, it feels like something that we were supposed to have answers around by now
and we definitely don't.
Yeah, totally.
I mean, FAA, we led the charge to ban TikTok over a couple years.
And I fully support it.
I also enjoy TikTok, but I do notice that like between my my my barbecuing steak videos and like funny memes, I'll get like a Pyongyang tourism board video now and then.
It's like, well, that I don't plan on visiting North Korea anytime soon.
But yeah, I don't have any super deep intel.
You know, there has been talks about or rumors about, you know, Oracle maybe being part of this.
and I think Trump still wants it to be part of the new sovereign wealth fund.
And actually, as sort of zanian idea that is, like, he kind of has a point.
Like, if TikTok became American and, you know, quadrupled in value, that would actually help pay down the debt.
The interesting thing here is, like, you know, people have pointed out that, you know, Trump has sort of placed fast and loose with the Constitution with the law and stuff like that, you know.
And a matter of fact, all the people he's fired, totally constitutional.
The biggest, the most unconstitutional thing he's done today is not enforce the TikTok ban.
Oh, yeah.
Because that was a direct, you know, statute that Congress passed that said,
thou shall ban TikTok.
So I'm hopeful that they can get a deal.
The reason I would just doubt it is China has very strong expert controls.
Like the reason TikTok can't sell is because algorithms in general are expert controlled.
and so they would be able to buy the brand name and like the offices,
but they'd have to completely revamp the algorithm,
which is like the secret sauce of the thing.
Now, TikTok is in our building in D.C.
So I can try to plan a bug for you if you want.
Sounds great.
That'd be fantastic.
Polymarket has the chance of TikTok being on the app store on May 1st at 97%.
And who will acquire TikTok?
Oracle's at 27%.
Number two, Larry Ellison directly at 24%.
You'll love to see it. Amazon's still up there. But I just want to say thanks so much for joining.
This is a really interesting conversation. We'll have to have you back soon.
Yeah, and get some sleep. We'll work on getting you an eight sleep.
Yeah, yeah, yeah. Start putting in some proper.
I want to see 100 for a week straight. I think. Yeah, less red light from the stock market.
Yeah, more sleep.
No way, go get some sleep. Thank you for coming on. And yeah, look forward to the next one.
Yeah, talk soon. Bye.
Later back.
Cheers.
Next up, we have Shield coming back on for a second TVPN appearance.
We're going to talk about FinTech, the markets, the tariffs, his dust up with another capital
allocator on X the other day.
Had a lot of fun with that.
And I'm sure we'll have plenty to talk about.
So as soon as Shield gets here, we'll bring him into the studio.
But those are some interesting questions.
There really are so many debates right now about China.
It's like DJI, Unitri, TikTok.
deep see there's like seven different really important questions maybe we'll talk about it
with shield maybe we won't but let's bring him in to the studio and welcome him to the show welcome
boom back with a suit looking great how you doing good looking good no no Apple Watch
there we go there we go we'll get you on Bezell now that's the next step we've we've
we've de-radicalized you from the Apple Watch next is radicalizing you to Bezle yeah the
tariffs haven't hit the secondary market yet no
Great buying opportunity.
This is financial advice.
Go to getbezzle.com, download the app.
Just for shield.
Just for you, not for the listener.
For you specifically.
You specifically.
I want to see an Adamar Pigay or Royal Oak on you, something like that.
Well, you've had a bit, I feel like you've been, the timeline's been in turmoil
and you've been at the center of it.
I guess, I guess Chimoth knows who you are now, now that people remind.
him that he would use your content in his newsletter.
Yeah.
But that's so funny.
The whole thing.
The whole thing was the whole thing was funny.
I'm sorry.
I mean, honestly, probably good metrics.
I'm sure we're up into the right.
So the creator,
the creator payout this month.
It's going to go from 200 bucks to 100.
Except he'll be paid for screenshots of his content with just this is why I can't
believe this Twitter.
This app is free.
And this is why I'm never deleting this.
I'm never leading this app because of the interaction.
Yeah, exactly.
Anyway, can you give us just your high level reaction
and how you've been processing the tariff news,
kind of set the table for us and then we'll dig in?
Yeah, wow, right into it.
Okay, I'm kind of like I've always been more of a free market kind of guy.
An American.
And I think free market American.
Yeah, American.
I've been an American guy.
And I tend to think competition makes us better.
And I also like spent time like living in protectionist India.
And so for those who don't know, like until the 90s, India was a closed economy.
Like they had super high tariffs on all foreign goods.
And it sucked.
There were two local car manufacturers.
And the cars were like built in the 50s and they like didn't get any better from the 50s until the 90s.
Because India had so much protections on their local car industry.
And that was terrible.
So they didn't innovate.
They never improved the quality.
They were super high so people couldn't afford.
The price were super high so people couldn't afford them.
And so that's what really scares me.
And then you might say that would never happen in America.
But you'd be totally wrong because that's exactly what has happened in the U.S. shipbuilding industry.
So like the Jones Act basically says that if you're shipping goods between two U.S.
you need to use a U.S. built ship crewed by U.S. citizens and owned by U.S. citizens.
So, like, it's a super protectionist of the U.S. shipbuilding industry, and U.S. ships suck.
They're, like, five times as expensive as other ships, and they've never had to innovate because
they have these protections.
And then it totally distorts the markets in general.
Like, on the East Coast, I mean, New York right now, on the East Coast, a lot of, like,
the East Coast gets some fuel from internationally.
because it's easier to ship here than it is to get it from Texas.
And that's just like a perversion of markets that exists because of the Jones Act.
So anyway, so I think like all these things, like I'm totally anti-protectionist.
There's a question of like what is Trump doing is like with it's not really a reciprocal tariff.
Now everybody realizes it was a funny situation last Wednesday when people were like,
what the fuck are these numbers?
And then, you know, the guy who did the math was like, oh, this is about our trade deficit, not reciprocal tariffs.
I think like if you if like now people are coming around and saying, oh, this is all about lowering trade barriers.
I think that's bullshit because like you have Lutnik saying like we need millions of Americans screwing in tiny iPhones or whatever.
And you and they also say that the tariffs are going to replace income taxes.
So if those things are true, then it's not about leveling the playing field to zero.
It's about like putting these tariffs in place to reshore.
And I personally don't like that.
Isn't it fascinating too?
There's this focus on trade deficits, but we're completely ignoring like services and specifically like digital services.
Right.
So it's like like Switzerland, for example, you know, we have a trade deficit because they have eight.
million people and we have hundreds of millions.
And then they like make all the world's fine watches, which we just talked about.
But then like they also probably love Netflix.
Yeah, I guess.
I guess that like a lot of people in Switzerland are subscribed to Netflix and we're just like
completely ignoring all of that.
Yeah.
And and you know.
Yeah.
I have a follow.
We're the richest most prosperous country in the history of the world.
Yeah.
It's fucking awesome.
Yeah.
We can afford to buy all their shit.
Like they don't need to buy stuff from us.
They can't afford it.
So, so.
Yeah, so the steel man here is like, first off, do you think DJI and the consumer drone market is a problem?
And then if so, what is your solution, if not just ban DJI, tariff DJI?
Like, we did a deep dive on GoPro versus DJI.
And it really just felt like China was like, we are going to kill GoPro in the drone market.
And they put so much firepower behind it.
And I'm like, I still get that there's some weirdness going on here.
here and it's important industry and there's dual use and there's a million different factors.
So how do you walk through that specific example?
Narrowly. Let's let's let's let's let's let's let's take away the blanket
tariffs walk through that for me and how would you solve this in a more free market,
more progressive fashion.
Yeah. That's a great question. So the first like we have tariffs in every country,
not just our enemies. Yeah. Um, with Trump. But China specifically, I,
I do think China's playing unfairly. Yeah. And, and there are enemy. And, and, and there are enemy.
and we we shouldn't let our enemy get data in the United States.
Like that could be really bad.
Yeah.
There definitely are national security issues with drones.
Yep.
I also think we should ban TikTok.
Sure.
And so I think those things can be dealt with, but they have nothing to do with tariffs.
Yeah.
I guess one of my scenarios would have been if I could if I could replay everything with everything I know now, maybe you see what's happening with DJI and GoPro.
And you say, hey, we are the richest country in the world.
We do have, China buys a bunch of our debt.
Let's lever up, essentially, and create a drone buying program from the government to stimulate
demand for American-made drones.
Totally.
Essentially backstop GoPro.
Let them get down the learning curve.
Hey, if they make these drones in America, we're going to buy them even more.
And, and let us develop that.
And then we are competitive.
And we say, hey, it is a little bit, we're still shifting.
the invisible hand, putting our hand on top of the invisible hand, but it's still somewhat of a
free market in the sense that like, just like what we did with EVs with Elon, like anyone could
have gone for those electric vehicle incentives. Elon did a great job taking advantage of it.
Totally. Like, and we got a great product. It sold really well eventually. Yeah, I think that's absolutely
right. I think. And like, look, we moved in this direction already. Yeah. Like the Chips Act and IRA both.
Yep. Did make good moves. Like, yeah. They, they, they, and they,
They subsidize U.S. chip manufacturing that are critical for military systems and other stuff.
I think they have made some moves away from foreign chips.
And so that all stuff is good.
I think, like, leading with a carrot is way better than leading with a stick, personally.
And I think, like, the idea is you mentioned, John, are spot on.
And by the way, like, we helped Tesla along the way.
Like, we loaned the U.S. taxpayers loaned $500 million to Tesla.
Yeah.
Like that kind of thing I'm totally in support of.
Totally.
Enable U.S. manufacturing to be better to compete on an even playing field by being more innovative,
not by blocking like other countries from competing.
Yeah.
Yeah.
Jordy.
Bummer to see the IPO window closed.
We had Clarna, stub hubs.
We'll see if Circle gets out.
Clarna would have been especially nice for FinTech broadly to get some marks.
Circle's still at 86% on Polly Market for this year.
Yeah, they might just be like, you know, crypto, we were born in the darkness.
We're going out.
We're going out.
Did you have a take on the Circle IPO in general?
I saw a lot of people just were not kind of loving the S-1, particularly just based on how much they were paying Coinbase to distribute the token.
I'm curious if you had a how to take on the IPO or dug into it at all.
And you don't need to have any knowledge to have it.
You don't need to have any knowledge to have a take, by the way.
Yeah, I would say on Circle in particular, like I saw all the same stuff you saw.
Coinbase gets half of the revenue from Circle's token and all this other stuff.
But I don't have a strong take on how the IPO will perform.
I tend to think that these things are somewhat, like initially somewhat disconnected from the reality of what's going on.
Like, I think, you know, we talked about Bridge last time I was on, and I think there became this stable coin hype.
And I bet if Circle was public at that point, they would have gotten a huge bump for no particular reason.
Totally.
Yeah.
But I think overall stock market, yeah, like, what does what does Polly Market say about Parnas there market for that?
Oh, I don't know.
Jorri, can you look at all?
Well, Klarna, I think officially pulled their.
It pulled.
Well, like, the thing is these tariffs are especially.
especially bad for Klarna, right?
Like, it's consumer discretionary spend that you use BNPL on,
and consumer discretionary spend in a recession or with high tariffs,
like goes to the toilet.
So, like, you're not buying that extra $2,000 item that you didn't exactly need.
Yeah.
And that's what you were BNPLing anyway.
Yeah.
So I think we've seen a firm stock.
Oh, yeah.
I think our firm stock got cut in half.
Yeah.
I want to go deeper on circle because I feel like,
it's one of those companies that if they're about to IPO, I can't even name the founders.
I don't know all the big investors.
Like, it's this fascinating.
This is the case with a lot of, a lot of crypto companies, but even Bridge, like, we heard
the story of like, who made the money on this.
Okay, they got acquired by Stripe.
Like, they're very much in the Silicon Valley world.
And Circle obviously is, but hasn't really told their story in the way.
And so it's interesting.
They could have a meme stock moment where it's like the, it's the primary way that you get
exposure as a public markets investor to stable coins broadly, I guess. And that could be a good
narrative. It could just be a meme stock because, hey, crypto, it's, you know, whatever.
But they haven't really told their story in a way that's broken through, at least with me.
I don't know if you processed it any differently. But yeah, I think it's certainly less
hyped than all the others. The CEO, Jeremy Aller, I went to a stable coin conference a couple
months ago and he spoke. And so he's very sharp. And he's he's been at it for a very long time. He's
like of a different, slightly different generation than us. Like he, he started a company that IPOed
in like the 90s, like dot com boom. And then he was actually a venture capital. It's like he worked
at General Catalyst for a little while. And then and then launch Circle, whatever 10 or 15 years,
obviously not 15 years ago. Yeah. But, but yeah. That was the best time to launch a stable coin
before Bitcoin.
Getting really early.
I mean,
there were digital gold companies.
So here's the bull case for USC and like, and it's,
here's my bull case.
Sure.
So Tether is like the most profitable financial institution ever, right?
Like it's literally what are they, is it $8 million?
It's like $50 million per employee or something.
I forget the actual, you probably shared it at some point in show,
but it's like some absurd number.
They're more profitable than like any of these other major financial institutions.
the risk with tether is like it's opaque you don't fully know what's going on like there could be
people for a long time said there could be systemic risk you know associated with tether
they've been accused of of a lot of stuff over the years yeah yeah yeah but but they're dominant
from a market cap standpoint the second the second biggest stable coin is is usDC at a 60 billion
dollar market cap and a market cap is obviously just one to one with the supply right um and then you go down
the list the next one is die which is also uh you know run in this very like crypto native way from what i
know and then you are to to get to the next stable coin made from a sort of true traditional western
institution you have to go to first digital usd which is under a two billion dollar market cap
and below that is paypal us d u sd u sd
which is an $800 million market cap.
And so to me, I'm looking at Circle and it's like, here's like the power law winner.
The dominant, you know, they have 80 times the circulating supply as their next like regulated, you know, Western institution.
And they have USC.
Like it's a pretty good ticker.
I mean, the crazy part is we talk to.
It's not super sophisticated, but it, you know, brand matters.
I mean, we talked to Zach Perrae at Plaid and we were like, if you had, you know, full authority.
you were like the president, could you speed up wire transfers in ACH? And he was like, absolutely,
but it's not going to happen. And so it's like, yeah, maybe stable coins are here to stay and all the
pitch about just, hey, it's just going to, you're just going to be able to transfer money two days faster.
Like, that's enough, even though it seems like you should just be able to speed up the government
transfers. What's your, what's your read on any sort of predictions on venture right now?
I think that the lesson in venture since 2020 has just been taken.
advantage of chaos, invest through market cycles, never stopped deploying. I remember in 2022,
we were talking about the, what is it, denominator effect? Yeah. Denominator effect, yeah.
Denominator effect, but then it didn't fully play out. We saw this, I mean, we saw like a,
again, a bifurcation of like the big funds raising all the money on paper, but, you know, if you're
a specialist fund with like a strong story, you can, you know, still get, get funds done. But I, but I'm
curious first about the venture market, then I want to kind of ask more about portfolio stuff.
Yeah, first, like, maybe a fun tidbit for you guys is like just the last few days,
obviously markets have been in various states of turmoil.
And venture capitalists are, some of them are like trying to seize the day where,
like, for example, there have been a couple of companies in our portfolio that some investors
have been really trying to invest in, but the companies are well capitalized.
and don't need the capital.
And now the investors are like, hey, markets in turmoil,
might this be a time that you would consider taking my money?
Yeah.
Yeah, yeah.
You don't have to be living up to the vulture capitalist name.
I like it.
Making money.
Yeah, how do you even think about there's going to be some enterprising founders
that are like, look, I'm building a startup around that's built to help solve
you know, global supply chains or something, like, you know, the chaos is a ladder.
I'm going to take advantage of this.
To me, it's like, okay, if we're entering this sort of protectionist phase of de-globalization,
maybe it's too early to make bets.
But yeah, how do you see companies like actually being able to make something out of the chaos
or are you just telling your portfolio, you know, just stay focused on the customer,
ignore the noise, that kind of thing?
I'd really like stay focused on the customer ignore the noise.
I think we don't have any companies that are like super exposed for some reason or any other.
I saw you guys have Jay Malik coming on later today, which sounds like you timed that perfectly.
Yeah, it's crazy.
Yeah.
Like literally.
I mean, there's a few of those companies that have been, I mean, that's been the thesis for a while, just general reindustrialization.
But they really hit a royal flush this week.
Yeah.
So, you know, it's mostly state of course.
I think there, like, people are saying, okay, venture capital dollars are going to decline.
But as you know, like the way it works is we raise a fund every few years.
Yeah.
And we have plenty of capital.
So like it's not like, you know, an LP, there's some impact on the markets today and
that means we don't have money tomorrow.
It's like if there's any impact, it's a few years out.
So it doesn't change how we invest.
Now, the later stage investors, it is a different equation because for them, they have a
certain timeline.
They're hoping these companies go public.
And if the public markets are kind of frozen, that makes things difficult.
And like, they're thinking on an IRA basis, like, has their opportunities have declined
if they can't, if the companies don't get out at a reasonable time.
Yeah.
So mostly just texting founders in the portfolio.
Have you seen this with a, with a screenshot of the.
market down. That's just what I always do. Yeah, exactly. I want to get your reaction to this
post from Semmel over at Haystack. He says, seed is again going to be the hot zone where nearly
every VC fund will want to invest. Just like when COVID struck and in the early, in early
2022, VC shifted early to balance large checks by firing $3 million seed bullets. LPs should
expect median seed entry prices to be up 50% in the next vintage. Does that seem like a good take?
or what do you think?
No, I like, I love Semmel.
Yeah.
But I don't know if I buy that.
I think that's basically high, right?
That's the thing.
Yeah, please.
Please.
Please, please make it low.
Don't tell the founders.
Just like, wait a minute, I can raise my safe by 50% with one stroke of a pen.
Let's do it.
Yeah, it doesn't make sense to me because, so we started this fund in 2019.
and actually like the seed valuation is
2021 was an insane time especially in fintech like everything we were investing
and seemed like it was like turning to gold and then you know and then maybe turning the shit
afterwards but but but actually like seed valuations have actually increased from that time
and it's basically kind of been like a straight line upwards and what he's talking about
actually started happening in 2022 and a lot of the funds invested at seed in company
companies, you know, and the problem is if you're a multi-billion dollar fund and you write a $2 million check into a company and you invested in the wrong company in the category, like you don't get a chance to write a $250 million check into the right company.
So I think it's pretty foolish when those funds invest at Seed.
and we have a bunch of examples now of like of friends of ours who took money from a multi-stage,
but like the multi-stage doesn't care about them that much because it's a small amount of money.
So I don't know.
I'm skeptical that this is going to happen again or that it's going to really accelerate and prices are going to go up.
I don't know.
We'll see.
We should make a bed and have Peter Walker from Carter give us the data in a year.
I love his stuff.
Can you talk about, there's this meme of like, oh, for a while, if you're building a consumer or something, like you get steamrolled by what if Google builds it, right?
And there's this story that Google is allegedly paying some AI staff to do nothing for a year rather than join rivals.
hilarious.
I want your reaction to that.
But then I also want to know, like, is there, does that meme exist in fintech?
Is there an idea that, oh, MX or Visa or J.P. Morgan are going to build this?
And has that ever actually happened in practice?
Well, yeah, and even potentially on that, I'm curious, like, Open AI wants to run your entire life.
Yeah.
Have you heard any sort of, like, rumors or is any concern around people saying, oh, I'm building a consumer agent, you know, for financial, consumer financial services.
Yeah.
But then Open AI might be like, oh, by the way, we launched a partnership with Chase or we launched a partnership with cash out.
Yeah, we can analyze your credit score now with an agent.
and that model, that rapper company got Steamrolled.
Yeah, what's your take on all that?
Okay, so the first thing I think you said was the rest invest situation.
Yeah.
Where, and so I thought it was really funny because did you guys watch Silicon Valley
the TV show?
Oh, yeah.
So good.
And there's that, obviously there's a, the phrase rest invest, I learned it from that show.
And it's certainly playing out of Google.
I had no idea that that phrase was like popularized in some way by the show.
Oh, yeah.
Yeah.
I thought it was a 2021, like big tech thing.
No, no, no, no.
This was the thing going back.
That show.
If you haven't seen it, you got to go back and watch.
It's so, so good.
So I never could, I never could get into it because I, it was just too close to reality.
Yeah, same thing.
Like the most like, it was not like, I watch TV because like I want to like, you know,
not think.
Yeah, totally.
Watching Silicon Valley is like, oh, that's an email I need to reply to.
Exactly.
I should follow up with that founder.
You know, it's just like.
My first company Soylent was in the intro to Silicon Valley, like in the intro sequence.
And they're just like making fun of me every single day.
Also, one of the creators went to my high school.
And so like I knew him and he's like actively poking fun at me every single episode.
Amazing.
That's amazing.
It's great.
But yeah, yeah.
It's very silly that Google would let this even leak out.
I don't know how that happened.
Totally.
It's crazy.
I mean, the things you hear out of Google are so crazy.
It's wild.
I think more so than it.
any other big co.
Like my wife works at Meta and they've like really got their shit together,
like the year of efficiency, stuff like that.
I think probably before then it had stuff like this, but not now.
Okay, so that was that was topic one.
I think topic two was like, what if X company builds this?
And is that the case in FinTech?
Yeah, I don't think so.
Like, in fact, you actually had, look, one of the sponsors RAMP.
So Stripe had built RIM.
Drive had a corporate card.
And it didn't work.
Like they ended up investing in RAM and deprecating that card.
So I think people have tried to do stuff.
There is the what if Stripe does this?
What if Plaid does this?
And there are in some cases, I think that's totally valid.
But for the most part, I think there's plenty of green space out there.
And, you know, Stripe has been acquisitive.
Obviously, we talked about that before.
Bruges.
There's nothing I'm super afraid of.
I will say in some categories, like,
For example, in wealth management, there was the wealth fronts and betterments of the world, the robo advisors.
And people said, okay, like, we're not charging 2%.
We're going to charge you 25 bibs.
But the reality is that the service offered by somebody who's charging 2% is different than what they offer at 25 bibs.
And the 25 bibs solution was fairly easy for Vanguard to build.
And Vanguard became by far the largest robo advisor in the world.
Got it.
But I'm not afraid of that in general.
in fintech too much
Do you think that
Do you think
humanoid robots
present an opportunity
for loan sharking
as a service
You know
Come break your legs
autonomously
Break your kneecaps
It's like hey
We're going to offer you this great rate
Whatever it's secured against your kneecabs
It's security
It's funny
Like
we
Our tagline for our fund
When we started
It was everything
It was fintech
It would be funny
If we invested
any humanoid robot
company and then just we were like deadpan like what do you mean like obviously the use cases for
loan sharks yeah yeah i mean i was talking to sales guys i'm curious like my thought goes with
um uh the do you think that AI can can get is already or could get materially better at underwriting
than than a human just spending you know months on an opportunity and is that something that do you
that fintech broadly has fatigue around investing in like AI lending just because it's been sort of
this like ongoing narrative isn't there like what what's the what's the public company that was
sort of promising this for a while something um i mean there was metro mile which was better underwriting
upstart but even metro mile was better underwriting for your car insurance based on how you drive they put a
GPS tracker and uh like a gyroscope in there basically see if you're stomping on the brakes every two
seconds give you a higher insurance premium. A lot of promise there, but not a lot of, you know,
massive adoption over time. I think they didn't execute that well. And I think with Metro Mile,
there's actually, Root has done a better job of it, but Metro Mile, it was primarily just
mileage based, the number of miles you drive. And then Root gives you a phone, you put your,
your phone in it, like checks if you're breaking hard and where you're driving and stuff like that.
So I think that there are opportunities to be used in insurance.
In underwriting for loans in particular, it can be tricky because you're the regulatory framework in the United States, Equal Credit Opportunity Act, Work Credit Reporting Act, etc.
You're not allowed to discriminate on the basis of race and gender and some of these other things are eyed to that.
So that can become tricky.
And you have to respond.
You have to give people the reason why they were denied.
like it's adverse action notice.
So you can't have a black box model that's like,
here's all the data.
They just give you a massive matrix of weights.
And they're like,
this is why you were denied.
Figure it out.
Totally.
So that.
Tensor number 76 was activating for you.
So get out of here.
Yeah.
So actually,
you know,
if we didn't have that,
lending would be probably more efficient and like you'd better be able to target the right customer
but we do have those things for a reason and so we can't have a black box model and so there
are actually companies we invested in the company that's like in part detecting bias in AI underwriting
for this purpose to make sure that you're compliant yep and yeah so anyway I think it can be used
and can be super useful but because of those regulatory
bound like guidelines. I'm not sure it's going to like be a step change in underwriting.
Yeah. Makes a lot of sense. Jordy, last question. You want to let Sheel get out of here?
No, this is great. Always a pleasure.
Always fun. Looking forward to the next one. Yeah, this is great.
Likewise. Have a great rest of your day. Godspeed. We'll talk to you soon.
Well, we got some breaking news and other massive funding announcement coming in to the studio.
Victor from Crea. Is that how you pronounce it?
Crea is coming in. AIV.
video company that just announced a massive fundraise.
Let me look up if I can find the details of this fundraise.
So I can get everyone up to speed before we bring Victor in here.
The website is crea.a.a-a-a-k-R-E-A.
And they just announced a huge funding round.
$83 million, just a couple million over J.
not that it's a competition.
They got Andrews and Horowitz, Bain Capital in the round.
The past 14 months at Crea have been hectic.
We rolled out over 50 major product updates,
grew to over 20 million users organically,
and they 20x their revenue,
all with a team of eight working out of a living room in San Francisco.
That is fantastic.
You'd love to see growth like that.
It doesn't happen every day,
but it's happening more and more in AI.
So excited to bring it.
Victor into the studio and talk about that. They write, the numbers are exciting, but they can miss
something crucial, the team behind it all. Krea is the work of a small, talented group of imaginative,
incredibly dedicated people, and yes, most of us still live together. That's fun. Until now,
we've never shared metrics or announced our funding. Heck, we didn't even have a blog until a few
hours ago. Those details always felt secondary compared to what truly matters to us, making AI
intuitive and controllable for creatives.
Now, after the release of our redesign, the growth of our team and recent funding,
it feels like the perfect time to open out about what inspires us and what we're building
towards.
So they write, we're living through a moment where everyone talks about automation APIs
and how AI and software are eating the world.
Perhaps too much.
Don't get us wrong.
While AI is powerful, transformative and is going to radically change creative work,
creatives aren't going anywhere.
40,000 years ago, we painted red ochre onto cave walls.
Later, we drew with graphite on paper.
Today, it's complicated.
We use cameras to digitize light through glass lenses and silicon sensors,
transferring data through metal wires to illuminate the LEDs,
lighting up the screen you're reading on now.
How do you know I didn't print this out?
I could have printed this.
The printer still works at TBPN.
We might have shifted to laptops, but you never know.
Too much pushback around.
Don't assume anything.
No, I am reading this on the screen.
Paper usage.
And old tools and work clothes.
Do we have Victor in the waiting room yet, by the way?
Not yet.
Old tools and workflows will disappear, but our creative itch won't, and I agree with that.
Excited to dig into that with him.
We will build new and more powerful tools to keep doing what we've always done.
Master new mediums for self-expression and storytelling.
AI will render some tools obsolete, but not the people behind them.
We see AI as a new medium that lets us express ourselves through any format, text, video, sound, and even 3D.
such a medium needs better, smarter, and more controllable tools.
That's where KREA comes into play.
They say it won't replace.
AI will not replace creativity.
Creativity is not disappearing, but the walls between creative mediums are.
Traditionally, excelling in one creative medium rarely translated smoothly into another.
AI changes that and we're bringing Victor into the studio to tell us more about KREA and the fundraising.
So welcome to the stream, Victor, you hear?
Yope.
How you doing?
What's going on?
Yeah, I'm here. Great. Can you give us a brief?
It's doing great. Great to meet you guys. Fantastic. Is the office going to change with this new fundraise? I got to ask. Are you guys going to stay posted in the living room? Do we have you, Victor? I think we might have lost you.
Seems like we're having some technical issues. Okay. Well, we can hear it, see and hear you now. Yeah. Let me go along far away from the Wi-Fi. I mean, that is the issue with working at home. Complicated Wi-Fi. You need to
the enterprise solution soon now that you have the big series D done.
I know so very soon yeah oh shit they are doing another meeting so I'm gonna steal
Diego's room this is great I love I love getting the whole tour I love getting the
you guys you guys want to see the office yeah yeah yeah yeah let's just do a tour anything that you can
show us you can turn around oh okay there you go API keys hopefully
Mexican music going on that's good that's fantastic yeah wow hey guys how you do
congratulations on the milestone looking great wow you guys said you guys we're not
kidding about the living room but you've really built it out I love it that's amazing
it's looking good that's good nice why don't you introduce yourself I John John was
gonna ask you that then I cut him off no you're all good yeah sorry sorry about
no worries so my my background my background my brother my
Yeah, like I guess on my background, like the TLD artists, I, growing up, I was very interested
into creative things of all kinds. I mainly had a music band and I was doing from playing multiple
instruments in the little studio that I created in my house to producing music, mixing,
mastering, like learning about all of these processes around music production.
but through my music band I also got super interested on doing photography and like doing different
kinds of content for that music band. So that way I explore like many different things from
graphic design, 3D graffiti art. I also had like a big passion for that. And at some point I was
that was in 2015. I was in I was just like I finished high school and I didn't I was not sure about what to do after that.
And I had like two options in front of me.
One of it was go and do classical guitar studies at the Conservatory of Barcelona,
at the Conservatory of Guitar of Barcelona.
And the other one was doing something around computer science or physics.
I really like math.
And I guess that what I like about math is kind of like the challenges that it poses
and like the interesting.
Yeah, like I guess I like, I love challenges in math,
put like a lot of challenges in front of me.
But in the end, I found like this middle ground
on this degree that it was called
audio visual systems engineering.
It was kind of like this degree where they showed you
how a microphone works,
how MP3 encodes audio,
how MP4 encodes video, etc.
And that's where I met Diego, my co-founder.
That was like 10 years ago.
He ended up in that same degree
following kind of a similar story.
In his case,
he came from having a lot of interest in film
and a lot of interest in 3D as well
but he also loved programming
and he also loved engineering
so we both ended up like in that degree
and on the second or third year
I got introduced
I mean first of all I loved coding
like right after getting into the degree
I loved coding
found it like extremely creative
later on I found about AI
I was my own loan by
deep learning, just like the fact that you can have these new networks learning by themselves
from data and being able to do such complex tasks was very interesting to me. And when I discovered
about GANS that they were like very early models for email generation, that's when I fell
super deep into the rabbit hole. And I ended up like reading a lot of papers doing a ton of implementations
by my own from all these papers that they were out there back when everything was open source.
And the good old days.
The good old days.
Do you have a first question?
No, go for it.
20 million users, absolutely massive.
Congratulations.
Where are you seeing those folks come from?
Is it consumers just having fun, prosumers who are maybe doing little contracting work,
monetizing their creativity on social networks, or are you already in the enterprise or all three?
All three?
I think that up until recently, there were like two very well-defined blogs of users.
One of them, it was the consumer type.
It was people who this technology gave them a zero to one when it comes to creative freedom
or to like enabling them to create.
It's people that didn't necessarily come from a creative background, but they had a lot of joy
out of expressing their creative ideas using this technology.
and they were paying for the subscription
almost in the same way that you could pay for a video game
or that you could pay for a camera.
Then we had the professional,
and the professional, it was that user that did have a creative background
and that it was using our technology,
when I'm in our platform, to speed up some of their processes.
These speedups, like vary depending on the industry.
Like you would see architecture studios coming to CREA with very low resolution renders and using our enhancer to get these renders up to 4K resolutions with very crisp textures.
Or you would see game designers coming to our real-time tool, putting a bunch of ideas around characters and being able to create prototypes for some characters that they were designing.
Can you talk about just general adoption?
So during the during this sort of like studio Ghibli moment, it's still, you know, top of mind.
We saw a lot of people that still weren't aware.
They had no idea how these images were being created.
John and I think that some people thought it was like Snapchat filters or something like that.
Can you talk about just like consumer sort of awareness and adoption broadly?
You know, are you guys still finding people every single day that are just sort of like completely new to this sort of new?
are sort of new image generation models or, you know, what do you think the broad consumer
awareness is today? I mean, I was, I just came two days ago from a short trip to New York. And I feel
like that that trip to New York made me realize how deep in the bubble we are here in SF. Like,
I think that I take for granted that people know that nowadays you can generate images with
artificial intelligence. And that's not the case. Like, I think that we haven't.
and we haven't reached.
I wouldn't even know what's like the percentage of like reach that we have had right now,
but it's definitely very, very small.
Like this technology is still nascent.
People like us are trying to make it intuitive and usable for really anybody
to just like wrap a phone, type of URL, and be able to create an image very easy.
But I think that people still need to know that this is even a possibility.
Like I think that that they just don't even think that.
some of the problems that they have when it comes to marketing or when it comes to doing product
design can be solved today by artificial intelligence. So I don't know if I'm the best one,
like if I'm the best person to have like a good sense of what is a current adoption because
of how deep we are in the S.F bubble. From my experience that we that I've had in New York,
I don't know, like I had this fun story that I was on an Uber and the Uber like she just like
saw that I was like talking on the phone in Spanish and she was from Puerto Rico. So she started like
talking with me and asking asking me what I was from and what I was doing. And this woman she had like
like, like she was like selling a sort of like beauty products on Instagram. And I saw it. And she
started asking me, oh, so can I use your tool for doing like this photography? Or can I use like all these
things? And as she was talking, I was like, yes, you can do it. But you need to go through a process.
It's not like some magic thing that you like go there and like the AI does everything for you.
You need to go and train a model with your product.
After the model is trained, you go to the image generator.
There you create like all the assets that you want.
And after you have this workflow in mind, after you have like this workflow in place, you can generate as many assets as you want and like your workflow is going to be extremely optimized.
Yeah.
How do you how do you think about prompt engineering long term?
Is it, you know, I remember like a year and a half ago, maybe a year ago, everybody said every company like prompt engineer is going to be this new role.
And now it feels like it's getting easy enough to prompt a lot of these tools, I'm sure like Korea, that maybe it's just not necessarily, maybe it's a skill set, but not necessarily a job.
But I'm curious how you think, do you think that prompt engineering will still matter in five or 10 years or it'll just be super intuitive?
I mean, program engineering at the end of the day, it's just like being able to communicate
your ideas in a clear way with like this technology, you know?
Like we have like this AI model that can understand language and that can do things.
And from engineering, it's just like the way that you tell these knowledge that we have
encapsulated how to do things or what exactly to do.
So at the end of the day, it's just managing.
And I do think that this feels like a new way of doing software.
And I do feel like this is going to, like in the future, most software that we see out there
has been created by a very big percentage through problem engineering, through steering AI models
towards whatever you want to accomplish.
And I see this on the visual space.
Like I see I see us building Korea in the future more and more through instructions.
I see our users working with our platform more and more through instructions rather than through
just like typing up Roman and just like getting an image.
I think that this new model from OpenAI kind of shows that.
Yes.
Speaking of the new OpenAI model, it seems like they've evolved the actual underlying algorithm.
it's not purely diffusion-based.
Are there new buzzwords or keywords that have you reverse-engineered any of how they're
doing that?
Because it seems like there's a number of steps.
Like they're actually transforming the prompt.
There's some reasoning in there.
The image loads top to bottom, which we haven't seen before.
Mid Journey kind of diffuses everything from blurry to crisp, just the whole image at a time.
It seems like they're doing some sort of blocks or line-by-line rendering.
What can you tell us about how that system actually works?
I don't have a, I mean, I have some intuitions, but I don't like super, I don't have high confidence on how it works.
It seems like there's some outer aggressiveness going on.
And we have already seen similar things with croc image generation.
But I feel like to me, what it's really game changing about this new image model is the,
it's like very similar to what we were like talking about before.
like this is an image model that is able to reason and it's able to understand instructions
like it's able to understand here's like the picture of my dog turn it into studio ghibli
and and like this this is like something new this is like something that previous diffusion models
we're not good at like the models are good at you have like a text and you can generate an image
that kind of represents that text but it's very hard to have them reason and to have thing about
like what you want to do and what is the instruction that the user wants and how to accomplish that goal
yeah yeah it seemed like there was like how it was like everything in style transfer should have been
plus the the latest and greatest in diffusion models like they really like packaged that up very well
and so i think that's why it broke through uh but anyway congratulations on the round thanks for
thanks so much for stopping by yeah and thanks for the office tour unexpectedly that was that was really
fun uh but we'll let you get back to work i'm sure we're so much to do the whole team and
And we'll talk to you soon.
Sounds great.
Thank you so much for having me.
Thanks a lot.
Talk to you soon.
Bye.
Very interesting.
We got Leif coming on from Public.
I'm curious if he's been sleeping at all.
It's a wild time in the market.
He has some interesting data on what's happening on public because that's where people
go to trade, multi-asset investing, industry leading yields.
They're trusted by millions, folks.
You've heard us do the ad reads before.
But now we have Leif in the studio, breaking it.
down for us and we will bring him in right now how you doing leaf welcome to the stream boom what's going on
great to finally have you nice took some it's gone let's go i was just saying i had my caffeine already
so that's why i'm like good fantastic good somebody was commenting yesterday about our caffeine
consumption oh yeah it's like yeah it's easily easily 500 milligrams plus oh yeah uh john that's 500 milligrams
milligrams during the show often times, but he's like built like a horse. So he can take it.
How are you doing? We were just joking about whether or not you had slept at all the last week.
I know it's been busy. You know, I'm sure it's been a busy time for you and the whole team.
It's been busy. But our systems have been up at least compared to other folks. So that's great.
Yeah, that's good. Walk us through some of, I mean,
I mean, I'm mostly curious to hear you would share it on X yesterday about how there had been more buyers than sellers over, at least in certain moments over the last week.
Maybe break down that data point and then we can talk about some other stuff that's top of mind.
Yeah.
I mean, generally speaking, just like a mini step back is like this generation of investors, like called especially millennials, like man, they have been through.
market cycles like crazy in the past five years, right?
And or even just like through their lifetime.
And like I even saw some like some meme on on X the other day of like millennials
experiencing their fourth once in a lifetime opportunity of a drop in market.
You know?
Yeah.
And so on.
And I think especially like the March 2020 drop where like circus breakers hit and so on.
It's crazy.
It's still in people's minds.
And I think that specifically because you saw.
a lot of like individual investors actually also making money on that.
And I think that has stuck with a lot of people.
And so generally speaking, this behavior of buying the dip is a little bit retail investing
culture now.
And so whenever you see these like massive drops, this is really when we see some of our best
days.
Yeah.
My reaction.
Yesterday it was like, you know, one of our record days and just deposits, for example.
And yeah.
Yeah.
Well, my reaction, you know, the stock market was down 5% back-to-back days.
And I was just like, what is everyone complaining about?
We're not even hitting circuit breakers.
Like this is not that crazy to me because I remember 2020 and it was way crazier.
But of course, like, it's very serious.
Can you actually break down the mechanics of what exactly is happening and what truly triggers the circuit break?
Yeah.
I don't have the exact numbers in front of me, but it's essentially just if it drops too quickly to, you know,
specific thresholds, I believe it's 7% and then 10 and 15 or so, essentially they
pause the markets and that didn't used to exist in the past, right?
And so it's essentially like a little bit of like a safety trigger, like a speed bump
to make sure that investors can take a breather when these markets start to drop too quickly.
Yeah, in Japan, don't they have lunch break in the middle of the...
Yeah, dude, none of us in Japan, other countries too.
Other countries too, I love that.
But yeah, it makes sense.
I mean, a couple of years ago when the algorithmic trading got really popular,
there was like the flash crash.
I think the market traded down like 20% in like two seconds and then went back up.
And yeah, obviously you want to avoid that.
What about overnight trading?
You always hear, oh, you're watching the futures market.
And it seems like somebody has an edge here that they can trade before the market opens.
Is 24-7 trading coming to America?
We've heard some rumors.
Is there a way to get in on that action?
Generally speaking, I think it's definitely coming.
Like, it will also come to public at some point.
Right now we essentially have, you know,
4 a.m. to 8 p.m.
But the thing that you have to think of is that each trading window
has its own participants in its own liquidity and execution venues.
And so think of it is like there's the regular opening between your 930 and 4 p.m.
That's the most liquidity.
It's when like most people participate.
You could call that the healthiest time in the market, in theory.
Then you have essentially pre-market and post-market, which is, you know, 4 a.m. to 9.30 and, you know, 4.30 to 8 p.m.
And then you have overnight, which is like the new thing.
Overnight right now, there's essentially only like one major player who drives some liquidity for that.
And what happens there is that because you have only one,
player, you have a lot of, like, or like, you have not as many platforms participating yet.
And so you can have these moments where there's a lot of kind of unilateral flow happening.
And that's why in the, in the, in the overnight markets, you often see certain stocks just
suddenly rally or so on. And that is a little bit, I don't want to call it fake, but it's a little
bit like it has these wild swings because the types of people that trade in those times of the
markets and it's a concentrated equity pool. And so, you know, these swings just happen, you know,
way more dramatically. And so you often have these moments where like in overnight, a stock goes
up and you see on Twitter, everyone's like, I'm sorry, on X, everyone like posting the screenshots
of like, oh my God, you know, Palantir is going nuts right now. Over the company might be. And then suddenly
like 9.30 market opens and it just
goes down and everything
normalizes again, right? And that is really
just because each market window has
their own participants and their own pools of liquidity
and so you kind of have to take
a little bit with a grain of salt. Like, can you
play that? Maybe
but there's always this hand risk there as well.
Can you talk a little bit about
information diets?
And really, I want to know
what events that are predictable,
not like Trump imposing
massive tariffs all of a sudden on Liberation,
day. But what can we count on light clockwork every single day to be the highest volume day of the
year? Is there a Super Bowl of stock trading that happens, whether it's earnings day or jobs day?
What are the big reliable sources of high liquidity in the market?
I don't know if I have a good answer there. My gut reaction would be just from internal measures
like Monday mornings because you have all you have a lot of cute orders from the weekend and stuff
like that yeah makes sense it executed at the open okay um because not everyone will trade pre-market
and stuff because spreads are wider and all this all these things um but um specific day is not really sure
to be honest maybe like big tech earnings too is kind of like a season for that generally speaking is
like it's always like it's often just driven by market events right at the end of the day
um people will trade when they see opportunity
And if you can predict that, let's start a hedge fund together tomorrow.
But other than that, but other than that, you know, it's, it's like, it is driven by these, by these moments, right?
Whenever, like, we have good days when the markets are in the news, no matter which direction.
But as long as the markets are in the news, we have good days because people are going to inspire it one way or the other.
Yeah.
And, you know, so, so in a way, trading volumes for companies like ours are a little bit like competing with any other thing that competes with attention.
Because, you know, if markets are in the news, you get inspired for something, and that might drive action.
And that's what we see.
Yeah.
What do you see from a demographic standpoint? I'm curious.
Public obviously offers access to bonds, which, you know, it was probably good to be in bonds, you know, if you sold last week before Liberation Day.
But do you see a lot of demographic differences, you know, sort of like Gen Zs, basically like bonds for me are just like, you know,
GameStop, right? Like I always know it's going to be worth something. Yeah, it's a store of value.
It's a store value, right? But I'm curious if you see sort of pretty specific activity across different
demographics in terms of interest in these different types of assets. Yeah, I mean, straight-up bonds
always skew older, just from the perspective of the older you get, the more you're like thinking
of preservation versus growth. But then I think what's interesting now is that, so we've launched
multiple yield accounts essentially.
So you have your high-yield cash,
which is similar to a savings account.
You just get your yield and it's variable based
of interest rates and such.
Then you have your bond account,
which essentially like a basket of corporate bonds
underlying.
And then you have like your treasury account,
which is like US government treasuries.
And those kind of simplify the investments into bonds
because you just deposit money,
earn yield.
It's like very simplified and just like,
you don't have to like pick certain bonds and stuff like that.
So what we've seen is with that is that a lot of people
are using those to just,
put money into the markets waiting for these moments of, of, like, of opportunity, right?
So what we see in the last few trading days essentially is that people cycle out of the,
the yield accounts and into stocks and ETFs because they essentially had this cash lying around
and we're like, okay, you know, I think totally what we've been hearing a lot is that like,
hey, after Trump was elected and the market started ripping and there were, you know,
all-time highs and a bunch of things going on all the time, that there was also a bunch of
of individual investors who were essentially feeling like,
oh, I'm just buying the top right now?
And so they put it into these yield accounts.
But then also the minute you saw things drop,
the way they've done now,
they've basically cycled it out of the yield accounts
into stocks NTS specifically.
So you're seeing younger generations,
using it less as a, hey, I'm going to now
actually hold the bond to maturity for 10 years from now
and more use like these account ties that we've created
for just like earn some yield on your stuff, you know,
until you actually see other opportunities.
Yeah.
Do you think AI is already helping retail investors better understand the companies that they're
investing in, right?
Every public company is putting out a huge amount of information unless you're becoming
just overly obsessed with this specific stock.
It's hard to figure out what's important.
What should I be looking at?
What have you guys seen?
I know you've released products to help people.
leverage all of that data with AI, but I'm curious what you're seeing.
That's a great layout, Jolly, by the way. Thank you.
Real softball.
I was trading to my pitch, you know.
Fainful sponsor.
Yeah.
But, yeah, 100%.
And like, we obviously launched Alpha, which started off by just you can swipe down on any
stock, ask any question about the stock.
And, you know, and that just created this like bite-sized researching for things.
And we've kind of fed the model with a bunch of,
of data that we already had from years ago.
Like for example, we acquired a company like three, four years ago that was essentially
a tool that turned all the SEC filings that had, you know, custom company KPIs of like
subscriber numbers and, you know, how many cars has Teflas shipped and things like that into
more structured data.
And then we use that structure data to kind of train our models and such to make that
very easily accessible.
Now what now has happened is that it's much more proactive than, you know, then just you
kind of have to pull information.
And so the obvious one is what we call why is it moving,
which essentially, if a stock is going in either direction very heavily,
we kind of pop this card on that page and tell people, you know,
the like why this thing is likely moving right now.
And then you can tap on that,
that brings you into a conversation with alpha,
gives you more, you know, granular breakdown on that.
And so it's much more the pulling versus the, like much more like the pushing
was the pulling.
And I think that's also just generally where it's where, where,
But what's awesome to see is that these like these like bite-sized contextual moments where I can be super fast with just really great at summarization.
Yeah.
And can also go against biases, right?
So like if we go for news stories, for example, we sort of say that QA multiple sources.
So we're not just coming from one source and pop it to you, but we QA multiple sources and then the summarization comes for the multiple sources.
And so there is a little bit of like QA built in and a little bit of like taking the bias.
all that maybe one writer will have or something.
Yeah,
speaking of,
which can be helpful.
Speaking of data quality,
what do you think,
you know,
yesterday Walter Bloomberg,
shared,
shared some news that wasn't quite accurate
and moved the market,
you know,
trillions of dollars,
maybe helped us avoid
whatever it was,
Black Monday,
Kramer was calling it.
What do you think is,
do you think that,
do you think that there's any,
like,
solution to that,
it's just the nature of the internet where now you have these accounts that basically act they publish
they're basically like mainstream media except they just publish headlines they're not doing any
journalism they're not even looking at data they're just sort of like trying to be the first or second
or third big account that's like sharing a headline is there any is what's the fix there right
is there one or is that just the nature of the internet where this sort of information breaks and
then markets are going to react really quickly and now retail investors are so
ready to act on information. You know, a good example is like if you just happen to be on X when
Trump posted Trump coin and bought 20 grand of it, you became, you know, a millionaire within
within a few hours. But I'm curious, like, if you've thought it all about like how, yeah,
just, just, I don't know if there's, I don't know if there is a solution, right?
Yeah, but I think it's, I always come back to, um, who are you building?
for and therefore what behavior is your product inspiring.
And generally speaking, the way you design your product will always have an impact on how
people use it and their behavior.
In our case, you know, yeah, you can buy a bean coin, you can do options trades, but generally
speaking, the way we've designed the product and the offerings that we have are more focused
around building long-term portfolios for people that want to compound their wealth.
over time, you know, all the fixed income offerings that we now have, et cetera.
And I think there are just certain design decisions that, that impact in the end, the behavior
of like, like, of these users, right?
And yeah, therefore, in the end, I think that is much more important for people to make
healthy investment decisions than necessarily, you know, like how they consume and so on.
But like that behavior you're talking about.
it's obviously not necessarily coming from the potential wrong information from some X account,
that behavior is more cultural or how they were trained when they started being in the markets,
you know? And so I think that is much more the sense of like if the platform you're using is closer to
gambling, you will enter being more of a gambler automatically just based on the design of how you
were introduced to the markets. And therefore, you'll be more prone to, you know, potentially
react on these types of things because your investing style will be closer to a gambler,
than maybe someone who tries to compound their wealth over time and, you know,
cycling money out of a hiker account into, you know, Amazon stock or whatever because they see an
opportunity that. Yeah.
Both two to then also hold it for long term and so on. So I think that's much more the
the issue, so to say, than then then those accounts.
I have a bunch of other questions, but I think we're, I think we're over. We'll have to
have you back on very soon. I know you got some big stuff in the works. Thanks for coming on.
Yeah, I'm excited for the announcements.
This would be great.
We'll talk to you soon.
You're the man.
See it.
And we have our last guest of the show announcing a $30 million series B, the smallest round of the day.
It's rough out there.
What is this a round for ants?
I don't want to talk to his crap.
It's great.
It still gets a size gong hit.
But it is funny.
We've seen a bunch of huge rounds today.
It's a good day in the markets.
The markets, the public.
markets are down, but the private markets are ripping. Let's bring in the founder and CEO of
Arena AI. Today, he's announcing a $30 million series B, and introducing Atlas and AI hardware engineer
that is used by many of the world's most respected and ambitious hardware companies. I'm excited
to talk to him. Now, if you're there, welcome to the studio. How you doing? Boom. What's going on?
Nice to see you guys. It's great. Would you mind with just starting with a little introduction on who
you are, the company, and maybe a little bit of your background, because I thought the,
the previous company was really interesting, too. So I want to hear about that.
Thanks. No, that's awesome. Yeah. So I'll tell you, like a bit of that company, it's Atlas AI
hardware engineer. Companies called Arena, we're based in New York. Yeah, background. I started
out as an applied physicist, so I spent like a decade when I thought I was doing physics,
dealing with hardware problems. Again, this was like a while back. You know, switch gears,
did a brief stint through consulting, so war suit for a short flash of time over there. And
Bring it back.
Yeah, it started right during that financial crisis too,
which was a wild time to be starting a job.
Wow.
But then sort of missed tech, moved out of San Francisco.
The first company, to your point, was in 2014.
It was called Kimono.
The idea was to make it really easy, I mean, to write a web scraper.
And it was pretty popular.
We grew to 150,000 users.
We got bought by Palantir, which is where I met my co-founder.
We were there for a while and then started Arena 2019.
Very cool.
Can you take me through the founding of Arena?
How did you settle on this to build?
It seems very on trend now, but you've been working on it for a couple of years.
What inspired you?
What was kind of like the early go-to-market, the first customer that you were talking to?
What does customer development look like?
All that stuff.
Yeah, totally.
So just, you know, we had a bit of an interesting path here.
I would say it's like a little bit non-traditional.
We started, we decided to bootstrap the company.
Oh, wow.
And so we said, well, you know, if you think about like our view on enterprise problems,
If you think about the B2B problem space is there's almost like a Maslow's hierarchy, right?
Which is if you, let's say you've had a job for two to four years and you're like,
you've encountered a certain group of problems like you've encountered payroll, onboarding, communications.
But then if you've been there for a while, you're deep in that industry, you're almost,
you're seeing another set of problems, right?
And I think one of the things Palantir did so well is they were able to go so deep into a customer for so long
that they encountered problems that for which there was very little competition for.
and like previously you had consulting companies kind of doing that.
So there's there's I think a whole host of sort of untapped problems.
And so our view is if we want to tackle problems that are really deep in an industry that are really valuable,
we need to go really deep with a customer.
So that's been the philosophy since the founding days.
Instead of saying we're going to sell to other startups and sell bottom up,
the view is to start with a very difficult to enter customer start top down.
And the origin of the company was actually more, let's say, less vertically opinionated.
we had a depth in reinforcement learning and transformers were like let's go and apply that for
enterprise problem so we were not as sort of like our thesis had informed as sharply as it had today
and then we saw traction in a few different markets and like post-chat GPT we were like look I don't
think for a small company playing in horizontal AI is really a winner's game but we found that like
there was this beautiful intersection that went back to sort of my days as a business we're like
two different technical fields together with like you know applied things and
physics, electrical engineering, and AI,
now you have an interesting customer set
where you look at like a hardware test lab,
it actually hasn't changed in a long time.
The incumbent competitor set are three companies
from the 80s.
It's weirdly the underpinning layer of technology
on which all of our software runs,
weirdly hasn't changed that much.
Developing the hardware has like stagnant.
And it's kind of surprising when you think about it.
Yeah.
Can you talk a little bit about like hardware engineering 101?
Are we writing Verlog?
Are we in CAD?
Are there other systems?
Like, what does the work look like?
And is this something where it's like, it's managed on GitHub, so Devin's going to go off
and write some code for you?
And we're just doing fancy auto complete.
That's probably, I'm not trying to diss.
It's incredibly valuable if that's what it is.
But just concretize, like, what are we actually talking about here for folks who haven't
done hardware engineering?
Totally.
Right.
So let's like, let's break it down.
Let's take a simple example.
Let's take something like a drum, right?
Yeah.
We've got like, you've got like the mechanical shell where you've got like your,
mechanical engineering, CAD models, stress drain modeling.
Still a lot to do, but humans got pretty good at.
We've been building physical stuff for a while.
We can screw things in, weld them together.
Again, not trivializing that, a ton of opportunity, but that's kind of figured out.
Now, inside, especially as you think about systems that are starting to go autonomous or partly autonomous, right?
You're like, I mean, we've had helicopters, now we have drones, right?
So what's the change?
The brains of this are basically like a set of embedded systems, right?
So embedded systems effectively, your computer, the green mother.
motherboard like you've got inside, except a whole bunch of them, right?
You've got like one that's operating as a sensor and multiple different types of sensors.
So like an IMU for how you're oriented, like temperature sensors, optical sensors.
So all of your sort of sensors just like the body has.
And then a brain.
And you might have multiple brains, which might be onboard again.
In our drone example, flight computers.
And then you have actions that you take, like servos and actuators.
And you think about this like inside that mechanical shell, you've got this almost electrical skeleton,
sort of like your own nervous system sort of wired together, right?
And at that layer, you know, to your point, there are two things that are happening.
One is all of the electrical connections to make that work.
And then for certain of those chips, you're running code on board.
So to your point about the Devon, so, you know, you might have an FPGA that's programmable.
You're putting code onto it.
And so that's sort of the sort of the, we're currently at that inner layer.
We're currently at that nervous system because there's this huge need.
And if you look at like the, just the kind of labor markets for a second, this is actually weirdly not surprising, but but kind of has profound implications.
The last 50 years, if you look at computer science course enrollments, they're up by 90%.
None of us are surprised by it.
But electrical engineering course enrollments are down by the same amount.
And so you look at it, we've got this huge research.
We've got tariffs.
We've got all that.
We've got a huge resurgence in American manufacturing, right?
And now you have all these intelligent hardware companies, robot companies, space companies.
And like, you have this burning platform problem where it's like, oh, my God, people haven't been studying this stuff.
And like we're trying to now ship at the velocity of a software.
company in a hardware space where stuff can literally explode.
Yeah.
Without a workforce, right?
Yeah.
My favorite, my favorite example here is, is you have Sonos, which hasn't, has made
like beautiful devices, but they haven't managed to like just get like even the
saw like, like the collective experience of using a sonos product is just completely brutal, right?
And then and then you like look like this is a company with like hundreds, thousands of employees.
They're public.
and it's not even defense.
Like it's not critical
that my speaker work
like when I want it to play music, right?
It's annoying, but it's not the end of the world.
And then it's like, hey, if that is hard
in a controlled environment and a home
and then we need to do much harder things
in sort of these defense critical industries,
like that should be a red alert.
Yeah, it totally is a red alert.
And that's where we've got customers
kind of screaming for it.
And at the root of it, like you have this idea
that you know, it's software.
I mean, talked about Devin, right?
Like, I mean, it's never been easier to write code, right?
It was like, I mean, already, weirdly, Python was an abstraction over like, you know, C++.
It's not as hard as C++.
It's gotten easier and easier.
And now, like, you're speaking in English and like, that's amazing, right?
It's like the Star Trek computer.
And it's a beautiful environment because code doesn't need to obey physics.
It just needs to render in your browser, right?
Now, suddenly you're making contract with nature, as we know, you guys go outside.
Like, nature's unforgiving, man.
It's not like, we don't like fixed a bunch of, we don't have space elevators.
We don't have jet packs.
No, we have like TikTok, which is great.
But like what about all of that?
And the problem is we're encountering this physics.
And so each test cycle, to your point about the Sonos is like, great, I have an idea.
I'm going to prototype it.
Like let me run it in my terminal.
It doesn't compile.
Great, I probably made a stupid mistake.
Everyone makes these.
But the cost of making a mistake at that speed and hardware, like worst case in our,
you get it wrong.
Something explodes.
But then even on the development cycle, each time you're like, oh, damn, the board was wrong.
I need to go and re-spin it.
That's like you're adding three months to the cycle.
And so these timelines and cost structures, I mean, you know, we all know how like how much the F-35 program cost and over-am.
It's like that explains it.
Like, I mean, there's a lot more that explains it.
But that's like a piece of it and an important piece of it.
Yeah.
Can you talk a little bit about where you see the most value to be delivered in the AI stack from it sounds like you're not doing pre-training on a foundation model?
Is found is fine-tuning important?
Is, you know, building a system on top of existing LLM is important?
Are you doing reasoning?
or is it more about UI and integration into existing systems?
There's so many different ways to create value in the stack right now.
I'm sure it can be kind of overwhelming, but how are you thinking about it?
Totally.
And it's a cool question because our own thinking on this has evolved quite a bit.
I would say we started with a view that was much more.
We kind of need to own all the pieces on the modeling side and solve the hard modeling problem.
And we sort of realized, like, what's happening is base cognitive functions
are just becoming available as an API.
So, like, vision is just going to be available.
We shouldn't work on a vision problem.
Like go fine tune like a, you know, YOL or whatever BLM is your favorite.
You know, LLMs are maturing.
But what we do find is if you think about like a person doing a word,
imagine like our objective as AI as we're trying to get as good as like a medium class person, let's say,
or like a junior person even, right?
And we unlock a value with that.
If you want to do that, now people do, you know, we think about, you talk about reasoning.
And there's a sort of like notion for reasoning in LLM land.
But like if we just think about human reasoning, there's like a nuanced kind of like,
Like, there are a couple of things that are special, right?
There's some sort of, like, especially in a formal environment, like electrical engineering,
there are certain rules of the world that we've learned over time that need to be true.
It's like, gravity is 9.8 meters per second square.
You can't probabilistically learn that by watching stuff fall in air and being like, yeah, my ML.
No, no, I mean, there's just some, like, speed of light.
Like, you're going to encounter that shit.
It doesn't matter if you're an ML model or like, you know, it's just real, right?
So there's some of these things with your hard constraints.
And, you know, where AI has struggled is you tell an engineer,
something obviously wrong, they're never trusting you again.
And they shouldn't, honestly.
Like you want to fly in a safe plane.
You don't want that happening.
So there's a piece here where it's like reasoning, but inside this sort of like structured
constraint and right, where there's a set of physics constraints that apply that you
sort of need, A to win trust the user, but B to work, right?
The second piece is it's this kind of multimodality where, again, I'm not saying we need to
build from the ground up those models, but you need to make sure you're getting really clean
input, right? And so that's input from, and it's weird. It's not like you're taking text input.
Text is, of course, a part of it. And I think the LLMs have gotten so good that it gives us an
ability to like really ingest a ton of text documentation. For sure, that's a piece. But now you're
also looking at the thing. You're looking at it visually. You're looking at thermally. Is it getting
hot? You're looking at readings from an oscilloscope. And each of those things has meaning to an engineer.
And the idea is, can you now tease the right meaning from that. And so a lot of our work is basically
on that data and fine tuning side, how do we turn all of that into a package that can be fed in
to a set of models?
And the other thing we found is, you know, a person is doing multiple different pieces of work.
A person might be saying, hey, I'm cross-referencing in some data sheets.
What should this FGAB expect to do?
Can this pane handle 10 volts at 100 degrees Celsius or is this thing, am I going to short out
the most expensive part?
So that's almost like a kind of a text-based look-up.
But then you're actually running a test.
You're comparing waveforms.
You're doing math.
you're running simulations.
And so what we found is we're using different systems to do the different,
like, different as agents to different pieces of the specialized workflow.
So you sort of have this like meta agent that you're talking to.
And then you have these others that are sort of, and the line blurs now between like,
what's an LM agent versus what's it calling, you know, we'll call tools.
But those tools, if you'd talk to me in like November 2020 before Chad GPT,
I would have been like, these are machine learning models and companies.
but they're just tools.
Now let's like, oh, I need a thermal recognition
stapled with like, you know,
the view from the waveform.
That's an ML model.
That doesn't need to be like a 600 billion parameter model,
but it's a non-trivial thing to do.
And so you can look at this entire constellation
as being that's sort of the product, if you would.
Got it.
One quote that comes to mind is,
we were promised flying cars
and said we got 140 characters.
I have to imagine that what you're building,
and other tooling like it can has a potential, you know, the exciting potential to me is
sort of getting us out of this period of stagnation, right? There's a lot of companies that are
building, you know, there's companies building supersonic jets, right? And they can use your tool.
And then there's all these other things that we've yet to even imagine or we imagine in science
fiction, but now we should probably think about building. How optimistic are you around,
you know, AI helping to accelerate and and help us sort of achieve these sort of like
science fiction dreams that we've had forever, but have never quite been reality.
First of all, I love the quote. I think definitely speaks to my heart. It's like, you know,
if you look at, and it's, it's an interesting question because it can feel sometimes like
reading the news like doom and gloom, AI is taking our jobs. And it's like, you know,
I'll go back to an example that I lived as a physics grad student, right? I spent a lot of time
And I supposedly came in to do physics.
I was like, oh, I'm going to do all this great quantum mechanics for research.
And I was basically like a mechanic and a plumber for like 99% of the time.
I was like, this thing is leaking.
I think there's a water leak.
Oh, the screw got bent.
Oh, like, I was not doing, I was doing like less than 1% of physics, right?
And I was like a, you know, that was the reality.
And I think that's a reality for a lot of us.
And so if you could take a lot of that away, like I think what, what it does is it changes to your point.
What human ambition should be?
Like, what could you achieve?
Let's say it takes 10 years on average to build a startup.
In the past, what we considered a SaaS company
is now just going to be a feature in the future, right?
And I think original Silicon Valley was about Silicon, right?
It was actually hardware-based.
And I think we're going to see a resurgence, hopefully,
that.
And our hope is, like, what gets me personally excited is
one of the magical moments at my last company, Kimono,
was you took someone who couldn't code
and you said, hey, wow, with this tool,
you could write a web scraper.
And it was like, we just got the most amazing,
like customer comments and I was like felt this joy of enabling people to do something and you know
hardware can be intimidating you're in like a hardware lab even in college you're like oh man this is
really complicated it's really there's a high barrier does it need to be that high you know it's like
we're seeing kids cheat on their essays with chat gpd that's a good thing you know will generate
more stuff what if we could let them cheat at e lab with this like would we have more people going
into hardware can we lower that barrier like what if you wanted to build a drone on the weekend like
you should be able to right you should have jarvis
I mean, the goal is to be Jarvis for,
and kind of enable everyone to be a little bit of a Tony Star.
I love it.
In your announcement post,
you highlighted five categories that it seems like you're going after
in the first initial rollout.
Semiconductors, aerospace, automotive, medical devices, and defense.
Is that sorted by market size,
like the burning need?
Just you like the way that it sounded in that order.
but I am interested to hear which of those has the most immediate need or is the largest market.
Yeah, it's a great question.
So we started with semiconductors, right?
So that's sort of why we put it first because, you know, the most complex, especially we think about a lot of what we do is electrical today.
Electrical engineering problems with something.
And if we take the philosophy of we want to be a little like Nike, start by selling it to the Olympic athletes and get everyone to buy it, that was sort of the proving ground.
And so we still have a few semiconductor companies, you know, that we're scaling up to.
But I think that's like a, you know, we all know the household names.
It's a small set that are really valuable.
But they established the credibility.
That actually helped us.
We had a few great companies then come in inbound based on that.
A lot of that was automotive and aerospace.
And it's interesting.
You think about like EVs and like non-autonomous driving and aerospace.
You have a huge amount of that coming in.
Medical devices, we've got an early customer in there.
And it's like, that's going really well.
You know, it's, it's, there's a whole like FDA angle to this that we sort of need
need to work through, we're newer that.
But it feels like the potential for impact is super high.
And so that's sort of like a little bit like the landscape.
I think we're seeing a ton of pull on the aerospace side.
Like especially if you look at that industry is getting, we're going to have more stuff that flies.
And then you introduce space to the mix.
And like airspace and defense like increasingly are kind of mixed.
So you look at these these things.
I think that's becoming kind of a unit in some way.
And so it feels like there's a ton happening there right now.
But yeah, I mean, that's sort of just a little bit.
There was not like a whole bunch of science behind that ordering.
Yeah, that makes sense.
I want to get your reaction to the tariffs.
It seems like you're probably an American company selling to a lot of American companies.
You know, regardless of what you think about the economics, it could potentially be a bull case for your company.
How do you process the news and what are you thinking about if it shifts your strategy at all over the next, you know, using this series B over the next couple of years?
Yeah.
So, you know, we actually do have a couple of international customers, too.
And, like, you know, I mean, obviously it's a huge impact, right?
I think the first thing we did was just, like, call them because we're like, are you okay?
You know, like, especially look at these, like the margins on something like a car have dramatically changed, right?
It's like you're doing some of the work here, you're doing some of the work there, some of it in America.
It's like, you know, there's a lot of American factories.
What percentage of the car is actually getting made here is a totally different question?
So you have a ton of like kind of panic in the system, right?
But you know, you're right.
Like for us, it's been like, it's accelerated customer pull and deployments.
They're like, oh, no, like, we can't go ahead and have like that gross margin impact and therefore I have to do this with people.
We need, we need technology.
And so it's actually a forcing function.
Like if part of this means that U.S. sort of quality and speed and sort of ability to manufacture needs to get up really quickly.
And I think this provided the economic incentive for it.
And it's just not there, honestly.
this is just an
accelerator, it's more fuel,
there's more urgency than there's ever been
on the customer side.
So yeah, I would say like
overall like a lot of like chaos there.
But net I think like
from our perspective, good because it means
there's a huge pull and like this problem
we talked about, you know,
we talked about the 90%
the changes in the in those people.
Like we suddenly need to do a lot of this
hard engineering in America.
And it's it's this finally put like a dollar amount
on how important that problem is.
How are you planning for kind of as AI technology gets better?
It feels like we're firmly in the co-pilot era.
There's a lot of talk about, oh, electrical engineering exam.
I'm sure that these models have aced them at the highest level.
And there's a prediction that, you know, AI will earn an IMOI gold medal this year.
And it's at like 50% on polymarket.
And yet I can't get AI agent to book my flight yet.
So how are you planning for integrating that,
taking advantage of what state of the art and amazing and what AI does well?
And then how are you building around the rough edges of the kind of innovation jagged edge?
Yeah.
You know, we think about this a lot because I feel like the question of defensibility
probably going to come up much sooner in a company's lifetime than it's ever done before.
And so it's sort of like playing with fire,
which is we want to be on the glide path where our product automatically gets better
as the Titans go to war and the foundation models improve, right?
Like, we just want to ride that wave.
But if we're just, that's what we're doing.
We're like, let's get documents from the internet and help you do cross-reference.
Okay, that's like not, that is going to disappear super fast.
And so, you know, to your point, it's tied in with like your math Olympiad or physics
Olympiad question, which is, you've got your friend who's the genius who's like really good at test, right?
And then you've got your friend who, I bet, is a different person who is really good at building stuff.
Usually they're not the same person somehow.
Like in my experience, they always do, does your tinkerer friend who didn't somehow get the A, right?
That tends to be the way.
And so we're not trying to pass the math Olympiad.
We're trying to be the guy who's tinkering in the garage, right?
And so the tinkering and garage problem is very unsolved.
Like you look at AI's capability there.
It's like, it's a disaster.
But as the base cognition gets better, you're getting better.
To be clear, like when I think about the guy tinkering in the garage, my, my dad was,
a was a high school teacher and he taught this class called Project Make.
And it was some combination of like wood shop meets electrical engineering,
meets physics and you know, you're making rockets and all that stuff.
So when I think about him solving problems, it's like the tinkerer in the garage and that he would
just try a lot of different things and experiment.
And the beautiful thing about AI is like I have memories as a kid of him working on one little
problem like for five hours like on a Sunday like trying to figure something out whether it's
around the home or in class and like he's basically running like a series of experiments right and so
the potential of AI is like run every experiment at once like in a simulated environment but like run
like a thousand experiments in like you know 10 minutes right and like when you start to think about
what that can do for like accelerating progress that's the most exciting thing for me because it's
a superhuman it's like the tinker in the garage but multiplied by million
Yeah, totally. I mean, I want to get your dad signed up with the sort of, we're working on like an academic condition.
I want to give him free access to that. See if he could even, we're looking for feedback. But I think that's, he's retired, but I'll put you guys in touch.
If he's still interested, if he's still got a garage. That'd be great. Well, I mean, thanks so much for stopping.
Here's the bar for the team. Five years from now, I want to be able to design our own podcast equipment. Oh, yeah.
The most cutting edge, you know, we need H-100s in these things.
Yeah, in the microphone.
I don't know why yet, but it sounds cool.
Yeah.
Feel.
Congratulations.
I do have one last question.
How much do you attribute your incredible energy levels to your, you know, being, being a triathlete.
Do you think it gives you an edge as an operator?
I would, I don't know.
I would hope so.
I do a lot less triathlon that I would like, but I feel like it does.
Training the pain threshold is a useful thing.
I think it's just a useful thing in life.
Yeah, that's awesome.
Love it.
Well, thanks so much for stopping by.
Congrats on the milestone.
For the series B.
Thanks for having me, guys.
Appreciate it.
We'll talk to you soon.
See it.
Have a good day.
Let's go to the timeline.
Justin Ross is quote tweeting.
Did you see the colossal company?
They have brought back Dyerwolves using ancient DNA with their first born on October 1st,
2024.
They waited a couple months to make sure that Dyer Wolf was healthy and growing.
Over 10,000 years since Dyerwolves.
were extinct. Can we do a deep dive on this? I have done a full video and deep dive on the company
Colossal. Remix. I was emailing with the company a while back. I'll rekindle that connection.
Hopefully have Ben, the founder on the on the on the on the show. He has a very funny collection
of investors, but some really great George Church from Harvard, uh, fantastically renowned scientists
is involved in and, uh, and they're working on cool stuff. So this post was put in the truth
zone. People said, hey, they're not technically dire wolves. They didn't really revive them using
ancient DNA. It's more genetic modification of existing dogs. A little bit of controversial.
But J.D. Ross chimes in and says, I don't care if these are real dire wolves or not. They're very
cute. And we should mix in golden retriever DNA and use them to hunt deer with us. And I couldn't
agree more. And you know where I would love to have a dire wolf hanging out and maybe go on some deer
hunting in a wander. I want to find my happy place. Find your happy.
place. Find your happy place. Bucklewander. Book of Wander with inspiring views, hotel
gritted, then he's dreamy beds, top tier cleaning, and 24-7 concierge service. It's a vacation home,
but better. Code TVPN. And I want to go to Mike Noop, who we had on the show, founder of Zapier.
He says, on the topic of AI is trained on all of humanity. Why can't innovate? A big question
that we're talking about. That question of the test taker versus the hacker, he says, new ideas come from
two places. One, noticing similarities between two existing ideas, new ideas in one area translate
into another, and two, logical construction, new ideas follow from prior axioms. One is easier and
bounded, and two is harder and open-ended. And Dorcas was talking about this. Like, if you've trained,
a lot of scientific innovation just comes from somebody who's read so much about the scientific
literature. They put together two random studies, and they find out that if you put those together,
you get innovation. And then that's true in all sorts of different individuals.
but specifically in just if you've read all the papers,
you've read all the books, you start making connections.
This is what David Senra does a lot with his show,
Founder's podcast, go download it.
And, but he says two is harder and open-ended.
Paradigm one can look a lot like career advice at the work,
to work at the intersection of two fields,
because it's easier to become an expert.
In contrast, being an expert in a single domain
requires much deeper hierarchical knowledge
and innovation requires novel in-domain idea construction.
This is the story of, you know,
you know, Elon Musk working in space and electric cars, maybe having both of those knowledge
sets multiplies in some way.
Two, he says it's harder because you don't know if innovation is blocked due to the prior
axioms not existing yet or if you just haven't combined them in the right way.
We want to build AGI that can innovate due to the fact that one is bounded search,
leverages ML strengths like pattern recognition and can bootstrap from human knowledge.
I think we will create AGI that can reliably do, number one.
one, well before number two.
Very, very interesting take.
And I just think it's like an interesting question
that he's clearly asking like these AIs,
they're blasting through all the benchmarks,
they're doing all these amazing things,
but we're not seeing innovation come out of them yet.
Or even you could think about like the joke test
is like you kind of need to be innovative
to come up with a joke.
Yeah.
It needs to come from something.
It needs to be new and fresh.
It's not just information retrieval.
The idea of like creativity is,
often just taking ideas from two different places and combining them in some way.
Yeah.
And it feels like the models do that very well today and that you can ask it to make me a,
you know, song.
Yeah.
It's not doing it, you know, independently.
It just like, you know, you have to sort of prompt it.
This was the genius of Harry Potter, Valenciaga.
Like the human element there that made that actually go viral wasn't the AI.
It was the idea that combining Harry Potter, kids' story with Balenciaga, high fashion, that was
funny and then the AI just instantiated it and I agree with you like the idea of of taking two disparate
concepts putting them together is where you get genius like take your best performing ad and put it on a
billboard with adquick.com like that's going to perform better that's right and so go to adquick
com out of home advertising made easy and measurable say goodbye to the ad quick basically took the
amazing attributes of online performance marketing and brought it into the real world that's actually what
they did that's true I'm serious we're not messing around yeah we are you get a dashboard you get
the different things that you expect when you're running a performance ad campaign online.
On Facebook, it gives you similar dashboards, but out in the real world, and they do a lot to
help you track the performance of your out-of-home campaigns.
I thought this was a funny one.
We'll move on to Quake 2.
Has been fully AI generated and replaced by Microsoft.
You can play it in a browser.
Every frame is created on the fly by an AI world model, so they trained it on Quake 2.
had the algorithm or the AI play a ton, generate a ton of frames,
and then just take the input from the controller,
output of the frames.
And so there's no game engine.
It's just input is what you're doing on the controller.
Output is the game with visual fidelity.
And you can see where this is going.
It's crazy.
It got a lot of hate.
Yeah.
Quake dad.
Quake dad.
Clearly a fan of Quake.
Dicated to the, committed to the bit, says,
Meanwhile, they haven't released a new Quake in like two decades.
So this guy has been in the trenches forever.
This is absolutely disgusting and spits on the work of every developer everywhere.
Bold.
John Carmack says, what?
Question mark?
This is impressive research.
And I love that because he's the creator of Quake.
And there was an amazing, there was an amazing meme that was like John Carmack holding a white monster being like, oh, you completely replicated exactly what I did.
Awesome work.
Based.
And it's like, the developer himself is like, this is cool.
But he did unpack it a little bit more, and so I want to read through this.
He says, I think you are misunderstanding what this tech demo actually is,
but I will engage with what I think your gripe is, AI tooling,
trivializing the skill sets of programmers, artists, and designers, and that's real.
My first games involved hand-assembling machine code.
What a code.
This is why he's one of the greatest programmers of all time.
And turning graph paper characters into hex digits.
Software progress has made that work as irrelevant as chariot wheel maintenance.
Yeah, you don't want to be in the business.
chariot wheel maintenance, not a big industry today. But building power tools is central to all
the progress in computers. Game engines have radically expanded the range of people involved in game dev,
even as they de-emphasize the importance of much of my beloved system and systems engineering.
Maybe first person to say that, systems engineering very, very hard. And it's a lot of, it's a huge
time suck to, I mean, when he built Quake, he had to build the whole game engine. He had to build
everything, the idea of a floor that you can't fall through a floor or a wall. You don't want to walk through the
wall. You have to write all that code from scratch. Instead, now you just fire up Unreal Engine and you
get Fortnite out of the box or you build it in Roblox, right? So he says AI tools will allow the best
to reach even greater heights while enabling smaller teams to accomplish more and bring in some
completely new creator demographics, people who don't know systems engineering or even programming,
for example. Yes, we will get to a world where you can get an interactive game or novel or
movie out of a prompt, but there will be far better exemplars of the media.
still created by dedicated teams of passionate developers.
And this is like the innovation concept,
this idea that, you know,
the Harry Potter Palenciaga game
will be the one that goes viral and gets a lot of attention.
If you have distribution, you can capitalize on that.
But also if you have a novel idea that AI couldn't think of,
you will have a breakout success.
And so we'll focus more on game mechanics,
game, like there was this game, Balatro,
that takes poker cards.
And you're basically playing poker
and trying to create like royal flushes and whatnot.
But it adds all these crazy mechanics on top of it.
It was a very simple game just designed in an engine,
not crazy on a technical level,
but the game design was so,
so incredible and so novel
that it just went massively viral
and like the solo developer, basically.
I think he had a few people on his team.
Just printed and became like the number one game of the year
or like that quarter on Steam or something like that.
Well, what should you do if you're printing, John?
pay your taxes that's for sure but your sales tax go to new normal H2 sales tax and autopilot spend less than
five minutes per month on sales tax compliance uh go get started they're back by what company your benchmark
five minutes a month you don't want to be bogged down and i mean this is true like you want to be focused on
the innovation that your company is doing you don't want to be dragged into a bunch of unnecessary
reports and and sales tax you can be thinking um your lucky stars that uh you're lucky stars that
You're not a part of the trade war right now.
Yep.
But take an opportunity to get your sales tax ducks in a row.
25 states are now taxing software sales.
And numeral helps you stay compliant.
So go to Numeril HQ and check them out.
Just do it.
And I think that's a good place to wrap up.
What do you think, George?
Yeah, fun show, John.
Great show.
I enjoyed podcasting with you today.
It was fantastic.
Can't wait to do it tomorrow.
I know.
I was so worried.
I checked the date in my intro, and I was like,
Is it Wednesday already?
It's not.
It's Tuesday.
We got three more days.
Glorious podcasting.
I know.
I have a feeling there'll be more news this week.
For sure.
The size gong hasn't rung its last gong sound.
The gong.
The gong is still fresh.
As long as we're.
Yeah, it's great.
Three amazing series Bs.
We got all three founders on.
I think we did great.
Three of a kind.
Jaze, a series B?
Oh, I guess.
Series B size.
Seed.
More of a precede.
Anyway, three big, three 10 plus million dollars in the tens of millions.
Great to see it.
Lots of money flowing into startups that we love to see, all working on very interesting things.
I remain bullish on America.
Me too.
Me too.
Anyway, thanks for listening.
Never lose faith.
We will see you tomorrow.
Have a great afternoon.
Have a great afternoon.
Cheers.
